Senior Engineer - Data & Platforms

You will act as a key technical authority shaping the evolution of our core data platform, which powers proprietary equity research and AI-driven analytics. Operating at petabyte scale and under real-world production constraints, you will define architectural direction, drive critical platform decisions, and ensure the system scales reliably as a long-term strategic asset.

What you'll do

• Design, build, and operate large-scale data pipelines and platform components handling complex, high-volume datasets.
• Contribute to the evolution of our data platform architecture (lakehouse/warehouse, orchestration, processing frameworks) with a strong focus on robustness and scalability.
• Improve data quality and reliability through testing, validation, and safe rollout patterns for pipelines and backfills.
• Strengthen operational excellence by improving observability, monitoring, alerting, and cost awareness across the data platform.
• Contribute to secure and compliant data handling practices, including access controls, secrets management, and auditing.
• Lead complex technical initiatives end-to-end while remaining hands-on in implementation.
• Raise engineering standards through code reviews, design discussions, and mentoring.
• Collaborate closely with researchers, data scientists, and other stakeholders to translate analytical and business needs into scalable engineering solutions.

What you'll need

• Several years of relevant industry experience building and operating production-grade data or platform systems.
• Strong Python and SQL skills, applied with clean engineering and testing practices.
• Experience with distributed data processing frameworks and modern data platforms (e.g. Databricks/Spark, Snowflake, or comparable technologies).
• Solid understanding of data modeling, pipeline design, schema evolution, backfills, and failure modes in large-scale data systems.
• Experience working with cloud infrastructure (preferably AWS) and production environments.
• Experience building and operating APIs using at least one of Django REST Framework (DRF), Flask, or FastAPI.
• A strong quality mindset: you care deeply about correctness, reliability, and long-term maintainability.
• Ability to lead technically through influence, sound judgment, and example.

Nice to have

• Experience with infrastructure as code, CI/CD, and containerized environments.
• Practical experience improving security in data platforms.
• Exposure to financial data, research workflows, or investment-related use cases.
• Experience supporting or operating LLM-based systems in production (e.g. RAG pipelines, evaluation, LLMOps).

What they offer

• Work with petabytes of data, leveraging the most cutting-edge tools
• Work with the brightest minds in the industry and become part of a unique success story in Europe
• An experienced, international team with professional colleagues and strong experts for an inspiring network
• Flat hierarchy and direct interaction with the management and senior staff of BIT Capital
• Competitive compensation package as well as relocation and visa support