AI Platform Engineer
Scalable Capital
Seniority
Midweight
Model
In-Office
Sector
Salary
Undisclosed
Contract
Full-Time
About the role
As an AI Platform Engineer embedded within the Data Science and AI tribe, you will design and maintain the foundational infrastructure that enables AI Software Engineers to build and scale generative AI applications. You will build an internal AI provisioning platform, focusing on seamless model access, observability, and strict governance.
What you'll do
- Develop and maintain an internal AI provisioning platform to streamline access to various LLMs & MCP Servers (e.g., via LiteLLM).
- Implement comprehensive LLM observability, logging, and alerting systems using tools like Datadog and Langfuse.
- Enforce model governance, ensuring security, data privacy, rate limiting, and strict LLM API cost management.
- Collaborate closely with embedded AI Software Engineers to support cloud-native architectures and agentic workflow integrations.
- Build and maintain infrastructure for monitoring the reliability and performance of production AI systems.
What you'll need
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
- 2+ years of professional experience in Platform Engineering, DevOps, SRE, or backend software development.
- Strong experience and confidence working with cloud infrastructure (AWS preferred) and Infrastructure as Code (Terraform).
- Proficiency in at least one programming language (e.g., Python, Go) and experience with CI/CD pipelines and containerization (e.g., Docker).
- Solid understanding of API cost management, rate limiting, security best practices, and data privacy for AI models.
- Experience with, or a strong willingness to learn, LLM gateways, observability platforms, and telemetry (e.g., LiteLLM, Langfuse, Datadog).
What they offer
- Latest hardware and tools for productivity.
- Individual Education Budget and in-house knowledge sharing sessions.
- Free German language classes.
- Attractive compensation package and company pension scheme.
- Flexible and discounted sports activities with Urban Sports Club.
- Opportunity to work from abroad.