Senior MLOps / LLMOps Engineer

About the role

Build and operate scalable ML and LLM-based systems in production, with a focus on self-hosted models, evaluation frameworks, and platform reliability. You will help shape Scout24's AI platform by enabling teams to efficiently develop, deploy, and scale both traditional ML and generative AI solutions for multi-modal use cases.

What you'll do

• Design and maintain scalable ML/LLM infrastructure and pipelines
• Productionize traditional ML and generative AI solutions with cross-functional product teams
• Own the ML/LLMOps lifecycle: prompting, deployment, monitoring, evaluation and optimization
• Build and evolve an LLM Gateway service to standardize access, routing, and governance
• Develop evaluation frameworks to measure quality, performance, and reliability of LLM outputs
• Design and implement MCP-compatible services to enable standardized context exchange between LLMs, tools, and data sources
• Work with AWS and integrate self-hosted open-source AI models for scalable, secure applications
• Ensure observability, cost efficiency, and system performance

What you'll need

• Strong experience in MLOps (CI/CD, Docker, Kubernetes) and operating production-grade systems
• Proficiency in Python and solid software engineering and scalable system design skills
• Hands-on experience with LLMs and generative AI technologies (e.g. GPT, Gemini or Anthropic-like models)
• Expertise in prompt engineering, agent orchestration, context management, and output validation
• Experience with LLM evaluation frameworks and deploying self-hosted LLMs
• Familiarity with cloud platforms (e.g. AWS, GCP) as well as DevOps, testing, and observability practices
• Strong communication skills and ability to collaborate with cross-functional teams and stakeholders

What they offer

• Competitive salary package and bonus
• Hybrid work model with three days on-site per week and 30 days vacation annually
• Work from abroad up to 10 days per year
• Professional development with dedicated learning time, ScoutAcademy courses, and career paths
• Relocation support with visa assistance and relocation package
• Modern office in Berlin with gym, rooftop terrace, and latest technical tools and hardware