Senior AI / LLM Engineer – Agent Developer
Blocks
Seniority
Senior
Model
In-Office
Sector
Salary
Undisclosed
Contract
Full-Time
You'll build the conversational and task-driven agents behind Major Tom, our Slack bot. You'll build agents and MCP server tools that pull data from our data lake and data warehouse to analyze AWS billing, cloud resource usage, and related operational data. Your immediate focus: Build the first production agent, deliver it through our Slack bot, and define the architectural scaffold for our broader agent ecosystem.
What you'll do
- Build production LLM agents that call tools, pull internal data, and return structured, accurate answers using function-calling and agent frameworks
- Build retrieval and RAG pipelines over proprietary data including embeddings, vector databases, and metadata filtering
- Version and evaluate prompts and tool policies with regression tests, hallucination checks, and offline evaluation stacks
- Leverage MCP-style tool servers to expose internal cost and usage data
- Work with DevOps, AI, backend, and frontend teams to bring Major Tom to life and make key architectural decisions supporting growth from startup to enterprise
What you'll need
- Shipped a production LLM assistant/agent that calls tools, pulls internal data, and returns structured, accurate answers using OpenAI / Claude / Gemini style function-calling plus ReAct/agent frameworks (LangChain / LangGraph / Pydantic AI)
- Built retrieval / RAG pipelines over proprietary data with embeddings, vector DB, metadata filtering, and context window management
- Versioned and evaluated prompts and tool policies like code with regression tests, hallucination/accuracy checks, and evaluation tools
- Shipped 0→1 products fast with high ownership, autonomy, and accountability
- Curious, pragmatic problem solver who experiments quickly, learns deeply, and optimizes for impact
What they offer
- Build AI shipped into production that changes how companies run cloud infrastructure
- Work with founders who've built unicorns and raised $1B+
- Real ownership and the opportunity to build zero-to-one product infrastructure
- Top market cash compensation plus meaningful equity upside
- Berlin, in-person by design with relocation support
