# Senior AI/ML Engineer — LLM & Agent Stack (Customer Facing) at TrueFoundry

- Company: TrueFoundry
- What the company does: Deploy, secure, and scale LLMs and AI agents with TrueFoundry's enterprise AI Gateway and MCP Gateway. Rate limiting, observability, and compliance built in. Backed by Peak XV.
- Company website: https://www.truefoundry.com/
- Type: Startups (AI role)
- Level: Senior
- Location: San Mateo, San Francisco Bay Area
- Work setup: On-site
- Posted: 2025-08-13
- Apply by: 2026-10-08
- Apply: https://app.careerpuck.com/job-board/truefoundry/job/4884548008?gh_jid=4884548008
- Page: https://www.1752.vc/careers/jobs/truefoundry-senior-ai-ml-engineer-llm-and-agent-stack-customer-facing/

## About the role

Architect and implement scalable agent orchestration patterns (graph-based executors, state management, multi-agent coordination) for production workloads. Own critical integrations: model adapters, LLM gateway hooks, vector DBs, tools & external APIs, and the platform’s LLMops flows.

## What they're looking for

- 5–10 years of software engineering with substantial experience building distributed systems, infra, or ML platforms
- Deep practical experience integrating and deploying LLMs in production (RAG, retrieval, embeddings pipelines)
- Hands-on experience with agent orchestration frameworks (LangGraph / LangChain or custom agent runtimes) and stateful workflow design
- Strong systems knowledge: Kubernetes, container orchestration, service meshes, and performance tuning
- Proven track record building observability, cost controls, and policy enforcement for production services

Tags: Engineering