Deploy, secure, and scale LLMs and AI agents with TrueFoundry's enterprise AI Gateway and MCP Gateway. Rate limiting, observability, and compliance built in. Backed by Peak XV.
About the role
You'll be the primary post-sales technical point of contact for TrueFoundry's largest AI Gateway customers - champion internally, trusted architect externally. Your customers are large enterprises with complex org structures, procurement cycles, and compliance requirements; they aren't just calling models, they're governing LLM traffic, MCP tool access, and autonomous agents across dozens of teams.
What they're looking for
- Intelligent routing with observability, cost policies, and fallback logic
- Centralized tool and MCP server management with security and lifecycle controls
- Agent orchestration with governance and guardrails
- A unified compute layer to run self-hosted models, custom tools, and agents
- Design access-control models and unified authorization across model calls, MCP tools, and agent-to-agent calls
- Advise on guardrail strategy - Validate/Mutate modes, phased rollout from Audit to Enforce for PII, prompt injection, and content moderation
More about this role
Every production AI system whether it's powering customer support, writing code, analyzing financial data, or diagnosing medical conditions needs the same foundational infrastructure.A way to route between models. A way to manage tools and integrate them securely. A way to orchestrate agents and enforce governance. A unified compute layer to run it all.
We are looking for a Senior Technical Customer Architect to join the team.
Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.
The infrastructure to support this doesn't exist yet. You can't just duct-tape together a few API calls and call it production-ready.
- Intelligent routing with observability, cost policies, and fallback logic
- Centralized tool and MCP server management with security and lifecycle controls
- Agent orchestration with governance and guardrails
- A unified compute layer to run self-hosted models, custom tools, and agents
AI Gateway is the control plane five composable...
Browse similar: Startup jobs · San Francisco Bay Area