Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems. Backed by Accel, Bessemer and General Catalyst.
About the role
Anthropic’s Inference organization serves Claude to millions of users and enterprise customers, across our own products and the world’s largest cloud platforms, with the speed, reliability, and efficiency that frontier AI demands. The stack that makes this possible is deep and tightly coupled: accelerator kernels, an in-house inference engine that manages the entire token path for both production and research workloads, distributed routing, autoscaling, and capacity management. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- A working understanding of how LLM inference uses hardware (prefill and decode, batching, caching, compute versus memory bandwidth versus interconnect), or a track record of getting deep in an unfamiliar technical domain quickly
- A track record of building program mechanisms from scratch on ambiguous, fast-moving efforts, and of retiring process that has stopped earning its keep
- The ability to drive outcomes across organizations you don't manage, with competing priorities and unclear decision ownership. You read people and rooms well, know when to push and when to listen, and earn the trust of senior engineers and researchers
- Strong written communication, including plans, reviews, and executive updates that many teams depend on
- Low ego and high ownership. You do whatever the program needs, whether that is writing a script, running an incident bridge, or chasing a quota, and you care more about the outcome than about scope or credit
- Care about Anthropic's mission and about serving frontier AI safely and reliably
More about this role
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
Anthropic’s Inference organization serves Claude to millions of users and enterprise customers, across our own products and the world’s largest cloud platforms, with the speed, reliability, and efficiency that frontier AI demands. The stack that makes this possible is deep and tightly coupled: accelerator kernels, an in-house inference engine that manages the entire token path for both production and research workloads, distributed routing, autoscaling, and capacity management. Every layer affects the others, often in ways that are hard to see in isolation. We build across GPUs, TPUs, and Trainium, and the complexity of building, testing, and shipping inference software grows with every platform we add.
We're looking for a Technical Program Manager to drive the programs that scale it. The work spans four closely coupled areas:
Scaling and infrastructure. Routing,...
Browse similar: AI jobs · AI startup jobs · Startup jobs · San Francisco Bay Area