Inferact is a startup founded by creators and core maintainers of vLLM, the most popular open-source LLM inference engine. Our mission is to grow vLLM as the world. Backed by Sequoia and Redpoint.
About the role
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build.
What they're looking for
- Bachelor's degree or equivalent experience in computer science, engineering, systems, infrastructure, or similar
- Hands-on experience building or operating production distributed systems, cloud infrastructure, or services where reliability has meaningful user or business impact
- Strong programming or scripting ability in Python, Go, Bash, or similar, with experience building tools and automation that solve operational problems
- Experience responding to significant production incidents, including mitigation, root cause analysis, escalation, and following corrective actions through to completion
- Practical understanding of service-level objectives (SLOs), service-level indicators (SLIs), error budgets, and alerting that distinguishes user-impacting failures from noise
- Strong Linux, networking, and systems debugging fundamentals, with the ability to investigate failures across application and infrastructure boundaries
More about this role
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build.
We're looking for a Site Reliability Engineer to make Inferact's vLLM-powered inference services dependable in production. You'll work alongside the engineers building the platform, bringing a reliability perspective to how systems are designed, shipped, and operated. This is a hands-on engineering role for someone who thinks about failure before launch, simplifies operations, and writes software that makes reliable inference possible at scale.
You'll help own reliability across the production lifecycle, from release safety and observability to incident response and recovery. You'll define SLOs around availability, latency, and successful inference requests; build monitoring that helps engineers pinpoint failures; and automate recurring operational work. When incidents occur, you'll drive mitigation, coordinate escalation, and lead post-mortems that result in concrete prevention work. You'll also partner...
Browse similar: AI jobs · AI startup jobs · Startup jobs · San Francisco Bay Area