Hyperbolic is the open-access AI cloud made for AI developers, providing fast, affordable access to compute, inference, and AI services. Backed by Polychain Capital.
About the role
We're looking for an Inference Engineer to build inference capabilities on top of Forge, our unified control plane, so customers can consume model tokens without managing GPUs and our NeoCloud partners get a full-stack path to their own token-factory offering. You'll own how models get deployed and served across clusters distributed around the world, on heterogeneous hardware.
What they're looking for
- Strong general inference background with a broad, high-level command of the stack rather than a narrow specialty — you can reason about the whole path from request to token
- Deep Kubernetes experience, including hands-on ability to operate clusters in production, not just deploy to them
- Solid grasp of the concepts that govern inference performance: TTFT, disaggregated inference, speculative decoding, and KV cache and its inner workings
- Familiarity with modern inference frameworks and serving engines, and the judgment to evaluate and select among them for a given workload
- Working knowledge of NVIDIA Dynamo and how it fits into a distributed serving architecture
- Experience setting up monitoring, gateways, and endpoints for production inference services
More about this role
Hyperbolic Labs is on a mission to democratize AI by breaking down the barriers to computing power with our Open-Access AI Cloud. By making better use of idle computing resources across the globe, we offer an innovative GPU marketplace and AI inference service that promise affordability and accessibility for all. As pioneers at the intersection of AI and open-source technology, we believe in an open future where AI innovation is limited only by imagination, not by access to resources. We're looking for forward-thinking individuals who share our passion for making AI universally accessible, secure, and affordable. Join us in building a platform that empowers innovators everywhere to turn their visionary AI projects into reality.
We're looking for an Inference Engineer to build inference capabilities on top of Forge, our unified control plane, so customers can consume model tokens without managing GPUs and our NeoCloud partners get a full-stack path to their own token-factory offering. You'll own how models get deployed and served across clusters distributed around the world, on heterogeneous hardware.
Deployment comes first: serving models on Forge and our Kubernetes offering,...
Browse similar: AI jobs · AI startup jobs · Startup jobs · San Francisco Bay Area