Connectionism: Research Blog by Thinking Machines Lab. Backed by a16z, Accel and GV.
About the role
We're hiring a Software Engineer, Inference to own the reliability, scale, and efficiency of the systems that serve our models to real users. Our research and inference teams push the limits of model performance and serving efficiency; this role makes sure those gains reach production safely and stay up — powering Tinker's live, multi-tenant serving and the products built on top of our models. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Experience operating large-scale, latency-sensitive production systems
- Proficiency in Python and Go or another systems language
- Experience with observability, monitoring, and incident response for production services
- Strong understanding of distributed systems and how they fail at scale
- Experience running production inference for large language models or other large-scale ML systems
- Experience with deployment and rollout systems, such as canarying, blue/green deploys, or feature flags
More about this role
The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.
We're hiring a Software Engineer, Inference to own the reliability, scale, and efficiency of the systems that serve our models to real users. Our research and inference teams push the limits of model performance and serving efficiency; this role makes sure those gains reach production safely and stay up — powering Tinker's live, multi-tenant serving and the products built on top of our models.
This is a production-facing systems role at the center of the company. You'll be the bridge between cutting-edge inference techniques and the day-to-day reality of serving real traffic: rollouts, capacity, incidents, and everything that keeps a fast-growing platform online.
Operate and scale the production inference systems that serve live traffic, including Tinker's multi-tenant serving platform
Own the rollout process for new models, model versions, and...
Browse similar: AI jobs · AI startup jobs · Startup jobs · San Francisco Bay Area