Groq is the premier neocloud for fast inference. One fully integrated platform for infrastructure, inference, and control. Millions of developers run trillions of tokens on Groq every week. Backed by Purple Arch Ventures.
About the role
GroqMetal is building the infrastructure platform that turns large-scale physical compute into a reliable, isolated, customer-consumable AI infrastructure. This is a hands-on Senior Staff role: you will write production software as part of a software engineering team. You will lead the design of a Kubernetes-based software platform focused on large-scale AI training and inference workloads. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Experienced software engineers first: Strong experience designing, implementing, testing, shipping, and maintaining production software
- Deep Kubernetes platform engineering experience: Experience with operators/controllers, CRDs, admission control, node lifecycle, cluster services, and production-grade platform design
- Strong distributed-systems expertise: Practical experience reasoning about CAP, consensus, leader election, eventual consistency, state reconciliation, fault domains, and recovery
- Experience developing infrastructure software: Experience working through a robust SDLC, including design review, automated testing, CI/CD, staged rollout, rollback, observability, and incident learning
- Comfort with ambiguity: Experience with inference platforms, accelerator/GPU infrastructure, device plugins, cloud infrastructure, or customer-facing platform products
More about this role
About Groq
Inference is the engine that powers AI, and Groq was built from the silicon up to deliver the world's fastest inference at scale. We pioneered the LPU—the first processor designed specifically for AI inference—and are transforming that innovation into a global cloud platform powering production AI workloads.
With the capital, infrastructure, and team to execute, we're uniquely positioned to define the next era of AI infrastructure. The opportunity is massive, and it's still wide open. Now let's go build it!
GroqMetal is building the infrastructure platform that turns large-scale physical compute into a reliable, isolated, customer-consumable AI infrastructure. This is a hands-on Senior Staff role: you will write production software as part of a software engineering team. You will lead the design of a Kubernetes-based software platform focused on large-scale AI training and inference workloads. You will be a key technical leader in building the systems that turn cutting-edge physical infrastructure into a stable product.
- Design and build core Groq platform systems: APIs, controllers, operators, reconciliation loops, and infrastructure abstractions.
- Remain deeply...
Browse similar: Startup jobs · San Francisco Bay Area