Groq is the premier neocloud for fast inference. One fully integrated platform for infrastructure, inference, and control. Millions of developers run trillions of tokens on Groq every week. Backed by Purple Arch Ventures.
About the role
GroqCore is building a high-performance software stack that converts bare metal compute into a token-producing engine This role is for a seasoned engineer with practical experience making LLMs fast, efficient, and reliable in production. This individual will work on an inference serving software stack from a trained model to a high-throughput delivery of output tokens. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- BS / MS / PhD in CS, CE, EE, or equivalent depth from industry
- 5+ years shipping performance-critical products, with some portion of that serving models at scale
- A strong applied understanding of transformer architectures
- Fluency in at least one systems language and one high-level language
- A rigorous, measurement-driven approach to performance work
- Clear communication about tradeoffs to both technical and business stakeholders
More about this role
About Groq
Inference is the engine that powers AI, and Groq was built from the silicon up to deliver the world's fastest inference at scale. We pioneered the LPU—the first processor designed specifically for AI inference—and are transforming that innovation into a global cloud platform powering production AI workloads.
With the capital, infrastructure, and team to execute, we're uniquely positioned to define the next era of AI infrastructure. The opportunity is massive, and it's still wide open. Now let's go build it!
GroqCore is building a high-performance software stack that converts bare metal compute into a token-producing engine This role is for a seasoned engineer with practical experience making LLMs fast, efficient, and reliable in production. This individual will work on an inference serving software stack from a trained model to a high-throughput delivery of output tokens. This will require experience on understanding/working with model internals, runtime software, and the supporting GPU & accelerator hardware underpinning it all.
- Build and optimize serving systems that handle high request volumes with low, predictable latency
- Apply model compilation and graph...
Browse similar: AI jobs · AI startup jobs · Startup jobs · San Francisco Bay Area