# Sr. Staff Inference Serving Engineer at Groq

- Company: Groq
- What the company does: Groq is the premier neocloud for fast inference. One fully integrated platform for infrastructure, inference, and control. Millions of developers run trillions of tokens on Groq every week. Backed by Purple Arch Ventures.
- Company website: https://groq.com
- Type: Startups (AI role)
- Level: Senior
- Location: Dallas, United States
- Work setup: On-site
- Pay: $341K to $402K base salary per year (USD)
- Posted: 2026-10-09
- Apply by: 2026-11-23
- Apply: https://jobs.gem.com/groq/am9icG9zdDpv-6vxL7UScmwdiQHb7RVH?utm_source=1752vc&utm_medium=careers
- Page: https://www.1752.vc/careers/jobs/groq-sr-staff-inference-serving-engineer/

## About the role

GroqCore is building a high-performance software stack that converts bare metal compute into a token-producing engine This role is for a seasoned engineer with practical experience making LLMs fast, efficient, and reliable in production. This individual will work on an inference serving software stack from a trained model to a high-throughput delivery of output tokens. Found on 1752vc Careers, the job board for startup and VC roles.

## What they're looking for

- BS / MS / PhD in CS, CE, EE, or equivalent depth from industry
- 5+ years shipping performance-critical products, with some portion of that serving models at scale
- A strong applied understanding of transformer architectures
- Fluency in at least one systems language and one high-level language
- A rigorous, measurement-driven approach to performance work
- Clear communication about tradeoffs to both technical and business stakeholders


Source: 1752vc Careers, https://www.1752.vc/careers/jobs/groq-sr-staff-inference-serving-engineer/