Groq is the premier neocloud for fast inference. One fully integrated platform for infrastructure, inference, and control. Millions of developers run trillions of tokens on Groq every week. Backed by Purple Arch Ventures.
About the role
As a Sr./Staff Forward Deployed Engineer focused on AI Infrastructure at Groq, you will work at the frontier of large-scale AI systems, taking complex customer infrastructure programs from requirements to working production environments. You’ll help bring some of the newest accelerator and infrastructure technologies into production, spanning next-generation NVIDIA GPU systems alongside Groq’s purpose-built inference platform. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Own technical execution across complex customer engagements, from discovery and architecture through PoCs, demos, deployment, cluster bring-up, validation, acceptance, production readiness, and operational handoff
- Translate incomplete or ambiguous customer requirements into practical architectures, implementation plans, test criteria, runbooks, and concrete engineering actions
- Work hands-on across Linux, bare-metal infrastructure, Kubernetes and Slurm, networking, storage, observability, automation, and Groq platform integrations to bring customer environments online and resolve issues
- Support large-scale GPU and LPX deployments, including infrastructure bring-up, cluster health and performance validation, workload testing, benchmarking, failure isolation, and production-readiness evidence
- Understand customer AI workloads well enough to reason about training and inference behavior, concurrency, throughput, latency, data movement, caching, scheduling, and infrastructure bottlenecks
- Troubleshoot production and pre-production issues that cross organizational or technical boundaries, drive them to resolution, and coordinate the right internal experts without losing end-to-end ownership
More about this role
About Groq
Inference is the engine that powers AI, and Groq was built from the silicon up to deliver the world's fastest inference at scale. We pioneered the LPU—the first processor designed specifically for AI inference—and are transforming that innovation into a global cloud platform powering production AI workloads.
With the capital, infrastructure, and team to execute, we're uniquely positioned to define the next era of AI infrastructure. The opportunity is massive, and it's still wide open. Now let's go build it!
Mission
As a Sr./Staff Forward Deployed Engineer focused on AI Infrastructure at Groq, you will work at the frontier of large-scale AI systems, taking complex customer infrastructure programs from requirements to working production environments. You’ll help bring some of the newest accelerator and infrastructure technologies into production, spanning next-generation NVIDIA GPU systems alongside Groq’s purpose-built inference platform.
You will operate across GroqCloud, GroqMetal (Groq’s infrastructure platform), GPU and LPX infrastructure, and the networking, storage, orchestration, observability, and workload layers around them. This is an opportunity to work on...
Browse similar: Startup jobs