Startups · AI

Sr. Software Engineer, Training/Inference (C++)

xAI · Palo Alto, CA · On-site

← All jobs
About xAI

SpaceXAI builds Grok — frontier AI models for reasoning, voice, image generation, and more. Build with the Grok API. Backed by Lightspeed, Sequoia and a16z.

About the role

At SpaceXSI we are building the high-performance inference platform that serves Grok to millions of users every day. As a Software Engineer, Training/Inference (C++), you will design and optimize large-scale model serving systems end-to-end. You will own everything from distributed infrastructure – global KV cache, continuous batching, load balancing, auto-scaling – to deep low-level optimizations, including GPU kernels, quantization, speculative decoding, and tail latency. Found on 1752vc Careers, the job board for startup and VC roles.

What they're looking for

  • Bachelor’s degree in computer science, computer engineering, or science discipline
  • 5+ years of experience with low-level system programming experience in C/C++ or Rust
More about this role

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.

SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next.

At SpaceXSI we are building the high-performance inference platform that serves Grok to millions of users every day. As a Software Engineer, Training/Inference (C++), you will design and optimize large-scale model serving systems end-to-end. You will own everything from distributed infrastructure – global KV cache, continuous batching, load balancing, auto-scaling – to deep low-level...

Read the full posting on xAI's site ↗

Infrastructure

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.