# Senior AI Runtime Engineer at Modular

- Company: Modular
- What the company does: The unified AI inference stack - from custom GPU kernels to production cloud serving on NVIDIA and AMD. 2x performance. Top open models. Open source stack. Backed by General Catalyst, Greylock and GV.
- Company website: https://www.modular.com/
- Type: Startups (AI role)
- Level: Senior
- Location: United States - Remote
- Work setup: Remote
- Posted: 2026-09-11
- Apply by: 2026-10-26
- Apply: https://jobs.gem.com/modular/am9icG9zdDrbpfE9JtgR-MYS5XN027JD
- Page: https://www.1752.vc/careers/jobs/modular-senior-ai-runtime-engineer/

## About the role

ML developers today face significant friction when deploying trained models. They work in a fragmented space with incomplete, patchwork solutions that require extensive performance tuning and model-specific optimizations. At Modular, we are building the next-generation AI platform that will radically improve how developers build and deploy AI models.

## What they're looking for

- 5+ years of experience working on high-performance computing systems
- Experience in C++ programming and complex software systems
- Experience with CPU or GPU runtime optimizations and performance analysis on CPUs, GPUs, or AI accelerators
- Proficiency with one or more profiling tools (CPU or GPU)
- Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture
- Experience with ML graph optimizations, parallel / distributed programming, heterogeneous ML computation, and/or code generation