The unified AI inference stack - from custom GPU kernels to production cloud serving on NVIDIA and AMD. 2x performance. Top open models. Open source stack. Backed by General Catalyst, Greylock and GV.
About the role
MAX is Modular's inference tech stack, built to run GenAI models fast across NVIDIA, AMD, Qualcomm, Trainium, TPU and more. The MAX Kernel team is the performance foundation of that stack, developing kernels using Mojo, GEMM, attention (MHA/MLA/MSA), MoE routing and grouped matmul, and the portable tile abstractions that let one kernel lower to many targets. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- 3+ years as an engineering manager leading GPU kernel, compiler, HPC, or ML performance engineering teams. (minimum requirement)
- Strong cross-functional communication, able to drive technical decisions with tech leads and communicate status, risks and tradeoffs to engineering leadership and customers
- Track record of hiring, retaining and growing senior kernel or performance engineers
- Working knowledge of writing and optimizing GPU/accelerator kernels (CUDA, HIP/ROCm, Triton, CUTLASS/CuTe or similar)
- Deep understanding of profiling, benchmarking, and roofline analysis
- Experience with Mojo or other kernel and tile-level programming models (Triton, TileLang, CuTe)
More about this role
At Modular, a Qualcomm company , we’re on a mission to revolutionize AI infrastructure by systematically rebuilding the AI software stack from the ground up. Our team, made up of industry leaders and experts, is building cutting-edge, modular infrastructure that simplifies AI development and deployment. By rethinking the complexities of AI systems, we’re empowering everyone to unlock AI’s full potential and tackle some of the world’s most pressing challenges.
If you’re passionate about shaping the future of AI and creating tools that make a real difference in people’s lives, we want you on our team. You can read about our culture and careers to understand how we work and what we value.
MAX is Modular's inference tech stack, built to run GenAI models fast across NVIDIA, AMD, Qualcomm, Trainium, TPU and more. The MAX Kernel team is the performance foundation of that stack, developing kernels using Mojo, GEMM, attention (MHA/MLA/MSA), MoE routing and grouped matmul, and the portable tile abstractions that let one kernel lower to many targets.
As the Engineering Manager of the MAX Kernel team, you will lead a team of kernel engineers, own the kernel roadmap and the per-model ×...
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs