The unified AI inference stack - from custom GPU kernels to production cloud serving on NVIDIA and AMD. 2x performance. Top open models. Open source stack. Backed by General Catalyst, Greylock and GV.
About the role
Modular is building a next-generation AI infrastructure platform that unifies fragmented application frameworks and hardware backends into a single, programmable system – making it easier to deploy AI in production while accelerating innovation across models and hardware.
What they're looking for
- 9+ years of product management experience, including significant work on technical cloud platforms, AI infrastructure, or data systems, or equivalent experience as a software or AI systems engineer
- Strong understanding of cloud architectures and technologies (e.g., Kubernetes), and/or experience with AI infrastructure platforms such as PyTorch, vLLM, CUDA, Vertex AI, SageMaker, or similar systems
- Experience defining product vision, shaping roadmap trade-offs, and driving products from early adoption toward broader production use
- Familiarity with security, privacy, and compliance considerations for cloud platforms
- Strong analytical and systems-level thinking, with the ability to reason about performance, scalability, and cost
- Excellent written and verbal communication skills, especially when working across technical and non-technical audiences
More about this role
At Modular, a Qualcomm company , we’re on a mission to revolutionize AI infrastructure by systematically rebuilding the AI software stack from the ground up. Our team, made up of industry leaders and experts, is building cutting-edge, modular infrastructure that simplifies AI development and deployment. By rethinking the complexities of AI systems, we’re empowering everyone to unlock AI’s full potential and tackle some of the world’s most pressing challenges.
If you’re passionate about shaping the future of AI and creating tools that make a real difference in people’s lives, we want you on our team. You can read about our culture and careers to understand how we work and what we value.
Modular is building a next-generation AI infrastructure platform that unifies fragmented application frameworks and hardware backends into a single, programmable system – making it easier to deploy AI in production while accelerating innovation across models and hardware. We’re looking for someone to drive the product vision for Modular’s cloud compute platform: a high-performance, scalable AI model-serving system designed for advanced GenAI developers, with deep visibility and control over...
Browse similar: Startup jobs · Remote jobs