# Engineering Manager, Hardware Bringup at Modular

- Company: Modular
- What the company does: The unified AI inference stack - from custom GPU kernels to production cloud serving on NVIDIA and AMD. 2x performance. Top open models. Open source stack. Backed by General Catalyst, Greylock and GV.
- Company website: https://www.modular.com/
- Type: Startups
- Level: Senior
- Location: United States - Remote
- Work setup: Remote
- Pay: $216K to $372K base salary per year (USD)
- Posted: 2026-08-20
- Apply by: 2026-10-08
- Apply: https://jobs.gem.com/modular/am9icG9zdDo8-b3ZXRNlNpal_TfkogiQ
- Page: https://www.1752.vc/careers/jobs/modular-engineering-manager-hardware-bringup/

## About the role

ML developers today face significant friction in taking trained models into deployment. They work in a highly fragmented space, with incomplete and patchwork solutions that require significant performance tuning and non-generalizable, model-specific enhancements. At Modular, we are building the next generation AI platform that will radically improve the way developers build and deploy AI models.

## What they're looking for

- 7+ years of industry experience in compiler engineering, high-performance computing, kernel development, or related domains, with 2+ years managing engineers (strong IC-to-manager transitions welcome)
- Strong technical foundation in compilers, systems software, or accelerator programming
- Sufficient to be hands-on with the team's codebase, lead architecture discussions, and credibly review designs in MLIR/LLVM, kernel codegen, or runtime systems
- Proficiency in C++ and direct experience working in complex, multi-component software systems
- Hands-on experience with at least one heterogeneous programming model (CUDA, SYCL, OpenCL, or similar), as a contributor rather than only a user
- Demonstrated track record of delivering multi-quarter technical roadmaps with external dependencies, including managing scope, risk, and external commitments