# Runtime Engineer at MatX

- Company: MatX
- What the company does: We make the best chips physically possible for the large model needs of frontier labs.
- Company website: https://matx.com
- Type: Startups
- Level: Mid level
- Location: Mountain View (HQ) or Remote
- Work setup: Remote
- Pay: $160K to $250K base salary per year (USD)
- Posted: 2026-05-27
- Apply by: 2026-10-08
- Apply: https://jobs.ashbyhq.com/matx/83eeb688-261b-4723-8f3f-90475a6e10cf
- Page: https://www.1752.vc/careers/jobs/matx-runtime-engineer/

## About the role

Build the host-side interface library — device memory management, DMA, streams and events, sync primitives — that every compiler-emitted program runs on top of Own and extend the executable format: the compiler→runtime contract, its versioning, the weight and quantization layouts that let compiler and runtime evolve independently

## What they're looking for

- Strong experience in a systems programming language — Rust, C, C++, or Go — including memory management, allocator design, and FFI/ABI work
- Have built Python interop layers in production (PyO3, ctypes, pybind11, or equivalent C-ABI bridging)
- Have designed and maintained API or ABI contracts between teams — versioning, evolution, breaking-change discipline — not just consumed someone else's
- Hands-on with at least one accelerator programming model (CUDA, ROCm, oneAPI Level Zero, TPU, or comparable) — enough to reason about device memory, async execution, and kernel launch
- ML-systems literate — comfortable with the training and inference loop, what collectives do, what a tensor layout is. Research depth not required
- LLM inference internals — vLLM, TensorRT-LLM, or SGLang (paged attention, scheduler design)

Tags: Software