d-Matrix is redefining AI inference with memory-centric compute built for ultra-low latency, greater efficiency, and scalable AI infrastructure.
About the role
The Inference Cloud Engineering team builds the deployment and orchestration technology behind d-Matrix’s inference services: an internal cloud where teams test and tune models, and a customer-facing Cloud with self-service inference endpoints and compute. Our accelerators run in on-premises clusters, and parts of the internal cloud also run in Azure. As the Staff Test & Release Engineer, you will own how this software is tested end to end and how it is released. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Experience testing or releasing LLM serving systems such as vLLM, SGLang, or TensorRT-LLM, including accuracy evals (such as GSM8K, HumanEval, MMLU) and performance benchmarks as release gates
- Familiarity with speculative decoding, disaggregated serving, or heterogeneous inference
- Hardware-in-the-loop testing experience, including qualifying software across driver, firmware, and hardware versions
- Experience with operator and controller testing tools such as envtest, kuttl, or chainsaw, and with upgrade and CRD version-migration testing
- Experience shipping software into customer-managed, on-premises Kubernetes environments, including compatibility matrices and customer install packaging
- Experience with canary or progressive rollouts for customer-facing services
More about this role
Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today. If you want to create what comes next and help make infinite inference possible, we’d love to hear from you.
Our culture is built on respect, collaboration, and direct communication. We value humility, we believe our different perspectives lead to better solutions, and we’re looking for people who are driven by execution and energized by hard problems.
The Inference Cloud Engineering team builds the deployment and orchestration technology behind d-Matrix’s inference services: an internal cloud where teams test and tune models, and a customer-facing Cloud with self-service inference endpoints and compute. Our accelerators run in on-premises clusters, and parts of the internal cloud also run in Azure. As the Staff Test & Release Engineer, you will own how this software is tested end to end and how it is...
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs