d-Matrix is redefining AI inference with memory-centric compute built for ultra-low latency, greater efficiency, and scalable AI infrastructure.
About the role
The Inference Cloud Engineering team builds the deployment and orchestration technology behind d-Matrix’s inference services: an internal cloud where teams test and tune models, and a customer-facing Cloud with self-service inference endpoints and compute. As the team’s Inference Performance Engineer, you will own end-to-end performance of the workloads we deploy, from the moment a request arrives to the moment a result is returned. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Experience with LLM serving frameworks such as vLLM, SGLang, or TensorRT-LLM
- Hands-on experience building or tuning speculative decoding, disaggregated serving, or heterogeneous serving architectures
- Experience tuning KV-cache management, request and batch scheduling, or weight prefetch and residency in an LLM serving system
- GPU programming and profiling experience (such as CUDA, Nsight, NCCL), valued as transferable background
- Experience with pre-production or bring-up hardware, or in organizations where root causes routinely cross team boundaries
- Rust experience
More about this role
Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today. If you want to create what comes next and help make infinite inference possible, we’d love to hear from you.
Our culture is built on respect, collaboration, and direct communication. We value humility, we believe our different perspectives lead to better solutions, and we’re looking for people who are driven by execution and energized by hard problems.
The Inference Cloud Engineering team builds the deployment and orchestration technology behind d-Matrix’s inference services: an internal cloud where teams test and tune models, and a customer-facing Cloud with self-service inference endpoints and compute. As the team’s Inference Performance Engineer, you will own end-to-end performance of the workloads we deploy, from the moment a request arrives to the moment a result is returned. The standard is that a...
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs