# Senior Staff Inference Performance Engineer at d-Matrix

- Company: d-Matrix
- What the company does: d-Matrix is redefining AI inference with memory-centric compute built for ultra-low latency, greater efficiency, and scalable AI infrastructure.
- Company website: https://www.d-matrix.ai
- Type: Startups (AI role)
- Level: Senior
- Location: Santa Clara
- Work setup: Remote
- Pay: $175K to $265K base salary per year (USD)
- Posted: 2026-10-15
- Apply by: 2026-11-29
- Apply: https://jobs.ashbyhq.com/d-Matrix/f637e097-d12a-4d0c-afd9-fc5f355ad27d?utm_source=1752vc&utm_medium=careers
- Page: https://www.1752.vc/careers/jobs/d-matrix-senior-staff-inference-performance-engineer/

## About the role

The Inference Cloud Engineering team builds the deployment and orchestration technology behind d-Matrix’s inference services: an internal cloud where teams test and tune models, and a customer-facing Cloud with self-service inference endpoints and compute. As the team’s Inference Performance Engineer, you will own end-to-end performance of the workloads we deploy, from the moment a request arrives to the moment a result is returned. Found on 1752vc Careers, the job board for startup and VC roles.

## What they're looking for

- Experience with LLM serving frameworks such as vLLM, SGLang, or TensorRT-LLM
- Hands-on experience building or tuning speculative decoding, disaggregated serving, or heterogeneous serving architectures
- Experience tuning KV-cache management, request and batch scheduling, or weight prefetch and residency in an LLM serving system
- GPU programming and profiling experience (such as CUDA, Nsight, NCCL), valued as transferable background
- Experience with pre-production or bring-up hardware, or in organizations where root causes routinely cross team boundaries
- Rust experience

Tags: Software Engineering

Source: 1752vc Careers, https://www.1752.vc/careers/jobs/d-matrix-senior-staff-inference-performance-engineer/