# Founding Machine Learning Infrastructure Engineer at Model AI

- Company: Model AI
- What the company does: ModelOp's Enterprise AI Command Center is the system of record that unifies every AI asset so you bring ML, GenAI, and agentic AI to production 10× faster. Backed by a16z.
- Company website: https://www.modelop.com
- Type: Startups (AI role)
- Level: Mid level
- Location: Palo Alto
- Work setup: On-site
- Posted: 2026-06-16
- Apply by: 2026-10-08
- Apply: https://jobs.ashbyhq.com/modelai/4056d228-8add-4349-9206-8fd6bcecd894
- Page: https://www.1752.vc/careers/jobs/model-ai-founding-machine-learning-infrastructure-engineer/

## About the role

We are looking for an ML Systems Engineer to help build and optimize the core serving infrastructure behind Agent Cloud. This role focuses on high-performance inference across different accelerators. You will work on model serving performance, accelerator utilization, long-context inference, batching, scheduling, KV cache management, runtime efficiency, and cost reduction. This is a deeply technical role at the intersection of ML systems, infrastructure, and product.

## What they're looking for

- Strong experience in ML systems, distributed systems, or high-performance computing
- Experience optimizing inference or training workloads for large models
- Familiarity with TPUs, GPUs, or other accelerators
- Experience with one or more of CUDA, Triton, NCCL, JAX/XLA, PyTorch internals, vLLM, SGLang, TensorRT-LLM, distributed inference, or distributed training
- Strong systems debugging skills
- Comfort working across model code, runtime, infrastructure, and product requirements

Tags: Technical Staff