# Member of Technical Staff - ML Systems & Inference at Gimletlabs

- Company: Gimletlabs
- What the company does: Backed by Menlo and Sapphire.
- Company website: https://gimletlabs.ai/
- Type: Startups (AI role)
- Level: Senior
- Location: San Francisco, CA
- Work setup: On-site
- Pay: $150K to $390K base salary per year (USD)
- Posted: 2026-03-10
- Apply by: 2026-10-08
- Apply: https://jobs.ashbyhq.com/gimlet/8df5a18f-fb87-4c23-8b8b-efffdace4223
- Page: https://www.1752.vc/careers/jobs/gimletlabs-member-of-technical-staff-ml-systems-and-inference/

## About the role

As a Member of Technical Staff focused on ML Systems, you will build the inference systems that execute models end-to-end in production. You will work on the systems that determine how inference executes across that pipeline: how requests are batched and scheduled, how stages are placed and scaled, how KV cache and intermediate state move between accelerators, and how the system balances latency, throughput, and utilization across different hardware characteristics.

## What they're looking for

- Strong software engineering fundamentals
- Experience building or operating ML inference or model serving systems
- Comfort reasoning about performance, memory usage, and system behavior under load
- Bachelor's degree in a relevant field, or an equivalent combination of education, training, and professional experience

Tags: Research and Development