# Senior | Staff Software Engineer - AI / ML at Snorkel AI

- Company: Snorkel AI
- What the company does: Snorkel AI builds specialized training data, benchmarks, and evaluation environments that help frontier models and agents perform in high-stakes domains. Backed by Greylock, Lightspeed and GV.
- Company website: https://www.snorkel.ai
- Type: Startups (AI role)
- Level: Senior
- Location: San Francisco, CA (Hybrid)
- Work setup: Hybrid
- Posted: 2026-09-25
- Apply by: 2026-11-09
- Apply: https://job-boards.greenhouse.io/snorkelai/jobs/6208931004
- Page: https://www.1752.vc/careers/jobs/snorkel-ai-senior-staff-software-engineer-ai-ml/

## About the role

Frontier AI data is expensive to make and hard to measure. Every task we deliver is tested against the strongest models, often through many long-running agent rollouts. Your job is to make that process faster, cheaper, and more rigorous with ML and AI

## What they're looking for

- Efficient agentic evals. Cut the cost of long-horizon agent evaluation with adaptive sampling, statistically grounded early stopping, model cascades, caching, and cheap-first gating
- AI model routing. Route every eval and judge call to the cheapest model that clears the quality bar, with fallback, monitoring, and cost attribution
- Fine-tuned small models. Fine-tune and serve open-weight models (LoRA and other parameter-efficient methods) where they match frontier quality, and know when they don't
- Predictive difficulty. Build models that estimate how hard a task is for frontier systems before running a single rollout
- Measurement for AI data. Build golden datasets, quantify the accuracy and calibration of LLM-as-judge systems, and make quality reproducible across projects
- Research to production. Turn research prototypes into reusable, configurable components that forward deployed engineers and researchers use on every project

Tags: Engineering