# Software Engineer, AI Evaluation at Nuna

- Company: Nuna
- What the company does: Backed by Kleiner Perkins.
- Company website: https://www.nuna.com/
- Type: Startups (AI role)
- Level: Mid level
- Location: San Francisco
- Work setup: Remote
- Pay: $148K to $232K base salary per year (USD)
- Posted: 2026-08-13
- Apply by: 2026-10-08
- Apply: https://jobs.ashbyhq.com/nuna/6d313b04-d9ad-4db7-98d4-cb16d59c3ca1
- Page: https://www.1752.vc/careers/jobs/nuna-software-engineer-ai-evaluation/

## About the role

This is a net-new, build-first role for someone who wants to own how we evaluate our AI agents end to end. You'll build the harnesses, datasets, judges, and release gates that tell us whether the coach is safe and good, and you'll own both that infrastructure and the evals that run on it. This is not a test-execution role - you write the code and own the system, rather than running tests someone else designed.

## What they're looking for

- Significant experience building and shipping reliable production systems and tooling
- A testing mindset applied to building the measurement system, not running tests against a spec: adversarial instinct, coverage thinking, regression discipline, and documentation others can build on
- You use AI in your daily work and build tools that make the people around you more effective
- Enough fluency in statistics and experimental design to partner with a data scientist on calibration and reliability
- Can design the workflow and build a functional UI for non-engineers like clinicians and labelers
- A genuine interest in improving healthcare alongside an interdisciplinary team, with the judgment to tell a launch-blocking issue from a nice-to-have

Tags: Engineering