The continuous-improvement stack for agents. Monitor and improve your agent's behavior at scale. Backed by Lightspeed.
About the role
You'll own the end-to-end customer process, from understanding their pain points, to building their evals and monitoring in Judgment, to turning what you learn into what we build next. Found on 1752vc Careers, the job board for startup and VC roles.
More about this role
Judgment Labs is building the infrastructure for continual learning in long-horizon AI agents.
We turn long agent trajectories into clean, structured data for evals, labeling, rubric generation, context engineering, and RL workflows. Instead of only showing teams what happened, Judgment helps decide what matters, what should be learned from, and how that learning should flow back into the agent.
We’ve raised $32M across two rounds led by Lightspeed.
You'll own the end-to-end customer process, from understanding their pain points, to building their evals and monitoring in Judgment, to turning what you learn into what we build next.
This role centers on deep technical execution, customer ownership, and product judgment. You will work directly with customer teams to reason about agent behavior and translate high-level goals into concrete ABM deployments. You'll partner with our AEs before customers sign and stay with them after. Then you'll take what you learn across customers and turn it into product direction: deciding what's worth building, prototyping it, and demoing it.
You'll ship PRs and prototypes, but your main job isn't owning large systems end to end. It's making sure we...
Browse similar: AI jobs · AI startup jobs · Startup jobs · San Francisco Bay Area