Startups · AI

Applied AI Engineer

Judgment Labs · San Francisco · On-site

← All jobs
About Judgment Labs

Backed by Lightspeed.

About the role

We are looking for Applied AI Engineers to build AI systems that use agent interaction data to understand how agents behave, evaluate them at scale, and improve them through learning and feedback.

More about this role

We are looking for Applied AI Engineers to build AI systems that use agent interaction data to understand how agents behave, evaluate them at scale, and improve them through learning and feedback.

Your research will not live on a whiteboard. You’ll work directly with real-world agent data, apply frontier methods in production, and see your work ship into the product. By making agent behavior measurable and debuggable, your systems will support teams deploying agents across finance, legal, operations, and other high-stakes workflows. You will own projects end-to-end, with significant autonomy, and work closely with the team to build self-improving agent systems.

Build AI systems to aggregate, index, and analyze large-scale long-running agent interaction data in order to extract meaningful signals

Design and implement post-training and optimization workflows to improve agents, both internally and for customers

Build agent platform infrastructure, including orchestration, runtimes, and developer tools that help teams define, test, deploy, and iterate on complex agent workflows

Build internal tools and infrastructure that support rapid experimentation, analysis, and training

Work...

Read the full posting on Judgment Labs's site ↗

Research

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.