# Software Engineering Director, Agentic Evaluations at G2

- Company: G2
- What the company does: Backed by IVP.
- Company website: https://www.g2.com/
- Type: Startups
- Level: Principal and up
- Location: Remote (US)
- Work setup: Remote
- Pay: $260K to $320K base salary per year (USD)
- Posted: 2026-09-23
- Apply by: 2026-11-07
- Apply: https://jobs.ashbyhq.com/G2/d683c14d-5e24-4b20-8469-6f673d32b616
- Page: https://www.1752.vc/careers/jobs/g2-software-engineering-director-agentic-evaluations/

## About the role

As a Software Engineering Director, Agentic Evaluations, your responsibilities will center around delivery of useful and credible evaluations of agents offered by software vendors. You’ll enhance the system that performs validation of agent performance, and lead the core team behind it. You will leverage “agent-first” ways of working, applying agentic engineering techniques to deliver your work to production. Build and enhance agent evaluations that run against live agents [80%]:

## What they're looking for

- We realize applying for jobs can feel daunting at times. Even if you don’t check all the boxes in the job description, we encourage you to apply anyway
- 10+ years of professional programming experience in backend or full-stack environments
- 2+ years of experience directly managing engineers
- Expert-level proficiency in backend development using languages like Python, Java/Kotlin, Typescript/Javascript or Go, strong proficiency in associated backend frameworks like FastAPI or Node.js
- Direct experience creating evaluations (evals) against a customer-facing agent, leveraging agent trajectory trace data and rubrics to measure an agent’s task completion rate, accuracy, correctness, or policy adherence
- Direct experience using frontier models from OpenAI, Anthropic, or Google in LLM-as-a-judge applications

Tags: Product R&D