# Member of Technical Staff, Evals at Profound

- Company: Profound
- What the company does: Profound is the AI marketing platform built for the agentic era. See what your customers ask AI, deploy agents to act on it, and measure the results in a collaborative workbench. Backed by Kleiner Perkins, Lightspeed and Sequoia.
- Company website: https://tryprofound.com/
- Type: Startups (AI role)
- Level: Senior
- Location: New York, New York
- Work setup: On-site
- Pay: $215K to $300K base salary per year (USD)
- Posted: 2026-10-29
- Apply by: 2026-12-13
- Apply: https://jobs.ashbyhq.com/profound/d5a9a79a-8abd-40bd-98d0-d4f7f41d3095?utm_source=1752vc&utm_medium=careers
- Page: https://www.1752.vc/careers/jobs/profound-member-of-technical-staff-evals/

## About the role

Build Profound’s eval system: golden datasets, scorers and LLM judges, programmatic verifiers, regression alerts, and dashboards Write evals for every pipeline behind the product: brand extraction, visibility scoring, sentiment, FactCheck, and citation classification Found on 1752vc Careers, the job board for startup and VC roles.

## What they're looking for

- 3+ years building evaluation or measurement systems, whether AI evals, experimentation, ranking, or search quality
- Strong Python and data skills, with a track record of shipping production systems
- Deep familiarity with LLM evaluation: LLM-as-judge, benchmark design, agent harnesses, calibration, and significance testing
- Sound experimental design, and the instinct to separate signal from noise in non-deterministic systems
- Strong opinions about how models and agents behave, and you keep up with current research
- You believe a good eval is clear, reliable, and hard to game

Tags: Data

Source: 1752vc Careers, https://www.1752.vc/careers/jobs/profound-member-of-technical-staff-evals/