# Member of Technical Staff, Evals and Post-Training at Profound

- Company: Profound
- What the company does: Profound is the AI marketing platform built for the agentic era. See what your customers ask AI, deploy agents to act on it, and measure the results in a collaborative workbench. Backed by Kleiner Perkins, Lightspeed and Sequoia.
- Company website: https://tryprofound.com/
- Type: Startups (AI role)
- Level: Senior
- Location: New York, New York
- Work setup: On-site
- Pay: $230K to $325K base salary per year (USD)
- Posted: 2026-10-29
- Apply by: 2026-12-13
- Apply: https://jobs.ashbyhq.com/Profound/8f2dc9c1-82c1-4f9b-93f0-ebeabf053cd8?utm_source=1752vc&utm_medium=careers
- Page: https://www.1752.vc/careers/jobs/profound-member-of-technical-staff-post-training/

## About the role

Build Profound’s eval system: tasks, rubrics, LLM judges, programmatic verifiers, regression alerts, and self-improvement loops where we look at the traces when something is wrong and come up with the fix Define what a great AI Marketer run looks like, and analyze trajectories across multi-step tool use, analytical correctness, and content quality Found on 1752vc Careers, the job board for startup and VC roles.

## What they're looking for

- 2+ years building evaluation or measurement systems, whether AI evals, experimentation, ranking, or search quality
- Strong Python and data skills, with a track record of shipping production systems
- Deep familiarity with LLM evaluation: LLM-as-judge, benchmark design, agent harnesses, calibration, and understanding how to integrate them into professional settings
- Sound experimental design, and the instinct to separate signal from noise in non-deterministic systems
- Familiarity with modern post-training methods: SFT, preference optimization, and RL
- Strong opinions about how models and agents should behave, and keeping up with current research

Tags: Data

Source: 1752vc Careers, https://www.1752.vc/careers/jobs/profound-member-of-technical-staff-post-training/