Join the waitlist and see why higher education will never again be the same. Backed by Khosla and Lightspeed.
About the role
You'll manage the full assessment development lifecycle at Outsmart — from item authoring through field testing, standard setting, scoring, and reporting. You'll work closely with psychometricians, faculty, product managers, and engineers to build rigorous, scalable assessments. As an AI-forward organization, you'll also help shape how AI tools are responsibly woven into our development and QA workflows. You thrive in ambiguity and are energized by building from scratch
What they're looking for
- Master's degree (Ph.D. preferred) in educational measurement, assessment , or a related field
- 3+ years managing operational, high-stakes assessment lifecycles end-to-end
- Proven experience leading standard-setting studies and managing diverse SME panels
- Experience managing external vendors for field tests and pilot studies
- Working knowledge of validity, reliability, and fairness standards (e.g., AERA/APA/NCME)
- Familiarity with cognitive complexity frameworks (DOK, Bloom's)
More about this role
Outsmart is a mission-driven, early-stage startup reimagining higher education for the age of AI by creating an entirely new collegiate experience that expands access and opportunity. Backed by $38M from top venture firms including Khosla Ventures, Forerunner, DST Global Partners, and Lightspeed, the company is led by former Duolingo executives and a founding team that also includes Emmy Award winners. With a strong culture centered around high-impact, detail-oriented team members, Outsmart is already seeing significant traction, generating 1–5 million weekly organic views on social media.
You'll manage the full assessment development lifecycle at Outsmart — from item authoring through field testing, standard setting, scoring, and reporting. You'll work closely with psychometricians, faculty, product managers, and engineers to build rigorous, scalable assessments. As an AI-forward organization, you'll also help shape how AI tools are responsibly woven into our development and QA workflows.
Master's degree (Ph.D. preferred) in educational measurement, assessment , or a related field
3+ years managing operational, high-stakes assessment lifecycles end-to-end
Proven experience...
Browse similar: Startup jobs