Prolific helps AI developers, researchers, and organizations easily access the highest-quality human data. Sign up for free. Backed by Y Combinator.
About the role
As one of the founding members of Prolific's newly formed AI Data Services team, you'll help build the quality systems behind some of the world's most advanced AI models. Data quality is a strategic priority for Prolific, so this is a high-visibility role with direct exposure to senior stakeholders. This isn't a traditional QA role. We are not looking for someone to review data against a predefined checklist.
What they're looking for
- Experience with LLM evaluation, RLHF, AI safety or red teaming
- Experience translating vague model or evaluation goals into clear annotation specifications
- Experience working with human annotation programmes or human data operations
- Familiarity with calibration, inter-rater agreement, drift detection or other evaluation methodologies
More about this role
Prolific
Prolific isn’t just enabling AI innovation – we’re redefining it. While foundational AI technologies are becoming commoditized, Prolific’s human data infrastructure provides the high-quality, diverse data required to train the next generation of AI models. Through our platform, we empower researchers and companies to access a global, ethically curated participant base, ensuring cutting-edge AI research and training grounded in inclusivity and precision.
The Role
As one of the founding members of Prolific's newly formed AI Data Services team, you'll help build the quality systems behind some of the world's most advanced AI models. Data quality is a strategic priority for Prolific, so this is a high-visibility role with direct exposure to senior stakeholders. This isn't a traditional QA role. We are not looking for someone to review data against a predefined checklist. We are looking for an innovative thinker that can leverage their expertise to define what good means where no definition exists yet.
Acting as a strategic thought partner, you’ll work at the intersection of human data, machine learning, evaluation across frontier use-cases that define what high-quality human...
Browse similar: Startup jobs · Founding team roles