Connect with next-gen talent and tools to get work underway. Hire more independents. Start more projects. Get more creative. Backed by NEA.
About the role
Think of yourself as the operator for a project or vertical. You sit between three groups that do not naturally talk to each other: the client who needs the data, the creative experts producing it, and the internal engineering team building the tooling. Your job is to make all three feel like they are working on the same thing, and to ship results that are both rigorous and genuinely useful.
What they're looking for
- 3+ years designing studies, running evaluations, analyzing data, and presenting findings
- Experience with data labeling, annotation, human-in-the-loop systems, or AI and ML evaluation workflows
- A track record managing several concurrent projects, including annotation, evaluation, or QA work
- A real point of view on creative quality and what "good" looks like
- Based in NYC. In office 5 days a week (Williamsburg)
More about this role
Contra Labs is a human-centered research lab studying how creatives actually use AI, how tools can serve creative work better, and how to protect the originality that gets flattened as everything starts to look the same.
We connect a global network of top creative talent with frontier AI labs and product companies. By grounding our research in real creative workflows, we help define what "good" looks like across design, video, imagery, and beyond. Our work powers benchmarking, evaluation, and post-training for leading models and applications. Built on Contra, the professional network for independent creatives, we turn human judgment into the training and evaluation layer that helps these tools serve the people who use them.
We are scaling across client engagements: post-training dataset creation, benchmarking programs, and ongoing evaluation partnerships. Each project spans a different mix of AI labs, creative-tool companies, and research teams, with different requirements, timelines, and quality bars. We need someone to own this work from end to end.
Think of yourself as the operator for a project or vertical. You sit between three groups that do not naturally talk to each other:...
Browse similar: Startup jobs