Startups

Member of Technical Staff, Evals

Handshake · San Francisco, CA · On-site

← All jobs
About Handshake

Decentralized certificate authority and naming. Backed by Greylock and Sequoia.

About the role

We are hiring a Member of Technical Staff, Evals to help define how frontier AI systems are measured, understood, and improved. This is a broad, high-ownership role for researchers who build. Found on 1752vc Careers, the job board for startup and VC roles.

What they're looking for

  • PhD in ML/AI, computer science, data science, or related fields (or equivalent research experience in industry)
  • Publications at top AI/ML venues like NeurIPS, ICML, ICLR, COLM
  • Builders who enjoy tinkering with agents and shipping high-quality software, benchmarks, or datasets (e.g. a strong GitHub profile / OSS contributions, or product portfolio)
  • Strong Python skills, experience building scalable software, working with agents
  • Strong knowledge of frontier AI: benchmarks, eval techniques, agent harnesses, post-training recipes, data shapes
  • Comfort operating in an ambiguous, fast-moving environment with substantial ownership
More about this role

Handshake's mission is to organize expert human knowledge to advance the AI economy. Handshake AI works directly with frontier labs on their most consequential data, evaluation, and post-training challenges, building the systems that turn expert human knowledge into the data and evaluations that make frontier models better.

You will work alongside engineers, researchers, operators, and builders from organizations including Scale AI, Meta, Google, Amazon, xAI, Notion, and Palantir—and help build the systems that make expert human knowledge useful for advancing AI.

We are hiring a Member of Technical Staff, Evals to help define how frontier AI systems are measured, understood, and improved. This is a broad, high-ownership role for researchers who build.

You will partner with AI researchers, domain experts, and customers to develop new benchmarks, reward and verifier systems, agent-evaluation methodologies, and data-quality techniques. You will work on questions at the center of frontier AI progress: what should be measured, how to design evaluations that reflect real capability, how to create high-signal feedback, and how to build the environments and data systems that make those...

Read the full posting on Handshake's site ↗

HAI Research

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.