Comparison and analysis of AI models and API hosting providers. Independent benchmarks across key performance metrics including quality, price, output speed & latency. Backed by AI Grant.
About the role
Our evaluations decide how the world measures AI. When a frontier lab ships a model, our benchmarks are how the industry finds out what it can actually do, and the labs themselves use our results to guide what they build next. This role puts you on the measurement frontier: you won’t just observe the cutting edge, your work will define what cutting edge means.
What they're looking for
- We require 3+ years of relevant professional experience, across industry or research. You have an intense interest in AI, a desire to become a world expert in the field, and strong analytical and coding skills to back it up
- Beyond that bar, we hire from three backgrounds. You should clearly fit one of these profiles:
- • Strong analytical and critical thinking skills
- • Proficiency in Python and data analysis
- • Genuine, demonstrable interest and knowledge of Frontier AI. We want people who have informed opinions about where AI is heading, not just people who use AI tools
More about this role
Artificial Analysis is the leading independent AI benchmarking company. We support labs, engineers and enterprises to understand AI capabilities and make critical decisions about their AI strategies. We are the go-to authority for understanding AI, from AI labs and enterprises to media, investors, and policymakers. Our benchmarks don’t just measure the cutting edge of AI, they are actively shaping the frontier.
Our benchmarks and analysis are trusted by hundreds of thousands of users and are the go-to reference for leading AI labs including OpenAI, Google, Meta, NVIDIA and Anthropic, and major publications including the Wall Street Journal, Bloomberg, the Financial Times and The Economist.
We are a team of 40+, on track to double by end of year, backed by Nat Friedman (GitHub, Meta), Daniel Gross (SSI, Meta), Andrew Ng (Google Brain, DeepLearning.ai , Amazon), Adam D’Angelo (Quora, Poe, OpenAI), Clem Delangue (Hugging Face) and other industry leaders.
Our evaluations decide how the world measures AI. When a frontier lab ships a model, our benchmarks are how the industry finds out what it can actually do, and the labs themselves use our results to guide what they build next. This...
Browse similar: AI jobs · AI startup jobs · Startup jobs · San Francisco Bay Area