Cloud platform for coding agents. Backed by Khosla.
About the role
Drive High-Impact Projects: Own data science and AI evaluation projects end-to-end—from defining the problem and developing the methodology to executing the analysis, communicating results, and driving implementation.
What they're looking for
- 5+ years of industry experience in data science, machine learning, or a related quantitative field
- Bachelor's or Master's degree in Computer Science, Data Science, Statistics, Mathematics, or a related quantitative field
- Strong proficiency in programming languages such as Python (with libraries like Pydantic, Pandas, NumPy, Scikit-learn)
- Strong foundation in statistical analysis, experimental design, hypothesis testing, and A/B testing methodologies
- Experience working with large-scale datasets, data pipelines, and analytical tools to generate actionable insights
- Familiarity with evaluation metrics (precision, recall, agreement metrics like Cohen's Kappa) to calibrate judge models against human ground truth
More about this role
Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing issues and administrative burdens using conversational AI and our patented voice biomarker technology in the delivery of better healthcare for everyone. We are headquartered in Silicon Valley and are funded and supported by some of the most preeminent venture capital teams.
As a Data Scientist specializing in AI Quality & Evaluation, you will play a pivotal role in ensuring the robustness, accuracy, and fairness of our AI models and systems. You will be instrumental in developing comprehensive evaluation frameworks, creating diverse and high-quality datasets, and implementing metrics to drive continuous improvement across our AI initiatives. Your work will directly contribute to accelerating customer onboarding and enhancing the overall user experience.
Ellipsis Health is located in the San Francisco Bay Area, but we are open to remote candidates for this role, as long as they are located in the U.S.
Drive High-Impact Projects: Own data science and AI evaluation projects end-to-end—from defining the problem and developing the methodology to executing the analysis, communicating results, and...
Browse similar: Startup jobs · Remote jobs · San Francisco Bay Area