GenMD generates digital twins of healthcare datasets that let health systems support research, AI development, and external partnerships—while maintaining strict patient privacy. Backed by 500 Global.
About the role
Frontier models still fail on real clinical work, and most of those failures never show up in public benchmarks. You'll build the benchmarks and evaluation systems that show where models break on real-world healthcare data, then turn those findings into the data that closes the gap. We call the loop measure, build, re-test. Design and maintain clinical benchmarks for reasoning, longitudinal patient histories, multimodal records and tool use. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Hands-on experience evaluating or training LLMs (PyTorch, Hugging Face or similar)
- Strong Python and data engineering skills, comfortable with large tabular and text datasets (SQL/BigQuery a plus)
- Research taste: you can design an evaluation that measures what matters and resists shortcuts
- B.Sc. or higher in CS, ML, NLP, biomedical informatics or a related field, LLM/NLP publications preferred
- About 4 hours of daily overlap with Pacific Time (roughly 9 AM to 1 PM PT)
More about this role
GenMD is a Stanford spin-off building AI and data infrastructure for healthcare. We grew out of years of work inside Stanford Medicine, alongside world-class researchers and clinicians, and we now work with health systems and data partners on large longitudinal datasets: claims, health records, imaging and clinical notes. We make that data usable for researchers and frontier AI, while patient privacy stays protected.
We're just coming out of stealth, already revenue-generating and well funded. We're intentionally small, move fast, and are focused on building something fundamental. Our CEO is a former Associate Director of AI at Stanford Medicine. See how we work: https://genmd.ai/careers
Frontier models still fail on real clinical work, and most of those failures never show up in public benchmarks. You'll build the benchmarks and evaluation systems that show where models break on real-world healthcare data, then turn those findings into the data that closes the gap. We call the loop measure, build, re-test.
Design and maintain clinical benchmarks for reasoning, longitudinal patient histories, multimodal records and tool use.
Build evaluation pipelines end to end: runs, scoring,...
Read the full posting on GenMD AI, Generative Medical, GenMD's site ↗
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs