The first empathetic audio companion for patients living with a chronic disease. Backed by Techstars.
About the role
Our client is hiring an AI Evaluation Lead to own how we measure the quality of AI-generated financial advice. Getting the advice right matters. A bad output here has real consequences for real people, and this role owns making sure we catch it.
What they're looking for
- Fluency with how LLM-based systems behave in production, including output variance, failure modes, and the limits of automated scoring
- Ability to assess whether an eval framework is measuring the right things, not just whether it is running correctly
- Comfortable working with behavioral and interaction data to surface patterns and quality signals
- Familiarity with evaluation and observability tooling
More about this role
We live in a paradox: AI is accelerating the world’s capabilities, yet the average person feels more financially precarious than ever. Inflation is rising, wages are stagnant, and the traditional “retirement” model is broken. We aren’t building another chatbot. We are building the Financial Answer Machine, an intelligent guide designed to help people navigate a new financial reality.
Underpinned by a proprietary financial system, we are turning “average” advice into personalized, multi-modal financial power. We have closed an over-subscribed seed round and are looking for founding team members to help us build a bridge between the intelligence of AI and the rigid accuracy required for financial freedom. This is a rare opportunity to join at Day Zero and architect a business designed for outsized impact and massive scale.
Our client is hiring an AI Evaluation Lead to own how we measure the quality of AI-generated financial advice. Getting the advice right matters. A bad output here has real consequences for real people, and this role owns making sure we catch it.
You will work with an AI-generated test case library and automated scoring infrastructure that is already in place. Your...
Browse similar: AI jobs · AI startup jobs · Startup jobs