Trace every run. Auto-fix silent failures. Simulate before shipping. Raindrop helps you detect agent issues and prevent them from happening. Backed by Lightspeed and Y Combinator.
About the role
The current status quo is sifting through millions of logs and trying to debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions.
What they're looking for
- Knows how to balance short-term and long-term speed
- Proven experience scaling applications
- Interest in AI products + tools (ideally experience building these or an avid user)
- Growth mindset
- Willing to do whatever it takes to solve a problem
- Must be in person in San Francisco (or willing to move)
More about this role
Raindrop is the monitoring platform for AI agents. Engineering teams at Fortune 100s and the fastest-growing AI companies (Vercel, Speak, Clay) use it to catch silent failures in production. When an agent misbehaves, Raindrop alerts the team, links to the trace, and surfaces the root cause so they can fix it fast. With Raindrop 2.0 (Self-Healing Agents) , the loop closes itself: your coding agent fixes it, and the fix becomes an eval to prevent regressions.
AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing.
The current status quo is sifting through millions of logs and trying to debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions.
That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning...
Browse similar: AI jobs · AI startup jobs · Startup jobs · San Francisco Bay Area