# Software Engineer, Agent Platform at Retool

- Company: Retool
- What the company does: Build, deploy, and manage internal tools with Retool's unified engine. Connect to any database, API, or LLM. Leverage AI throughout your business. Backed by Sequoia and Y Combinator.
- Company website: https://retool.com/
- Type: Startups
- Level: Mid level
- Location: San Francisco, United States
- Work setup: On-site
- Pay: $164K to $306K base salary per year (USD)
- Posted: 2026-09-18
- Apply by: 2026-11-02
- Apply: https://jobs.gem.com/retool/am9icG9zdDrWsqKmo7GEKkxG6frVxgV7
- Page: https://www.1752.vc/careers/jobs/retool-software-engineer-agent-platform/

## About the role

Nearly every company in the world runs on custom software for critical operations like tracking performance metrics, handling support workflows, building admin dashboards, and countless processes you might never have thought of. But most companies don't have the resources to properly invest in these tools, leading to a lot of old, clunky internal software, or worse, teams still stuck in manual and spreadsheet workflows.

## What they're looking for

- Own the behavior of AI-powered features across multiple product surfaces, including quality, safety, variance, and failure modes
- Design and evolve prompting, retrieval, routing, and tool-use strategies that embrace non-determinism while bounding its downside
- Build and maintain evaluation systems that measure model performance using statistical signals, distributions, and trends—not just pass/fail tests
- Detect, diagnose, and resolve non-deterministic failures such as hallucinations, partial correctness, instruction drift, or sensitivity to context changes
- Define and implement guardrails, fallbacks, and degradation paths that keep systems useful even when models behave unexpectedly
- Partner with product and infra teams to decide when probabilistic behavior is “good enough” to ship—and when it isn’t