# Senior AI Systems Quality Engineer at Abacus Insights

- Company: Abacus Insights
- What the company does: Abacus Insights offers a data management solution that standardizes data across the healthcare ecosystem by providing a highly secure unified data infrastructure that minimizes change management and maximizes analytics enablement to help healthcare providers... Backed by BlueCross BlueShield Venture Partners.
- Company website: https://abacusinsights.com
- Type: Startups (AI role)
- Level: Senior
- Location: United States
- Work setup: On-site
- Posted: 2026-09-28
- Apply by: 2026-11-12
- Apply: https://boards.greenhouse.io/abacusinsights/jobs/8853572002?gh_jid=8853572002
- Page: https://www.1752.vc/careers/jobs/abacus-insights-senior-ai-systems-quality-engineer/

## About the role

At Abacus Insights, we’re building AI‑powered platforms that sit at the center of critical healthcare decisions—where reliability, correctness, and trust matter as much as innovation. As our use of agentic, LLM‑driven systems scales, ensuring these systems behave safely and predictably in real‑world environments isn’t optional—it’s foundational.

## What they're looking for

- 7+ years of software engineering experience, primarily in backend or platform systems
- Proven experience designing and implementing AI testing automation in production environments, not just executing tests
- Demonstrated ability to build custom validation, evaluation, or testing frameworks for complex, distributed systems
- Strong proficiency in Python and/or TypeScript within modern AI engineering stacks
- Hands-on experience with AI-powered systems, including LLM-based or agentic workflows and non-deterministic behavior
- Experience designing or contributing to AI testing at scale, including regression frameworks, long-tail evaluation, and large test coverage

Tags: Engineering