Startups · AI

Senior AI Systems Quality Engineer

Abacus Insights · United States · On-site

← All jobs
About Abacus Insights

Abacus Insights offers a data management solution that standardizes data across the healthcare ecosystem by providing a highly secure unified data infrastructure that minimizes change management and maximizes analytics enablement to help healthcare providers... Backed by BlueCross BlueShield Venture Partners.

About the role

At Abacus Insights, we’re building AI‑powered platforms that sit at the center of critical healthcare decisions—where reliability, correctness, and trust matter as much as innovation. As our use of agentic, LLM‑driven systems scales, ensuring these systems behave safely and predictably in real‑world environments isn’t optional—it’s foundational.

What they're looking for

  • 7+ years of software engineering experience, primarily in backend or platform systems
  • Proven experience designing and implementing AI testing automation in production environments, not just executing tests
  • Demonstrated ability to build custom validation, evaluation, or testing frameworks for complex, distributed systems
  • Strong proficiency in Python and/or TypeScript within modern AI engineering stacks
  • Hands-on experience with AI-powered systems, including LLM-based or agentic workflows and non-deterministic behavior
  • Experience designing or contributing to AI testing at scale, including regression frameworks, long-tail evaluation, and large test coverage
More about this role

About Us

Abacus Insights is transforming how data works for health plans. Our mission is simple: make healthcare data usable, so the people responsible for care and cost decisions can act faster, with confidence.

We help health plans break down data silos to create a single, trusted data foundation. That foundation powers better decisions—so plans can improve outcomes, reduce waste, and deliver better experiences for members and providers alike. Backed by $100M from top investors, we’re tackling big challenges in an industry that’s ready for change. Our platform enables GenAI use cases by delivering clean, connected, and reliable healthcare data to support automation, prioritization, and decision workflows—and it’s why we are leading the way.

Our innovation begins with people. We are bold, curious, and collaborative—because the best ideas come from working together. We embrace the thoughtful use of AI and automation to drive innovation and efficiency, and we look for individuals who are curious and adaptable—those excited to leverage emerging technologies to enhance how we work—while keeping human insight, connection, and our clients at the center of every decision.

Ready to make...

Read the full posting on Abacus Insights's site ↗

Engineering

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.