DEFCON AI engineers AI solutions that are powered by advanced optimization across a range of industries, translating complex operations into scalable success. Backed by Bessemer.
About the role
Be the independent voice that keeps the whole program honest — your evaluation is the standard everyone else is held to. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Construct labeled ground truth for model evaluation
- Design and run sampled audits
- Gate releases against model version, maintain version inventory, evaluation records, and rollback triggers
- Run drift and override review
- Produce human-oversight and fairness / disparate-effect evidence
- Maintain independence from the build roles: produce evaluation evidence, but do not build the models, approve thresholds, or authorize releases against that evidence
More about this role
ABOUT DEFCON AI
RESILIENCE IN THE FACE OF DISRUPTION. DEFCON AI is an insights company that leverages artificial intelligence, mathematical optimization, data analytics, and software engineering for resilient optimization of complex systems.
In today’s dynamically changing world, DEFCON AI’s technology aligns outcomes with operational goals, better decision making, and empowers customers to anticipate assess, and mitigate the impacts of disruptions.
Be the independent voice that keeps the whole program honest — your evaluation is the standard everyone else is held to.
About the Role
You'll join the analytics and AI engineering team behind a system that genuinely matters: an AI-assisted platform that brings together records from dozens of disparate data sources, resolves them to the correct individual, highlights what analysts should review first, and provides transparent, explainable recommendations that users can trust. Operating within a secure government cloud environment, the platform tackles complex challenges in AI, data integration, and decision support where quality, trust, and accountability are mission-critical .
As a Model Test & Measurement Engineer, you'll own the...
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs