Startups · AI

Tech Lead Manager, AI Evaluations

Glean · Mountain View, CA · On-site

← All jobs
About Glean

Glean is the Enterprise AI platform connected to your enterprise's data. Find, create, and automate anything. Explore what Glean can do for you! Backed by General Catalyst, Kleiner Perkins and Lightspeed.

About the role

The bottleneck in building reliable and useful AI systems isn’t writing code anymore. It’s knowing what good looks like, applying that knowledge and experience from production usage into building rigorous evals, and using those evals to guide continuous product self-improvement loops. Found on 1752vc Careers, the job board for startup and VC roles.

What they're looking for

  • 10+ years of experience in software engineering, ML infrastructure, data systems, or a related technical field. Experience must include building and operating production systems
  • 5+ years of engineering or applied AI team management experience, with a track record of technical leadership, developing engineers and scientists, and delivering cross-functional projects
  • Understanding of agent evaluation, including tool calling, multi-turn behavior, trajectory quality, task completion, and recovery from errors, experience with safety testing or red teaming is a plus
  • Strong coding ability in Python or another production language, with sound engineering fundamentals in testing, APIs, data modeling, and reliable distributed systems
  • Experience building scalable data and developer platforms, experiment pipelines, or CI/CD integrations, familiarity with cloud infrastructure, Kubernetes, data stores, and observability is beneficial
  • Strong judgment about measurement quality, including dataset representativeness, judge calibration, reproducibility, uncertainty, and the risk of optimizing to a narrow metric
More about this role

Glean is the Work AI platform that helps everyone work smarter with AI. What began as the industry’s most advanced enterprise search has evolved into a full-scale Work AI ecosystem, powering intelligent Search, an AI Assistant, and scalable AI agents on one secure, open platform. With over 100 enterprise SaaS connectors, flexible LLM choice, and robust APIs, Glean gives organizations the infrastructure to govern, scale, and customize AI across their entire business - without vendor lock-in or costly implementation cycles.

At its core, Glean is redefining how enterprises find, use, and act on knowledge. Its Enterprise Graph and Personal Knowledge Graph map the relationships between people, content, and activity, delivering deeply personalized, context-aware responses for every employee. This foundation powers Glean’s agentic capabilities - AI agents that automate real work across teams by accessing the industry’s broadest range of data: enterprise and world, structured and unstructured, historical and real-time. The result: measurable business impact through faster onboarding, hours of productivity gained each week, and smarter, safer decisions at every level.

Recognized by Fast...

Read the full posting on Glean's site ↗

Engineering

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.