# Software Engineer L5 - AI Observability & Agent Evaluation at Netflix

- Company: Netflix
- What the company does: Watch Netflix movies & TV shows online or stream right to your smart TV, game console, PC, Mac, mobile, tablet and more. Backed by IVP and Redpoint.
- Company website: https://www.netflix.com
- Type: Startups (AI role)
- Level: Mid level
- Location: Los Gatos
- Work setup: On-site
- Posted: 2026-09-16
- Apply by: 2026-10-31
- Apply: https://netflix.wd108.myworkdayjobs.com/en-US/Netflix/job/Los-Gatos/Software-Engineer-L5---AI-Observability---Agent-Evaluation_JR42630
- Page: https://www.1752.vc/careers/jobs/netflix-software-engineer-l5-ai-observability-and-agent-evaluation/

## About the role

The AI Observability team makes AI, ML, and Agentic systems transparent, reliable, and production-ready at scale. We build end-to-end observability for ML and GenAI workloads, capturing model inputs, features, predictions, outcomes, and behavior across online and batch systems. Our platform enables teams to monitor model performance, data quality, drift, latency, and failures, turning the ML system from a black box into an explainable, debuggable system.

## What they're looking for

- Experience in software, AI/ML, or platform engineering, with hands-on time in production observability, monitoring, or ML/LLM evaluation
- Proven track record of designing standards, libraries, SDKs, or frameworks that other teams build on and adopt, reflecting a platform and enablement mindset rather than shipping features for a single use case
- Strong coding skills in Python and at least one of Java, Go, or Scala, with experience building production services
- Practical experience operating ML models in production (online serving and/or batch), including drift, model performance, and data quality
- Hands-on experience with modern observability stacks (e.g., Prometheus/Grafana, Datadog, OpenTelemetry, ELK/OpenSearch, Jaeger/Tempo, or similar)
- Solid understanding of distributed systems, microservices, and at least one major cloud platform (AWS, GCP, or Azure)


Source: 1752vc Careers, https://www.1752.vc/careers/jobs/netflix-software-engineer-l5-ai-observability-and-agent-evaluation/