The AI Control Plane for enterprises. Gain visibility, context, and control through evaluation, monitoring, enforcement, governance, and cost efficiency. Backed by Insight, Lightspeed and Lux.
About the role
Lead applied research and development. Lead applied research and development for the models and datasets at the core of Fiddler's Trust Service and suite of guardrail classifiers and evaluators that customers depend on to keep their LLM and agentic applications safe, accurate, and compliant in production.
What they're looking for
- 7+ years of applied AI experience, with a strong track record of taking models from research to production
- Experience in LLM or Agentic Evals, Guardrailing
- Deep expertise training and fine-tuning classifier models, including modern encoder architectures (BERT-family, ModernBERT, etc.) and LLM-as-classifier approaches, clear understanding of the tradeoffs between them
- Hands-on experience with dataset development as a first-class engineering discipline: sourcing, labeling, synthetic generation, adversarial augmentation, and quality control
- Strong applied experience with LLMs and agentic systems – prompting, fine-tuning, and evaluation
- Proficiency in Python and the modern ML stack (PyTorch, Hugging Face, common training/serving frameworks)
More about this role
At Fiddler, we understand the implications of AI and the impact that it has on human lives. Our company was born with the mission of building trust into AI. The rise of Generative AI and Agents has unlocked generalized intelligence but also widened the risk aperture and made it harder to ensure that AI applications are working well. Fiddler enables organizations to get ahead of these issues by helping deploy trustworthy, and transparent AI solutions.
Fiddler partners with AI-first organizations to help build a long-term framework for responsible AI practices, which, in turn, builds trust with their user base. AI Engineers, Data Science, and business teams use Fiddler AI to monitor, evaluate, secure, analyze, and improve their AI solutions to drive better outcomes. Our platform enables engineering teams and business stakeholders alike to understand the "what", “why”, and "how" behind AI outcomes.
Fiddler AI is founded by Krishna Gade (engineering leader at Facebook, Pinterest, Twitter, and Microsoft) and Amit Paka (product leader at Microsoft, Samsung, Paypal and two-time founder). We are backed by Insight Partners, Lightspeed Venture Partners, and Lux Capital.
Our team is...
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs · San Francisco Bay Area