Secure the AI apps and agents you build and deploy with red teaming and runtime guardrails powered by real-world adversarial data. Backed by Norwest and CRV.
About the role
As part of this role, you will be responsible for leading new frontier evaluation and benchmarking projects every six weeks. Successful candidates are expected to drive self-initiated research, design evaluation methodologies for emerging risks (e.g., persuasion, manipulation, sycophancy, agentic safety), and build safety benchmarks across Generative AI modalities (Text, Image, Multimodal, and Autonomous Agents). If you're creative and driven to secure the future of AI, we want to hear from you! Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Ownership & Self-Starter Attitude: Proven track record of self-initiating research projects, bringing in external partnerships, and shaping technical vision
- Communication & Engagement: Excellent verbal and written communication skills with the ability to convey complex technical concepts to non-technical stakeholders, executives, and research peers
- Cross-Disciplinary Versatility: Ability to operate comfortably across technical data science, social science paradigms, and product execution
More about this role
We are seeking a visionary, highly accomplished Senior Responsible AI Researcher to lead state-of-the-art research initiatives at the intersection of frontier models, Trust & Safety (T&S), model evaluation, and adversarial robustness.
As part of this role, you will be responsible for leading new frontier evaluation and benchmarking projects every six weeks. Successful candidates are expected to drive self-initiated research, design evaluation methodologies for emerging risks (e.g., persuasion, manipulation, sycophancy, agentic safety), and build safety benchmarks across Generative AI modalities (Text, Image, Multimodal, and Autonomous Agents).
- Design, build, and deploy new evaluation frameworks, benchmarks, and "Agentic Safety Gyms" to measure model capabilities, vulnerabilities, and alignment across diverse risk domains (e.g., Hate Speech, Misinformation, Elections Preparedness, IP/Copyright, Child Safety).
- Develop advanced adversarial prompting methodologies, red-teaming strategies, and behavioral suites to stress-test Large Language Models (LLMs), Multimodal systems, and AI Agents.
- Investigate emerging safety risks, including model persuasion, manipulation, sycophancy,...
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs · San Francisco Bay Area