Secure the AI apps and agents you build and deploy with red teaming and runtime guardrails powered by real-world adversarial data. Backed by Norwest and CRV.
About the role
Alice is seeking a driven, detail-focused professional to become a vital part of our team as a GenAI Safety Analyst. In this role, you'll dive into the cutting-edge of technology, meticulously analyzing various content infringements to secure the new wave of Generative AI tools. Your duties will include collaborating with experts in diverse fields such as Hate Speech, Misinformation, Intellectual Property and Copyright, among others.
What they're looking for
- Background in AI Safety and/or Responsible AI and/or Trust and Safety
- Familiarity with recent Generative AI models and agents is essential, though direct technical experience is not a prerequisite
- Command of English at a near-native level
- Attention to detail, organizational capabilities, and the capacity to juggle numerous tasks concurrently
More about this role
Alice is seeking a driven, detail-focused professional to become a vital part of our team as a GenAI Safety Analyst. In this role, you'll dive into the cutting-edge of technology, meticulously analyzing various content infringements to secure the new wave of Generative AI tools. Your duties will include collaborating with experts in diverse fields such as Hate Speech, Misinformation, Intellectual Property and Copyright, among others.
Your tasks will involve writing adversarial prompts to identify weaknesses in various AI models, including Large Language Models (LLMs), Text-to-Image, Text-to-Video, AI Agents and beyond. You'll also oversee data management to guarantee the highest quality of outputs.
- Developing adversarial and risky prompt strategies across several areas of abuse to expose potential vulnerabilities in models.
- Managing projects end-to-end, from initial planning and oversight through quality assurance to final delivery.
- Handling extensive datasets across multiple languages and areas of abuse, ensuring precision and meticulous attention to detail.
- Ongoing investigation into new tactics for circumventing foundational models' safety measures.
- Working alongside...
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs