Safeguards Enforcement Analyst, Violence & Extremism

Analyze AI model behavior to detect and mitigate misuse related to violence and extremism.

• •As a Safeguards Enforcement Analyst focused on Violence & Extremism, you will be responsible for building and executing operational workflows to assess model behavior, drive enforcement decisions, and develop evals across a technically demanding range of policy areas.
• •Your work spans detecting and mitigating attempts to misuse Anthropic's AI systems to facilitate real-world harm.
• •Key Responsibilities Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy.
• •Develop and maintain evals that measure model performance on these policy areas, surface regressions, and inform policy and model improvements.
• •Partner with Engineering and Data Science to optimize detection and automated enforcement systems for potential policy violations.
• •Review flagged content to drive enforcement decisions and surface policy gaps, with particular attention to novel or technically sophisticated misuse attempts + emerging extremist movements, ideologies, and mobilization tactics.
• •Requirements Experience in policy enforcement, threat intelligence, counterterrorism, government, or a closely related field, with direct exposure to harmful content, dangerous technology, violent extremism, or physical harm facilitation.
• •Experience standing up and scaling policy enforcement or content review workflows.
• •Proficiency in SQL and/or other data analysis tools to draw insights from large datasets and monitor enforcement workflow health.
• •Experience identifying emerging risks and threat actors, and communicating findings to a diverse set of stakeholders, such as Product, Policy, Engineering, and Legal teams.