AI Policy Reviewer (Remote)

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory requirements and responsible AI principles. Working remotely, you will act as a quality‑assurance checkpoint, safeguarding model integrity by identifying safety risks, bias, misinformation and policy violations.

Key responsibilities

• Review and score AI‑generated responses against detailed policy rubrics, assessing safety, truthfulness, fairness and alignment with community guidelines.
• Identify edge cases where the model is over‑ or under‑sensitive, and make nuanced judgement calls on context, satire or emerging risks.
• Analyze data to spot systematic flaws such as bias or hallucinations and report patterns to product and engineering teams.
• Collaborate with policy and engineering teams to refine rubrics, provide feedback on teachability, and create “golden set” prompts and ideal responses.
• Participate in adversarial testing (red‑team) to uncover vulnerabilities before product launch.

Required profile

• Minimum 3 years of experience in Trust & Safety, content policy, risk analysis or legal/compliance review.
• Deep knowledge of content moderation standards covering hate speech, harassment, misinformation and graphic violence.
• Strong written communication skills to explain why an AI response is incorrect to engineers and policy experts.
• Proven emotional resilience and self‑care strategies for handling disturbing content.

Required skills

• Familiarity with large language model platforms (e.g., ChatGPT, Gemini).
• Experience using review tools, dashboards and spreadsheet analysis.