AI Policy Reviewer – Remote

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely, you will act as a quality‑assurance gatekeeper, safeguarding model integrity by detecting safety risks, bias, misinformation, and policy violations.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, assessing safety, truthfulness, fairness and alignment with community guidelines.
• Identify over‑sensitive or under‑sensitive model behavior and handle ambiguous edge cases.
• Analyze data to spot systematic flaws, bias, hallucinations or policy gaps and report findings to Product and Engineering teams.
• Collaborate with Policy teams to refine evaluation rubrics and test their teachability to AI models.
• Participate in adversarial testing (red‑team) to uncover jailbreak or unsafe response vulnerabilities.
• Work closely with Machine Learning Engineers, explaining rating rationales and helping adjust model behavior.
• Create high‑quality prompt‑response examples that serve as “golden sets” for training.

Required profile

• Minimum 3 years experience in Trust & Safety Operations, Content Policy, Risk Analysis or Legal/Compliance review.
• Deep knowledge of content moderation policies covering hate speech, harassment, misinformation and graphic violence.
• Strong analytical ability to deconstruct AI outputs and detect logical flaws, hallucinations or subtle biases.
• Excellent written communication to explain findings to engineers and policy experts.
• Emotional resilience and self‑care strategies for exposure to disturbing content.
• Comfort with dashboards, spreadsheets and specialized review tools.
• Familiarity with large language models such as ChatGPT or Gemini.

Required skills

• LLM platforms (ChatGPT, Gemini)
• Dashboard tools
• Spreadsheet software
• Specialized content review tools

What we offer

• Fully remote work with flexible hours
• Opportunity to shape responsible AI practices at scale
• Collaboration with cross‑functional product and engineering teams