Trust & Safety Evaluator conduct adversarial testing and safety evaluation of generative AI features.

Main tasks are crafting queries, evaluating the safety of generated content and providing critical feedback. This role requires creative thinking about potential misuse, deep cultural and linguistic knowledge, and the ability to identify subtle safety risks.

Key Responsibilities

• Designing and testing challenging queries
• Simulating realistic conversations
• Creating attack scenarios
• Conducting age-appropriate safety assessments
• Assigning risk ratings
• Detecting biases
• Identifying subtle safety issues
• Evaluating cultural and linguistic nuances
• Leveraging domain knowledge
• Completing testing within deadlines
• Maintaining high accuracy
• Producing creative content

Required Skills

• Fluency in US English
• Deep cultural awareness of U...