Overview

Position: LLM AI Quality Analyst (Personalization) Portuguese

Type: Short-Term Contract (2 months)

Compensation: $11.5 per hour

Location: Remote

Commitment: Part-time availability required (30 40 hrs/week)

Role Responsibilities

• Evaluate a personalization feature for Gemini
• Design and execute multi-turn conversational prompts that require the AI to leverage personal context
• Assess how effectively the model uses personal context from past conversations and activity to generate relevant responses
• Evaluate responses based on intent and appropriate application of personalization
• Analyze responses for grounding issues, flawed inferences, or hallucinations
• Assess integration quality to ensure personal data is incorporated naturally into responses
• Perform side-by-side evaluations and stack-rank model outputs based on usefulness, ...