Become a Language Model Evaluator with Mercor, engaging with remote work as a contract Generalist. Focus on English and Punjabi to enhance AI language capabilities.
Mercor is looking for a detail-oriented evaluator for its language models. This role requires expertise in both Punjabi and English, bringing valuable experience with large language models. Your task will include generating and analyzing evaluation data to ensure the quality and factual accuracy of AI model responses, conducted independently and asynchronously.
Key Responsibilities:
• Conduct thorough fact-checking using vetted sources
• Assess strengths and weaknesses in AI responses
• Monitor clarity, reason quality, and tone of outputs
• Ensure responses meet set guidelines for conversation
• Collaborate asynchronously to refine AI performance
Requirements:
• Bachelor's degree in a relevant discipline
• Native proficiency in Punjabi and strong English skills
• Significant experience with ...