We are seeking a detail-oriented Senior QA Engineer to keep the quality assurance efforts across our complex data flows and AI-driven products, specifically focusing on conversational agents. This role requires a blend of automation expertise and strong analytical skills to define quality standards, validate complex data outputs, and ensure the reliable and responsible behavior of our generative AI systems.
Key Responsibilities - Expertise in quality assurance efforts for data pipelines, APIs, and conversational agents.
- Design and execute generative AI testing scenarios, including exploratory testing for chatbot interactions, intent recognition, tone, and edge-case behavior.
- Experience in LLM test designs, including prompt and grounding validation, golden sets, and non-deterministic assertions.
- Perform crucial safety and quality checks, such as testing for hallucination, bias, toxicity, and PII leakage.
- Validate structured ...