Position Overview
Design and execute manual and automated test cases for backend APIs, frontend interfaces, and end-to-end AI workflows.
Conduct exploratory testing of new generative AI features and user interactions.
Develop and maintain automated test frameworks for UI and API.
Build automation scripts for AI/ML pipelines using pytest, unittest, or custom frameworks.
Create comprehensive test plans, manage defects, and report results using Jira, or similar tools.
Validate RAG (Retrieval-Augmented Generation) pipelines, including embedding accuracy, retrieval quality, and model response evaluation.
Test AI agents and orchestration flows, ensuring correctness in multi-step reasoning and tool invocations.
Perform performance and scalability testing for ML inference endpoints (SageMaker, Bedrock, custom APIs), monitoring latency and throughput.
Conduct...