Drive quality assurance in AI operations at Summit, a leading commercial brokerage. This role focuses on agent performance and ensuring operational excellence in a hybrid environment.
As a Quality Engineer for AI Operations at Summit in Kelowna, you'll work with innovative AI technologies to assure the quality of our production agents. Your responsibilities will include running tests, curating memory resources, and collaborating with broker teams to enhance agent capabilities. This position is crucial to maintaining the high standards Summit is known for in Canada’s commercial insurance sector.
Key Responsibilities:
• Execute regression tests on production agents
• Analyze evaluation results to identify systemic issues
• Tune memory libraries for agent context accuracy
• Document agent workflows and training resources
• Partner with broker teams to resolve feature gaps
Requirements:
• 2-4 years working with AI systems or applications
• Expertise in prompt ...