Responsibilities

• Own the reliability and quality bar for an AI copilot embedded in a trading platform used by sophisticated investors
• Design and build evaluation systems to measure correctness, safety, latency, and regression risk across market analysis and trading workflows
• Develop and maintain benchmarks, including curated golden sets, scenario suites, and adversarial test cases
• Build automated quality gates and regression workflows to ensure model stability during releases
• Partner with engineering and product teams to define safe tool/action contracts and ensure predictable assistant behavior
• Manage model improvement loops through data collection, labeling strategies, error taxonomy, and fine-tuning
• Design and operate monitoring, telemetry, and incident response processes for AI systems

Requirements

• At least 8 years of experience shipping production software with strong ...