Description
Customer Experience and Business Trends (CXBT) is seeking a Senior Technical Program Manager to join our exciting team building advanced model and agent evaluation capabilities that measure the performance of GenAI (LLMs, multi-modal models, LLM-based agents) and end-customer experience, providing performance benchmarks versus alternatives. This product provides an opportunity to influence how Amazon teams improve customer experiences through comprehensive model assessment and optimization capabilities. Our objective is to create a self-guided application that empowers teams across Amazon to independently evaluate AI/ML models and LLM-powered agents, and measure application-level outcome metrics. This allows teams to make data-driven decisions about model selection and optimization with speed and agility.

The ideal candidate will be comfortable in a fast-paced environment and have proven experience planning, executing, and delivering projects across cross-functi...