Sign In
Register

Register your interest

Save $100 on your pass

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Alexei
Robsky
Senior Director, Data Science and AI
Microsoft
Alexei leads cutting-edge machine learning and AI initiatives at Microsoft, driving real-time intelligence and aligning technical innovation with strategic business goals. Previously at Google Gemini, he led research on post-training data and model evaluation, bringing deep expertise in RLHF, SFT, and human+LLM evals to real-world AI impact.
Button
02 October 2025 15:20 - 15:40
Panel discussion | LLM Evaluation: frameworks, metrics, and best practices
Dissect LLM evaluation, covering the frameworks, metrics, and tooling used to assess real-world performance. Panelists will explore trade-offs between automatic and human-in-the-loop methods, evaluate alignment with task-specific goals, and share lessons from production-grade testing pipelines. Expect a grounded, hands-on discussion on what actually works when benchmarking LLMs for reliability, safety, and business impact.