Partnership opportunities

Get your ticket

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Priyanka
Pande
AI Platform Product Manager
Capital One
Priyanka Pande is a Product Manager at Capital One, where she has built enterprise observability, developer, and data products in financial services. Her career spans banking, insurance, and AI startups, focusing on taking AI from early ideas to products people actually use. Beyond her day job, Priyanka is passionate about entrepreneurship and is actively involved with Women in Product and Products that Count (PTC), where she organizes events, mentors, and loves bringing the product and tech community together. She is passionate about making AI practical, responsible, and accessible to the people it’s meant to serve
Button
29 October 2026 12:30 - 13:00
Panel | The new evaluation stack: Measuring reasoning, workflow quality, and real-world performance
How do you know your AI system is actually working? Not in a test environment. Not on a benchmark. In production, across multi-step tasks, where failures don't always throw an error and drift doesn't always announce itself. Most existing tooling wasn't built for this problem. This session gets into how engineering teams are building eval infrastructure for workflow-based AI: catching silent failures, measuring reasoning quality across decision chains, and closing the gap between controlled evals and real-world performance. Key takeaways: - How to measure reasoning quality across multi-step workflows, not just final output accuracy - The patterns that signal silent failure or drift before they surface as visible errors - What a production-grade eval stack looks like when you're evaluating a workflow, not a single model