Partnerships

Register now

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Ralph
Lozano
Director, Data Scientist
JP Morgan Chase
Ralph Lozano is Director Data Scientist at JPMorgan Chase, leading ML and NLP initiatives to turn complex data into actionable insights. He has held technical and leadership roles across Capital One, PwC, and KPMG, building high-performing teams and scalable AI systems, and also serves in the Army National Guard.
Button
05 June 2025 16:00 - 16:30
Panel | Evaluating autonomous agents: Bridging the gap between testing and real-world performance
Evaluating autonomous agents is harder than static models or prompt-based systems. Their behavior unfolds over sequences, interacts with tools and environments, and can shift in live conditions in ways offline tests miss. In this panel, engineers share how they measure agent behavior, analyze trajectories over single outputs, and identify the signals that matter in real-world contexts, offering candid insights on what works, what doesn’t, and remaining evaluation challenges.