Sign In
Register

Partnership opportunities

Secure your seat

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Gregor
Williamson
Senior Data Scientist
Amazon
Gregor leads agentic evaluations at Amazon, where he defines the global strategy for Alexa for Shopping’s LLM-as-a-judge program. His team develops self-service evaluation capabilities that give feature developers actionable insights on demand. He leads company-wide workshops focused on practical AI adoption. His career spans AI research, development, and evaluation across academia and industry, from scrappy startups to products serving hundreds of millions of customers worldwide.
Button
01 December 2026 16:30 - 17:00
Panel | Your agent completed the task. But did It do it right?
An agent can complete a task successfully and still produce the wrong outcome. As agents take on longer workflows and greater autonomy, teams need to evaluate more than final outputs, they must determine whether the agent followed the right process, used tools appropriately and acted within its intended boundaries. This panel will examine how engineering teams can evaluate agent behaviour at scale. We'll explore what “correct” looks like for non-deterministic systems, where human review still belongs and how continuous evaluation can help teams trust agents without slowing down deployment. Key takeaways: → Define success for agents when there may be more than one valid path or outcome. → Evaluate both final outputs and the actions taken to produce them. → Combine automated evaluation with targeted human review. →Build continuous checks that keep pace as agents, tools and workflows evolve.