Sign In
Register

Partnership opportunities

Secure your pass

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Adam
Vagley
Partner
Sole Consulting
Adam is a partner at Sole Consulting, where he helps financial services organizations scale enterprise AI. He writes and speaks on AI adoption, operating models, change management, and the practical challenges of turning AI from isolated pilots into business value. Over the past 20+ years, he has led business and technology initiatives across the U.S., U.K., and Australia, working with organizations ranging from startups to Fortune 100 companies. His experience spans strategy, enterprise AI, product development, and large-scale transformation. Adam is a graduate of Cornell University and lives in Los Angeles with his family.
Button
26 August 2026 11:30 - 12:00
Taming non-determinism: A framework for evaluation and observability in autonomous agent trajectories
Deploying agentic AI in production introduces a unique engineering challenge: debugging non-deterministic execution paths. Unlike traditional software, an agent's "code" is a dynamic interplay of prompt context, model weights, and external tool outputs. This talk presents a rigorous engineering methodology for agents, focusing on quantifying agent performance and analyzing trajectories. Key takeways: →Trajectory evaluations: Analyzing the "Reasoning Trace" using a secondary judge model to detect hallucinated logic steps or tool misuse → Cost-latency trade-offs: Optimizing token usage via dynamic context compression and speculative execution of tool calls → Sandboxing & side-effects: Technical implementation of ephemeral execution environments to safely contain agentic code execution