Partnership opportunities

Save $200 on your pass

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Jeff
Singer
VP, Engineering
DraftKings
Jeff is a Vice President of Engineering at DraftKings, he leads engineering teams building highly scalable, customer-facing platforms that power millions of users in one of the world's largest digital sports entertainment and gaming companies. With a background in engineering leadership across large-scale consumer technology, he specializes in building resilient, high-performance products, leading distributed teams, and driving engineering excellence. Jeff is passionate about modern software architecture, AI-enabled development, and creating technology organizations that can innovate rapidly while operating reliably at enterprise scale.
Button
29 October 2026 11:00 - 11:30
Taming non-determinism: A framework for evaluation and observability in autonomous agent trajectories
Deploying agentic AI in production introduces a unique engineering challenge: debugging non-deterministic execution paths. Unlike traditional software, an agent's "code" is a dynamic interplay of prompt context, model weights, and external tool outputs. This talk presents a rigorous engineering methodology for agents, focusing on quantifying agent performance and analyzing trajectories. Key takeways: →Trajectory evaluations: Analyzing the "Reasoning Trace" using a secondary judge model to detect hallucinated logic steps or tool misuse. → Cost-latency trade-offs: Optimizing token usage via dynamic context compression and speculative execution of tool calls. → Sandboxing & side-effects: Technical implementation of ephemeral execution environments to safely contain agentic code execution.