Partnership opportunities

Secure your seat

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Ramy
Erfan
VP, Business & Technology Enablement
Citi
Ramy is Vice President of Business & Technology Enablement at Citi, specialising in AI governance, enterprise transformation and operational excellence within highly regulated financial services environments. With more than 13 years of international experience across technology, operations and risk, he has led large-scale transformation programmes across multiple markets. His work focuses on moving AI and Generative AI from experimentation to controlled, enterprise-wide adoption while enabling regulatory confidence, operational readiness and measurable business outcomes. Ramy also contributes to the wider industry through speaking engagements and by mentoring MBA students at Imperial College Business School.
Button
02 December 2025 16:30 - 17:00
Panel | Is it doing the right thing? The new job of checking your agents' work
An agent can complete a task successfully and still produce the wrong outcome. As agents take on longer workflows and greater autonomy, teams need to evaluate more than final outputs, they must determine whether the agent followed the right process, used tools appropriately and acted within its intended boundaries. This panel will examine how engineering teams can evaluate agent behaviour at scale. We'll explore what “correct” looks like for non-deterministic systems, where human review still belongs and how continuous evaluation can help teams trust agents without slowing down deployment. Key takeaways: → Define success for agents when there may be more than one valid path or outcome. → Evaluate both final outputs and the actions taken to produce them. → Combine automated evaluation with targeted human review. →Build continuous checks that keep pace as agents, tools and workflows evolve.