SpeakersAgendaWhy attendPartnersVenue
Locations ▼

Get invited

Register

Partnership opportunities

Secure your pass

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

EJ
Odo
Principal Product Manager
Microsoft
Ejiofor (EJ) Odo is a Principal Product Manager at Microsoft Azure, where he focuses on AI infrastructure strategy, competitive intelligence, and total cost of ownership (TCO) modeling for next-generation compute platforms. With over a decade of experience spanning semiconductors, cloud, and data infrastructure, EJ has led analysis and strategy across GPUs, custom silicon, and large-scale AI systems. He specializes in translating complex hardware and system-level innovations into clear business and economic insights, helping shape cloud platform decisions in the rapidly evolving AI landscape. Prior to Microsoft, EJ held roles across product management and engineering in the storage and semiconductor industry.
Button
15 April 2025 16:30 - 17:00
Panel | What breaks when GenAI scales: Latency, cost, and reliability in the real world
As GenAI adoption grows, the underlying infrastructure is under constant strain. Latency spikes, unpredictable traffic, rising inference costs, and brittle retrieval layers often emerge long after a system looks stable in testing. This session explores how engineering teams are redesigning serving layers, data pipelines, and performance workflows to keep GenAI systems fast, affordable, and reliable at scale. Key takeaways: → How teams reduce latency under real-world load → The cost impact of routing, batching, and caching decisions → Where retrieval layers and vector search introduce scaling limits → Architectural choices that improve reliability as usage grows