Partnership opportunities

Register now

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Matt
Staats
Engineering Manager
Meta
Matt Staats has split his career between academia and industry, first exploring driving correctness in critical systems, and later applying his expertise towards large scale industrial problems. He has a decade of experience driving innovation and technical excellence across a variety of domains, including Apple’s self-driving car project, Google Assistant, and Gemini. He currently leads a team in the Meta Llama Research org with a focus on scalable, performant infrastructure and enabling agentic behaviors in LLMs.
12 September 2024 09:00 - 09:30
Llama 3
Llama 3 models take data and scale to new heights. It's been trained on two recently announced custom-built 24K GPU clusters on over 15T token of data – a training dataset 7x larger than that used for Llama 2, including 4x more code. In this session, Matt Staats shares more on how it got to where it is.