Mark
Kim-Huang
Chief Architect & Co-Founder
Gradient
Mark is a co-founder and Chief Architect at Gradient, a full stack AI platform that enables businesses to build customized agents to power enterprise workloads. Known for his pioneering work in LLMs and fine-tuning, Mark is a frequent contributor to the AI and MLOps community. Prior to Gradient, Mark led machine learning teams at Splunk and Box, transitioning over from a nearly decade long career as an algorithmic trader at quantitative hedge funds like Stevens Capital, Paloma Partners, and TD Securities. Mark holds a dual bachelors degree in mathematics and finance from the University of Pennsylvania.
17 April 2024 09:30 - 10:00
Solving enterprise use cases through agents: caching memories and customizing Models
Have you ever struggled to make an LLM perform the task that you intend? Providing more raw context is still only a stop gap. Even though new releases of models such as Gemini support context lengths of up to 1M tokens, Retrieval Augmented Generation (RAG) is brittle to the retrieval mechanism and often fails to reconcile between multiple sources of context. The same failure points are amplified when introducing Autonomous Agents due to compounding effects of chaining multiple tasks together. Learn how to build a reliable production AI Agent System and apply it to high stake industries such as financial services and healthcare. We will deep dive into sentiment analysis as an unexpected and useful showcase of how you can go from a naive system to production level performance through a composable AI system to manage an agent’s memory, connect it to the higher-level concept of sentiment, and utilize reasoning traces for continual performance enhancement.