30 April 2025 14:20 - 14:40
Exploring the intersection of knowledge distillation & transformer models in optimizing online ranking systems
Nikhil's session will explore the application of knowledge distillation techniques in optimizing online ranking systems, while highlighting its connection to generative models and transformers.
The session will cover critical factors such as latency requirements, data sparsity, and the need to preserve ranking quality, all within the context of reducing model complexity using the power of transformer architectures.