SC20 Is Everywhere We Are

SC20 Virtual Platform
Kraken: Memory-Efficient Continual Learning for Large-Scale Real-Time Recommendation
Event Type
Machine Learning, Deep Learning and Artificial Intelligence
Memory Optimization
Scalable Computing
Registration Categories
TimeTuesday, 17 November 20202pm - 2:30pm EDT
LocationTrack 4
DescriptionModern recommendation systems in industry often use deep learning (DL) models that achieve better model accuracy with more data and model parameters. Current open-source DL frameworks, however, such as TensorFlow and PyTorch, show relatively low scalability on training recommendation models with terabytes of parameters. To efficiently learn large-scale recommendation models from data streams that generate hundreds of terabytes training data daily, we introduce a continual learning system called Kraken. Kraken contains a special parameter server implementation that dynamically adapts to the rapidly changing set of sparse features for the continuous training and serving of recommendation models. Kraken provides a sparsity-aware training system that uses different learning optimizers for dense and sparse parameters to reduce memory overhead. Extensive experiments using real-world datasets confirm the effectiveness and scalability of Kraken. Kraken can benefit the accuracy of recommendation tasks with the same memory resources, or trisect the memory usage, while keeping model performance.
Back To Top Button