Develop and Optimize Deep Learning Recommender Systems: Insights and Best Practices from NVIDIA, Facebook, and TensorFlow

Join fellow machine learning engineers and data scientists on July 29 for an engaging online conversation with experts who are building hardware and software that make recommenders run efficiently at scale.

By joining this Deep Learning Recommender Summit, you'll hear from fellow ML engineers and data scientists from NVIDIA, Facebook, and TensorFlow on best practices, learnings, and insights for building and optimizing highly effective DL recommender systems.

Sessions

High-Performance Recommendation Model Training at Facebook

Deep learning recommendation models are the single largest AI application at Facebook which consumes the highest number of compute cycles at our large-scale data-centers. Meanwhile, training recommendation models with GPU is challenging as the model often contains large embedding tables thus carries compute-intensive, memory intensive and communication-intensive components. In this talk, we will first analyze how model architecture affects the GPU performance and efficiency, and also present the performance optimizations techniques we applied to improve the GPU utilization, which includes optimized PyTorch-based training stack supporting both model and data parallelism, high-performance GPU operators, efficient embedding table sharding, memory hierarchy and pipelining.

RecSys2021 Challenge Predicting User Engagements with Deep Learning Recommender Systems

The NVIDIA team, a collaboration of Kaggle Grandmaster and NVIDIA Merlin, won the RecSys2021 challenge. It was hosted by Twitter, who provided almost 1 billion tweet-user pairs as a dataset. The team will present their winning solution with a focus on deep learning architectures and how to optimize them.

Revisiting Recommender Systems on GPU

In this talk we’ll explore changes in GPU hardware within the last generation that make it much better suited to the recommendation problem, along with improvements on the software side that take advantage of optimizations only possible in the recommendation domain. A new era of faster ETL, Training and Inference is coming to the RecSys space and this talk will walk through some of the patterns of optimization that guide the tools we’re building to make recommenders faster and easier to use on the GPU.

TensorFlow Recommenders

TensorFlow Recommenders is an end-to-end library for recommender system models: from retrieval, through ranking, to post-ranking. In this talk, we describe how TensorFlow Recommenders can be used to fit and safely deploy sophisticated recommender systems at scale.

Content

content goes here