Session • SC20

· Contributors · Organizations · Search Program

Workshop: The 5th Deep Learning on Supercomputers Workshop

Session Chairs

Valeriu Codreanu

Argonne National Laboratory (ANL)

University of Chicago

Texas Advanced Computing Center (TACC)

Event TypeWorkshop

Registration Categories

TimeWednesday, 11 November 202010am - 6:30pm EDT

LocationTrack 7

Presentations

10:00am - 10:10am EDT	DLS – Introduction: The 5th Deep Learning on Supercomputers Workshop Organizers Zhao Zhang Ian T. Foster Valeriu Codreanu
10:10am - 11:10am EDT	AI for Science: AI + HPC Presenter Rick Stevens
11:10am - 11:30am EDT	DLS – Break
11:30am - 12:00pm EDT	Online-Codistillation Meets LARS: Going beyond the Limit of Data Parallelism in Deep Learning Author/Presenters Shogo Murai Hiroaki Mikami Masanori Koyama Shuji Suzuki Takuya Akiba
12:00pm - 1:00pm EDT	DLS – Lunch Break
1:00pm - 2:00pm EDT	Exploring the Limits of Concurrency in ML Training on Google TPUs Presenter Sameer Kumar
2:00pm - 2:30pm EDT	DLS – Break
2:30pm - 3:00pm EDT	Time-Based Roofline for Deep Learning Performance Analysis Author/Presenters Yunsong Wang Charlene Yang Steven Farrell Yang Zhang Thorsten Kurth Samuel Williams
3:00pm - 3:30pm EDT	Towards a Scalable and Distributed Infrastructure for Deep Learning Applications Author/Presenters Bita Hasheminezhad Shahrzad Shirzad Nanmiao Wu Patrick Diehl Hannes Schulz Hartmut Kaiser
3:30pm - 4:00pm EDT	DDLBench: Towards a Scalable Benchmarking Infrastructure for Distributed Deep Learning Author/Presenters Matthijs S. Jansen Valeriu Codreanu Ana-Lucia Varbanescu
4:00pm - 4:30pm EDT	DLS – Break
4:30pm - 5:00pm EDT	Vandermonde Wave Function Ansatz for Improved Variational Monte Carlo Author/Presenters Alberto Acevedo Michael Curry Brett Leroux Shantanu Joshi Nicholas Malaya
5:00pm - 5:30pm EDT	TopiQAL: Topic-aware Question Answering Using Scalable Domain-Specific Supercomputers Author/Presenters Hamsa Shwetha Venkataram Chris A. Mattmann Scott Penberthy
5:30pm - 6:00pm EDT	DeepGalaxy: Deducing the Properties of Galaxy Mergers from Images Using Deep Neural Networks Author/Presenters Maxwell X. Cai Jeroen Bédorf Vikram A. Saletore Valeriu Codreanu Damian Podareanu Adel Chaibi Penny X. Qian