Session • SC20

· Contributors · Organizations · Search Program

Workshop: The 5th Deep Learning on Supercomputers Workshop

Session Chairs

Valeriu Codreanu

Argonne National Laboratory (ANL)

University of Chicago

Texas Advanced Computing Center (TACC)

Event TypeWorkshop

Registration Categories

TimeWednesday, 11 November 202010am - 6:30pm EST

LocationTrack 7

Presentations

10:00am - 10:10am EST	DLS – Introduction: The 5th Deep Learning on Supercomputers Workshop Organizers Zhao Zhang Ian T. Foster Valeriu Codreanu
10:10am - 11:10am EST	AI for Science: AI + HPC Presenter Rick Stevens
11:10am - 11:30am EST	DLS – Break
11:30am - 12:00pm EST	Online-Codistillation Meets LARS: Going beyond the Limit of Data Parallelism in Deep Learning Author/Presenters Shogo Murai Hiroaki Mikami Masanori Koyama Shuji Suzuki Takuya Akiba
12:00pm - 1:00pm EST	DLS – Lunch Break
1:00pm - 2:00pm EST	Exploring the Limits of Concurrency in ML Training on Google TPUs Presenter Sameer Kumar
2:00pm - 2:30pm EST	DLS – Break
2:30pm - 3:00pm EST	Time-Based Roofline for Deep Learning Performance Analysis Author/Presenters Yunsong Wang Charlene Yang Steven Farrell Yang Zhang Thorsten Kurth Samuel Williams
3:00pm - 3:30pm EST	Towards a Scalable and Distributed Infrastructure for Deep Learning Applications Author/Presenters Bita Hasheminezhad Shahrzad Shirzad Nanmiao Wu Patrick Diehl Hannes Schulz Hartmut Kaiser
3:30pm - 4:00pm EST	DDLBench: Towards a Scalable Benchmarking Infrastructure for Distributed Deep Learning Author/Presenters Matthijs S. Jansen Valeriu Codreanu Ana-Lucia Varbanescu
4:00pm - 4:30pm EST	DLS – Break
4:30pm - 5:00pm EST	Vandermonde Wave Function Ansatz for Improved Variational Monte Carlo Author/Presenters Alberto Acevedo Michael Curry Brett Leroux Shantanu Joshi Nicholas Malaya
5:00pm - 5:30pm EST	TopiQAL: Topic-aware Question Answering Using Scalable Domain-Specific Supercomputers Author/Presenters Hamsa Shwetha Venkataram Chris A. Mattmann Scott Penberthy
5:30pm - 6:00pm EST	DeepGalaxy: Deducing the Properties of Galaxy Mergers from Images Using Deep Neural Networks Author/Presenters Maxwell X. Cai Jeroen Bédorf Vikram A. Saletore Valeriu Codreanu Damian Podareanu Adel Chaibi Penny X. Qian