Deep Learning at Scale Tutorial at ISC 2019
Staff from NERSC (Thorsten Kurth, Mustafa Mustafa, Steve Farrell) and Cray (Mike Ringenburg) presented a tutorial on Deep Learning at Scale at ISC 2019 in Frankfurt, Germany.
Attendees learned about core concepts of deep learning, about state of the art methods for scaling model training on large computing systems, and heard about a number of success stories in scientific applications of deep learning. They were given training accounts on Cori and ran hands-on examples that implement some of the most established, practical scaling techniques.
The materials (slides, code examples) are available at