NERSCPowering Scientific Discovery Since 1974

Deep Learning at Scale Tutorial at ISC 2019

Staff from NERSC (Thorsten Kurth, Mustafa Mustafa, Steve Farrell) and Cray (Mike Ringenburg) presented a tutorial on Deep Learning at Scale at ISC 2019 in Frankfurt, Germany.

Attendees learned about core concepts of deep learning, about state of the art methods for scaling model training on large computing systems, and heard about a number of success stories in scientific applications of deep learning. They were given training accounts on Cori and ran hands-on examples that implement some of the most established, practical scaling techniques.

The materials (slides, code examples) are available at

IMG 20190616 095840265