NERSCPowering Scientific Discovery Since 1974

Deep Learning and General Machine Learning

Machine Learning and Deep Learning are increasingly used to analyze scientific data, in fields as diverse as neuroscience, climate science and particle physics. In this page you will find links to examples of scientific use cases using deep learning at NERSC, information about what deep learning packages are available at NERSC, and details of how to scale up your deep learning code on Cori to take advantage of the compute power available from Cori's KNL nodes. 

Machine learning for science at NERSC

Examples of how machine learning is being used for science at NERSC

 

Science Use Cases

We have assembled some examples of machine learning projects being carried out at NERSC, in most cases including links to the codebase. These cover a variety of science areas, and in many cases showcase the use of Tensorflow optimised for the KNL architecture. 

Deep Learning Software

NERSC supports several software frameworks for machine learning and deep learning. If there is a framework you would like to see evaluated and supported at NERSC, please let us know

Anaconda

Most standard machine learning and deep learning packages are available via the anaconda installation on both Edison and Cori. Anaconda is the easiest way to access and use these frameworks, and is the way we recommend most users get started with machine learning at NERSC. The packages include: 

  • Tensorflow
  • XGBoost
  • Scikit-Learn
  • Theano
  • Torch

Spark

We also provide Spark as a separate module

Caffe

Caffe is also available in a separate module - simply use  module load caffe/master

 

Tensorflow

 As well as the version available under the anaconda distribution, we also provide a version that has been optimized to run very efficiently on Intel architectures. Please see Using TensorFlow at NERSC for more details.

Resources for learning more about machine learning for science

  • Machine learning and deep learning is being used in many scientific fields at LBNL. This article describes in depth some of the opportunities (and challenges!) involved in using deep learning to enable scientific discovery. 
  • For an overview of how machine learning is impacting scientific discovery, watch the video "Deep Learning for Science" by NERSC's Prabhat from the 2017 HPC Developer Conference.   
  • LBNL staff participated in NIPS 2017. This article links to papers presented by lab staff on several deep learning topics. 
  • For more detail on optimizing deep learning architectures for CPUs, see this blog post from Intel