NERSCPowering Scientific Discovery Since 1974

E4S at NERSC 2022, Aug 25, 2022

August 25, 2022

Introduction

NERSC and ECP Training is co-hosting a one-day E4S at NERSC training event on Aug 25th, 2022. This session will provide users with an overview of E4S and how one can use the E4S stack at NERSC. We will have a hands-on component where one will learn how to deploy their own software stack using spack along with E4S tutorial. There will be numerous talk from ECP leadership on the different focus efforts pertaining to E4S and how it aligns with the ECP project. This session will be continuation of E4S at DOE Facilties with Deep Dive at NERSC

This session will be held in hybrid mode (both in-person and online), and is open to all ECP members and all users of NERSC, ALCF, and OLCF.   

The Extreme-scale Scientific Software Stack (E4S) is a collection of open source software packages for high performance computing. The E4S stack comes with up to 100+ HPC applications, libraries and tools, MPI, development tools such as HPCToolkit, TAU, PAPI, math libraries including PETSC and Trilinos. E4S is available for use via containers, buildcache, AWS EC2 image, and facility tuned spack environments in the form of spack.yaml. E4S provides a new model for providing a standard set of software stack to HPC centers with dedicated support to help bridge the gap between HPC facilities and application developers of E4S products. NERSC has several deployments of E4S on Cori and Perlmutter using the spack package manager. We plan to use E4S as the vehicle for installing and supporting much of the software we provide for users.

Session Details

Richard Gerber, HPC Department Head will start with opening remarks and present what E4S is for NERSC users. Mike Heroux, who leads the ECP Software Technology (ST) group will present an overview of the group and what types of applications are being developed in the ECP project. E4S consists of many open source products developed by ECP ST teams which are installed on DOE systems at OLCF, ALCF and NERSC. Sameer Shende, who leads the E4S project will present the components of E4S and the different modes on how to access the E4S stack.

Katie Antypas who leads the Hardware Integration (HI) whose focus is application integration at facility, hardware evaluation, training and productivity and software deployment at facility. Katie will present an update on current activities and roadmap for the upcoming year.

We will discuss the E4S software deployment process at HPC centers, with a particular focus on what we’re doing here at NERSC to bring you reliable, performant HPC software. Shahzeb Siddiqui will present an overview of E4S stacks installed at NERSC. This session will be a mix of hands-on and walkthrough the NERSC E4S Documentation. Participants are encouraged to follow the hands-on session if you have access to NERSC systems. Shahzeb will present the Spack Infrastructure project at NERSC that discusses how we leverage Gitlab to automate spack deployments using Continuous Integration capability.

The Software Deployment (SD) group is responsible for deploying ECP software at the DOE facilities via E4S. The SD group partners with Application Development (AD) and ST projects to properly tune their software to run efficiently on the facility system. This group is responsible for providing CI infrastructure to help AD/ST teams automate their workflows using GitLab CI. Ryan Adamson will provide an overview of the Software Deployment group including current challenges and future roadmap.

We will conclude this event with hands-on exercise on how to use spack on Perlmutter to deploy software stack. Sameer will present how to use E4S containers, replacing MPI in an E4S container with the host MPI, creating custom containers for your application, using E4S on AWS and DOE facilities, and building applications using E4S with a bare-metal installation. He will highlight the use of E4S on Perlmutter and answer questions about applying E4S to your projects.

Time Topic Speaker
9:00am - 9:05am Welcome Richard Gerber
9:15am - 9:25am E4S for NERSC and its Users Richard Gerber
9:25am - 9:45am What is E4S Sameer Shende
9:45am - 10:00am Overview of Software Technology Mike Heroux
10:00am - 10:15am Overview of Hardware Integration Katie Antypas
10:15am - 10:25am Break  
10:25am - 10:50am NERSC Spack Infrastructure Shahzeb Siddiqui
10:50am - 11:10am Software Deployment at the Facilities Ryan Adamson
11:10am - 11:30am E4S User Documentation Shahzeb Siddiqui
11:30am - 12:30am Lunch  
12:30am - 1:30pm Spack Training on Perlmutter Shahzeb Siddiqui
1:30pm - 2:15pm E4S Training Sameer Shende
2:15 - 2:30pm Q/A  

 

Venue

In-Person and Remote Connection Information.

This event will be presented both online and in-person at NERSC/LBNL (visitor info) in Berkeley, CA. The training will be held at Building 59 (Wang Hall), Room 3101, from 9 a.m. to 2 p.m PST.

Please refer to the corresponding ECP training page for more details and presenters introduction.

Lunch will be provided! 

Registration

Please use this form to register. There is no registration fee.