NERSCPowering Scientific Discovery Since 1974

Burst Buffer

The NERSC Burst Buffer is based on Cray DataWarp that uses flash or SSD (solid-state drive) technology to significantly increase the I/O performance on Cori for all file sizes and all access patterns. 

 

 

Burst Buffer Architecture and Software Roadmap

The Burst Buffer on Cori is a layer of non-volatile storage that sits between the a processors' memory and the parallel file system. The burst buffer will serve to accelerate I/O performance of application on Cori. Read More »

Tutorials and example batch scripts

Burst Buffer usage documentation Read More »

Burst Buffer Early User Program

NERSC selected a number of HPC research projects to participate in the center’s new Burst Buffer Early User Program, where they were able to test and run their codes using the new Burst Buffer feature on the center’s newest supercomputer, Cori. The following are the applications selected to receive early access to the Burst Buffer, and in some cases active NERSC support in tailoring their code to take advantage of the Burst Buffer features. Please see this news article for more details on… Read More »

Known Issues

There are a number of known issues to be aware of when using the Burst Buffer on Cori. This page will be updated as problems are discovered, and as they are fixed.  General Issues  Do not use a decimal point when you specify the burst buffer capacity - slurm does not parse this correctly and will allocate you one grain of space instead of the full request. This is easy to work around - request 3500GB instead of 3.5TB, etc.   Data is at risk in a Persistent Reservation if an SSD fails - there… Read More »

Performance Tuning

Hints and tips on how to optimize your Burst Buffer performance Note: this only applies to the Cori Burst Buffer and should not be taken as general Burst Buffer advice (i.e. your mileage will vary on other systems). This page will be updated as the DataWarp software is updated and performance continues to improve.  For larger files, ensure your Burst Buffer allocation will be striped over multiple nodes Currently, the Burst Buffer granularity is 82GiB in the wlm_pool, and 20.14GiB in the… Read More »

Publications

The Burst Buffer Early User program has resulted in several publications, posters and talks. For reference, we list them here.  "Accelerating Science with the NERSC Burst Buffer", W. Bhimji, Cray User Group (CUG) 2016 (Best Paper award) "Accelerating Science with the NERSC Burst Buffer", D. Bard, Salishan Conference on High-Speed Computing 2016  "Data Elevator: Low-contention Data Movement in Hierarchical Storage System", Bin Dong, Suren Byna, Kesheng Wu, Prabhat, Hans Johansen, Jeffrey N. Read More »