Nick supports HPSS systems and the NERSC Globus/HPSS interface.
Lisa Gerhardt, Jeff Porter, Nick Balthaser, Lessons Learned from Running an HPSS Globus Endpoint, 2016 HPSS User Forum, September 1, 2016,
- Download File: HPSS-Globus-LBNL-NERSC-HUF2016.pptx (pptx: 16 MB)
The NERSC division of LBNL has been running HPSS in production since 1998. The archive is quite popular with roughly 100TB IO every day from the ~6000 scientists that use the NERSC facility. We maintain a Globus-HPSS endpoint that transfers over 1PB / month of data into and out of HPSS. Getting Globus and HPSS to mesh well can be challenging. This talk gives an overview of some of the lessons learned.
N. Balthaser, GlobusOnline/HPSS Live Demo, HUF 2013, November 5, 2013,
- Download File: GO-HPSS-LiveDemo-HUF2013.pdf (pdf: 1.6 MB)
Live demonstration using the GlobusOnline data transfer software to store files to the NERSC archive for 2013 HPSS Users Forum meeting.
N. Balthaser, LBNL/NERSC Site Report: HPSS in Production, HUF 2013, November 5, 2013,
- Download File: HUF-2013-NERSC-site-intro.pdf (pdf: 1.3 MB)
Overview of HPSS infrastructure and practices at LBNL/NERSC for 2013 HPSS Users Forum meeting.
N. Balthaser, W. Hurlbert, T10KC Technology in Production, May 9, 2013,
- Download File: LTUG-2013-T10KC.pdf (pdf: 1 MB)
Report to 2012 Large Tape User Group meeting regarding our production statistics and experiences using the Oracle T10000C tape drive.
N. Balthaser, J. Hick, W. Hurlbert, StorageTek Tape Analytics: Pre-Release Evaluation at LBNL, LTUG 2012, April 25, 2012,
A report to the Large Tape Users Group (LTUG) annual conference on a pre-release evaluation of the new software product, StorageTek Tape Analytics (STA). We provide a user's perspective on what we found useful, some suggestions for improvement, and some key new features that would enhance the product.
Glenn K. Lockwood, Damian Hazen, Quincey Koziol, Shane Canon, Katie Antypas, Jan Balewski, Nicholas Balthaser, Wahid Bhimji, James Botts, Jeff Broughton, Tina L. Butler, Gregory F. Butler, Ravi Cheema, Christopher Daley, Tina Declerck, Lisa Gerhardt, Wayne E. Hurlbert, Kristy A. Kallback-
Rose, Stephen Leak, Jason Lee, Rei Lee, Jialin Liu, Kirill Lozinskiy, David Paul, Prabhat, Cory Snavely, Jay Srinivasan, Tavia Stone Gibbins, Nicholas J. Wright,
"Storage 2020: A Vision for the Future of HPC Storage",
October 20, 2017,
- Download File: Storage-2020-A-Vision-for-the-Future-of-HPC-Storage.pdf (pdf: 3.6 MB)
N. Balthaser, D. Hazen, "HSI Best Practices for NERSC Users", May 2, 2011, LBNL 4745E,
- Download File: HSIBestPractices-Balthaser-Hazen-2011-06-09.pdf (pdf: 245 KB)
In this paper we explain how to obtain and install HSI, create a NERSC authentication token, and transfer data to and from the system. Additionally we describe methods to optimize data transfers and avoid common pitfalls that can degrade data transfers and storage system performance.