Globus Online (Globus.org) is the recommended way to move significant amounts of data between NERSC and other sites as the service addresses many of the common challenges faced by researchers in moving, sharing, and archiving large volumes of data. With Globus, you hand-off data movement tasks to a hosted service that manages the entire operation, monitoring performance and errors, retrying failed transfers, correcting problems automatically whenever possible, and reporting status to keep you informed while you focus on your research. Visit Globus.org for documentation on it's easy to use web interface or its versatile REST/API for building scripted tasks and operations.
Globus Online is available as a free service that any user can access. You can log into Globus Online web interface with your NERSC credentials (by select NERSC in the drop down menu of supported identity providers) or using many of the other supported providers listed that you can authenticate against. NERSC maintains several Globus endpoints that can be activated for individual use by any NERSC user. The list of endpoints are provided in the table below.
Endpoint Name Description Recommended Use
Multi-node, high performant transfer system with access to all NERSC Global File systems (NGF) as well as the large Cori Scratch Almost all data transfers needs into & out of NERSC NERSC HPSS Single node system connected directly to the NERSC HPSS tape archive Remote transfers into & out of HPSS NERSC Edison Single node system connected to NGF and uniquely to the Edison scratch file system Only recommended for access to Edison scratch NERSC PDSF Single node system connected to NGF and the two remaining PDSF-specific file systems, eliza3 and eliza18 Only recommended for access to /eliza3 and /eliza18 NERSC Cori Originally a dual-node system needed for accessing the Cori scratch file system. The endpoint is the same as NERSC DTN Use NERSC DTN instead NERSC DTN-JGI Single node system that was used to access JGI-specific file systems, which are now connected to the NERSC DTN servers. Use NERSC DTN instead
Note: To transfer files into/out of your laptop or desktop computer, you can install a Globus connect (personal) server to configure an endpoint on your personal device.