NERSCPowering Scientific Discovery Since 1974

Globus Online

To access the HPSS system using Globus Online, you first need to create a Globus Online account. Once you've created an account you can log in either with your Globus Online information or with your NERSC account information. The first time you log in using your NERSC account you'll be asked to enter your Globus Online account information as well.

Once you're logged in select "Start Transfer" (under "File Transfer"). This will take you to the file transfer page which looks like this.

The left hand side is the location you are transferring files from and the right hand side is where the files are going. NERSC endpoints have names like 'nersc#carver' and  'nersc#hpss'. Click on the elipsis ('...') next to each box to see a listing of all available endpoints. If you haven't connected to a particular endpoint before, you may have to type it into the box and will have to authenticate with the account information for that endpoint. For nersc# endpoints you authenticate with your NERSC account information. Below is an example of transferring from hopper to HPSS.

To copy files, click on the file you want to move and then click on the lit up blue arrow. Globus Online will copy the file and send you an email when the transfer succeeds (if the transfer fails for whatever reason, Globus Online will retry until it succeeds). You can copy file both ways.

Globus Online also has a command line interface. Please see this page for details on how to set it up.

Currently, there is no explicit ordering by tape of file retrievals for Globus Online.  If you're retrieving a large data set with Globus Online, we recommend that users see this page for instructions on how to best order files using HSI and then retrieve files using the command line interace for Globus Online in tape order.

 

 

 

 

 

 

 

 

 

The major benefits of GridFTP clients over other HPSS clients are their ability to accept grid credentials that you may already have along with their multi-threaded transfer capability.  They are well known for making optimal utilization of available network bandwidth and performing well for WAN data transfers.  They can also do third-party transfers where you launch the transfer from a low-capability workstation for a transfer that occurs between two supercomputers.  Grid clients require additional software for this but can also launch and forget or retry on failure.