Accessing HPSS - HSI

HSI is a flexible and powerful interface utility to HPSS. The HSI commands are similar to those in ftp and pftp (e.g., put and mput) and UNIX (e.g., mv, mkdir, rm, cp, cd). HSI also has commands similar to those in CFS. HSI can be used both interactively or in batch scripts.

A related utility, HTAR, is useful for archiving multiple files to HPSS without using the intermediate local file storage that would be needed if one first used the tar utility followed by HSI.

For complete documentation on HSI, see the HSI documentation. There are man pages for HSI on production NERSC computers.

Authentication

NERSC's HPSS systems rquire DCE authentication. Your DCE Principal (login name) is the same as your NERSC user id. Your DCE password, however, is handled differently. See the HPSS Passwords section of this document.

Your first login to HPSS with HSI will require the use of both your DCE principal (login name) and your DCE password. After this HSI will have established a local credential on the computer from which you connect. Subsequent connections from that system will be automatically authenticated. To force generation of new credentials, use the -L option, as follows:

% hsi -L

Connecting with HSI

From NERSC machines

To connect to the main user system (archive) from a NERSC machine, simply start the HSI utility:

% hsi

This is equivalent to the following:

% hsi archive

From NERSC machines do not specify archive.nersc.gov as this will force HSI to use the slower external network interface.

NERSC's other HPSS system - the original HPSS system at NERSC - is named "hpss". (It seemed like a good idea at the time, but now causes confusion. It is know internally as "regent"). This system is now used for backups, and does not offer the same capacity and performance as "archive." However, it does contain some older user data. To connect to it from within NERSC use the command:

% hsi hpss

From outside NERSC

NERSC's HPSS system can be accessed via HSI from outside the NERSC domain. The discussion above applies except the DNS (internet) names of the machines should be specified as one of:

• archive.nersc.gov (current production)
• hpss.nersc.gov(deprecated for user file storage)

Remember that hpss.nersc.gov is not the current NERSC production machine for users.

HSI binaries for a number of different platforms can be downloaded by NERSC users.

Starting and Using HSI

HSI can accept input several different ways; some examples:

HSI can also read from standard input and write to standard output using pipes.

For "get" and "put" operations, HSI uses a special syntax to identify and separate the local and HPSS file names:

1. The local file name is always on the left, and the HPSS file name is always on the right.
2. A ":" (colon character) always separates the local pathname from the HPSS pathname, and the colon character must be surrounded by whitespace.

Examples:

% put local_file : hpss_file  
% get local_file : hpss_file  

Recursive operations are allowed for the following commands:

    cget, chgrp, chmod, chown, cput
    delete, get, ls, mdelete, mget, mput
    put, rm, stage, touch

Wildcards are supported.

Frequently Used Commands

HSI's command set is rich, and will look familiar to users of UNIX, FTP, and other storage utilities. A small set of commands will satisfy most user storage needs.

Short List of HSI Commands by Function

A complete list of HSI commands is available in Chapter 8 of the HSI manual.

HPSS File and Directory Commands

Local File and Directory Commands

File Administrative Information

Miscellaneous HSI commands