HPSS Storage Statistics

Statistics about NERSC's storage systems are collected in order to plan for future needs and to monitor utilization.  The statistics come from HPSS collected statistics, HPSS accounting records and log files provided by the hsi and ftp servers.

• Bandwidth and Transfer Activity Data Rate vs. File Size The graph below shows the bandwidth for individual file transfers for one day. The graph also gives a quick overview of the traffic and maximum bandwidth and file size for a given day. Historical yearly peak days Aggregate Transfer Bandwidth This graph shows the aggregate transfer rate to the storage systems as a function of time of day. The red line is the peak bandwidth observed within each one minute interval. The green line is the average over ten minute intervals.
  • Bandwidth Historical Peak Days
  • Aggregate Transfers Last 8 Days
  • Aggregate Transfers Historical Yearly Peak
  • Concurrent Transfers Last 8 Days
  • Concurrent Transfers Historical Yearly Peak
  • Transfer Activity Last 8 Days
  • Transfer Activity Historical Yearly Peak
• Storage Trends and Summaries Total Bytes Utilized The growth in NERSC's storage systems amounts to roughly 1.7x per year.   Number of Files Stored The growth in the number of files stored is less than the growth in the number of bytes stored as the average file size has increased over time. The average file size as of August 2003 is about 30 MB. The median file size is closer to 1 MB.   Monthly I/O The growth rate of I/O is roughly the same as the growth rate of the number of bytes stored. As a rough rule of thumb, the…
  • I/O Statistics Last 30 Days
  • HPSS Yearly Network Traffic
  • Tape Mounts Last 30 Days
• Storage by Scientific Discipline These graphs show the utilization of storage space by scientific disciplines.  Space consumed by backups, staff resources and overhead functions is not shown here.   Total Bytes Utilized Number of Files Monthly…