Storage Trends and Summaries

Total Bytes Utilized

The growth in NERSC’s storage systems amounts to roughly 1.7x per year, as shown in the graph below.

Number of Files Stored

The chart below shows that the growth in the number of files stored is less than the growth in the number of bytes stored, as the average file size has increased over time. The average file size as of August 2003 is about 30 MB. The median file size is closer to 1 MB.

Monthly I/O

The growth rate of I/O is roughly the same as the growth rate of the number of bytes stored. As a rough rule of thumb, the amount of I/O per month is about 10% to 14% of the amount of data residing in the storage systems.

Additional graphs show the last 30 days of activity for the amount of I/O and the number of files transferred.

A yearly summary is shown in these bar charts which show the growth and distribution of the I/O traffic between storage and network destinations.