Move to CRT
During Fall 2015, NERSC will be moving from the Oakland Scientific Facility (OSF) in downtown Oakland to a brand new building: the Computational Research and Theory (CRT) facility, located on the main Lawrence Berkeley National Laboratory campus.
Impact on NERSC users
NERSC will make every effort to minimize the move's impact on its users. We do not expect to shut down the center completely at any point during the move and NERSC will always have at least one computational system available. However, there will be significantly fewer computing hours available when Edison moves to CRT in December. Edison is expected to be down for up to 6 weeks. There will also be times when the I/O bandwidth to various global file systems will be reduced for extended periods.
The move will be performed in phases spread over several months. During the move there will be extended periods where some resources are at OSF, and others are at CRT. Communication between the two sites will be provided by a single 400 Gb/s network connection, and a backup 100Gb/s connection.. Thus, if you are running on a compute platform located at OSF, but performing I/O on a file system located at CRT, I/O bandwidth may be reduced.
Edison will begin its move to CRT on November 30, 2015 and is expected to be offline for up to 6 weeks. Hopper will not move; it will be retired at OSF. Carver was retired on September 30; Hopper will likely retire on December 15, 2015.
There will be no outage for Genepool and PDSF.
Global scratch was retired on October 14, 2016. All other global file systems (homes, common, project, projectb, dna, seqfs) will be moved to CRT in phases starting in early November. Communication between the two sites is provided by a primary 400Gb/s network connection, and a backup 100Gb/s connection..
Each global file system will be migrated over the high speed network to CRT. The migration process is an I/O intensive activity, and will consume a sizable fraction of available file system bandwidth. During the migration, you may notice a reduction in file system performance. After the migration completes, some compute systems at OSF will have decreased file system bandwidth. We do not expect any outage of the global file systems during this process.
Both HPSS systems (user archive and system backup) will remain at OSF until other moves complete, accessed via the 400 Gb/s network link.
|Carver Retires||September 30, 2015 (at noon). Retired|
|Jesup Testbed Retires||September 30, 2015 (at noon). Retired|
|Global Scratch Retires||October 14, 2015 (at noon). Retired|
|Cori Phase 1 becomes available to all users||All users enabled on Nov. 11, 2015|
|Edison offline for move to new facility||November 30, 2015 (all files on scratch file systems will be deleted). The estimated downtime is up to 6 weeks.|
|Hopper retires||December 15, 2015, at noon|
Cori Phase 1 and associated file systems were installed at CRT.
Carver was retired on September 30, 2015 at noon. On the same day (and same time), the Global Scratch file system became read-only and the Jesup testbed system was retired.
Global Scratch was retired on October 14, 2015 at noon.
Cori Phase 1 became available to early users.
Cori Phase 1 will be made available to all users.
The Global Projecta file system will be migrated to CRT (estimate starting Nov 9). During the migration, available bandwidth will be reduced. After migration completes, IO performance from systems at OSF accessing /global/projecta at CRT may be reduced. We do not expect any outage of /global/projecta during this process.
The Global Project file system will be migrated to CRT (estimate from Nov 30 to Dec 15). During the migration, available bandwidth will be reduced. After migration completes, IO performance from systems at OSF accessing /global/project at CRT may be reduced. We do not expect any outage of /global/project during this process.
Edison is scheduled to be powered off at 7:00am PST on November 30, 2015. Edison scratch file systems will be reformatted and all data will be removed. ALL files on the /scratch1, /scratch2, and /scratch3 file systems will be DELETED!
Edison queues will be turned off and all running jobs will be killed at 00:01 PST (midnight) on November 30, 2015. All queued jobs will be deleted. Edison login nodes will be available until 7am PST on November 30 for users to retrieve files.
Edison will begin move to CRT; relocation will result in about 6 weeks of downtime.
Hopper will retire after Cori Phase 1 is installed, stable and has users running on it. The planned date is December 15, 2015, at noon.
Global homes will be migrated to CRT. During the migration, available bandwidth will be reduced. After migration completes, IO performance from systems at OSF accessing /global/homes at CRT may be reduced. We do not expect any outage of /global/homes during this process.
Edison will return to service in its new home in CRT. It will be brought online with Slurm as the batch system.
/global/projectb, /global/dna/, and /global/seqfs (JGI file systems) will be migrated to CRT. During the migration, available bandwidth will be reduced. After migration completes, IO performance from systems at OSF accessing these file systems at CRT may be reduced. We do not expect any outage of these file systems during this process.
Some PDSF file systems will be relocated to CRT. This will result in about a two week outage for those file systems.
A cluster providing resources to PDSF, JGI, the Materials Project and Babbage will be moved. There will be new compute components for PDSF and JGI already in place at CRT, so this will not be an outage; however, the total amount of available compute resources will be reduced during the move. For the Materials Project there will be a three week outage while it is moved. Babbage will be offline for up to a month while it is moved.
Cori Phase 2 will be delivered and installed at CRT.
Cori Phase 2 will be available to all users.