NERSCPowering Scientific Discovery Since 1974

Move to CRT

During 2015, NERSC will be moving from the Oakland Scientific Facility (OSF) in downtown Oakland to a brand new building:  the Computational Research and Theory (CRT) facility, located at Lawrence Berkeley National Laboratory (LBNL).  Groundbreaking for the building took place on February 1, 2012, and construction is continuing.

The information on this page is still very preliminary, and subject to change as planning continues.

User Impact

NERSC will make every effort to minimize the user impact of this move.  We do not expect to shut down the Center completely at any point during the move.  However, there will be periods when some systems will be unavailable for several days.  There will also be times when available I/O bandwidth to various global file systems will be reduced for extended periods. 

The move will be performed in a series of phases spread over several months.  During the move, there will be extended periods where some resources are at OSF, and others are at CRT.  Communication between the two sites will be provided by a single 100 Gb/s network connection.  Thus, if you are running on a compute platform located at OSF, but performing I/O on a file system located at CRT, the available bandwidth will be reduced.

Summary

Edison will move to CRT.  Hopper and Carver will not move; both will be retired at OSF.  Carver will be retired August 31, 2015; Hopper will remain in service until Edison has resumed full production at CRT.  Cori, NERSC's next major system, will be installed at CRT in mid-2016.  NERSC is still investigating the possibility of acquiring addional computational resources to "close the gap" between the retirement of Hopper and the arrival of Cori.

Some old Genepool hardware will be retired; some current Genepool hardware will be moved; some new Genepool hardware will be acquired.  The same is true for PDSF hardware.

All global file systems will be moved, in phases, as will both HPSS systems.

Schedule

At this time, exact dates of system outages are not known.  Once the building contractors have committed to a particular date when NERSC personnel can begin installing our network infrastructure, we will be able to provide more accurate estimates.  What is presented here is a month-by-month overview of move activities that will impact user access to NERSC systems and services.  We expect these activities to begin in Spring, 2015.

Month 1

/global/homes will be replicated and installed at CRT.  During the replication, available bandwidth will be reduced.  After installation, bandwidth between systems at OSF and /global/homes at CRT will be limited.  We do not expect any outage of /global/homes during this process.

/global/projectb, /global/dna/, and /global/seqfs (JGI file systems) will be replicated and installed at CRT.  During the replication, available bandwidth will be reduced.  After installation, bandwidth between systems at OSF and JGI file systems at CRT will be limited.  We expect a 2-day outage of JGI file systems during this process.

Month 2

Some PDSF file systems will be relocated to CRT.  This will result in about a week of outage for those file systems.

Month 3

A cluster with the internal name Mendel (provides resources to PDSF, JGI, and the Materials Project) will be moved.  There will be new compute components for PDSF and JGI already in place at CRT, so this will not be an outage; however, the total amount of available compute resources will be reduced during the move.  For the Materials Project, there will be an outage while Mendel is moved.

Month 4

The HPSS Backup system will be moved.  This system is used primarily for system backups.  It will be unavailable for 2 - 3 weeks.

Month 6

/global/project will be replicated and installed at CRT.  Following this, an outage lasting a few days will be necessary to complete the migration of project data.

Month 7

Edison will be moved.  Users can expect an Edison outage of at least a month.

Month 8

The HPSS Archive system will be moved.  This is the primary "user" HPSS system.  It will be unavailable for 2 - 3 weeks.  Edison move will be completed.