NERSCPowering Scientific Discovery Since 1974

Outage Log

This table lists events reported, ongoing, and resolved on NERSC systems. It is a historical record and may not be updated while a system event is in progress.

Event Date/TimeUp Date/TimeSystemComment
06/18/13 9:44 PDT06/18/13 11:52 PDTGlobus Online/NERSC CAUnavailable. Globus Online and NERSC CA services were unavailable due to certificate issues.
06/12/13 17:05 PDT-EdisonEdison Phase I will be retired on June 24, 2013. Phase II is expected to be available late July or early August.
06/11/13 1:00 PDT06/11/13 19:55 PDTEdisonScheduled maintenance.
06/07/13 13:56 PDT-EdisonEdison is experiencing some batch system issues that prevent debug jobs from starting. We are working with Vendors to fix the problem.
06/06/13 8:00 PDT06/06/13 18:01 PDTEdisonScheduled maintenance.
06/05/13 9:00 PDT06/05/13 11:30 PDTHPSS BackupScheduled maintenance.
06/03/13 10:35 PDT-HopperHopper06 is down, causing Grid and Transfer queues to be unavailable.
05/29/13 9:00 PDT05/29/13 13:53 PDTHPSS UserScheduled maintenance.
05/29/13 10:20 PDT05/29/13 10:30 PDTNIMUnavailable. Access to the NIM login/interface was unavailable.
05/26/13 23:25 PDT05/26/13 23:53 PDTCarverSystem in degraded mode. cvrsvc04 is being rebooted.
05/23/13 15:10 PDT05/23/13 16:15 PDTHopperUnavailable. NGF issues affected /global/home.
05/23/13 15:10 PDT05/23/13 16:15 PDTGenepoolUnavailable. NGF issues affected /global/home.
05/23/13 15:10 PDT05/23/13 16:14 PDTCarverUnavailable. NGF issues affected /global/home.
05/23/13 5:30 PDT05/23/13 16:03 PDTEdisonScheduled maintenance. Dedicated test time and maintenance.
05/23/13 15:10 PDT05/23/13 15:58 PDTGlobal Homes/global/homes unavailable. NGF issues affected /global/home.
05/23/13 8:45 PDT05/23/13 9:00 PDTNIMUnavailable. Intermittent login issues due to database connectivity.
05/22/13 9:00 PDT05/22/13 14:00 PDTHPSS BackupScheduled maintenance.
05/21/13 7:00 PDT05/21/13 18:57 PDTGenepoolScheduled maintenance.
05/21/13 7:00 PDT05/21/13 18:52 PDTPDSFScheduled maintenance.
05/21/13 10:00 PDT05/21/13 10:43 PDTProjectBScheduled maintenance. projectb was unavailable to Hopper, Edison, Carver, and Dirac.
05/21/13 3:00 PDT05/21/13 6:30 PDTNERSC WebsiteUnavailable. Access to www.nersc.gov and www.es.net was unavailable.
05/16/13 5:30 PDT05/16/13 12:15 PDTEdisonUnavailable. Dedicated testing.
05/15/13 9:00 PDT05/15/13 13:50 PDTHPSS UserScheduled maintenance.
05/14/13 14:25 PDT-CarverMatgen queues will be unavailable from 0700-1900 PDT on 5/21.
05/13/13 13:12 PDT05/13/13 18:29 PDTHopperUnavailable. Due to hardware problem, Hopper is unavailable.
05/10/13 8:00 PDT05/10/13 16:20 PDTEdisonScheduled maintenance. During the maintenance, Edison will be unavailable.
05/09/13 14:00 PDT05/09/13 14:40 PDTLicense server Scheduled maintenance. Matlab and Mathematica will be unavailable on all compute platforms
05/09/13 10:00 PDT05/09/13 10:56 PDTPDSFScheduled maintenance. Maintenance on pdsf1 (login node). pdsf2, pdsf3, and pdsf4 will be available.
05/09/13 9:22 PDT05/09/13 10:15 PDTProject/project unavailable. /project was hanging for file creation/deletion. There was intermittent access to directories.
05/08/13 7:00 PDT05/08/13 11:33 PDTHopperScheduled maintenance. During the maintenance, the XE6 mainframe will be down with no access to the batch system. The login nodes will be available for editing files and compiling codes.
05/08/13 9:00 PDT05/08/13 10:10 PDTHPSS UserScheduled maintenance.
05/06/13 11:00 PDT05/06/13 11:29 PDTHPSS UserUnavailable.
05/02/13 14:00 PDT05/02/13 15:30 PDTLicense serverScheduled maintenance. idl, matlab and mathematica were unavailable on all compute platforms
05/01/13 4:00 PDT05/01/13 20:26 PDTEdisonScheduled maintenance.
05/01/13 14:30 PDT05/01/13 14:35 PDTGlobal HomesUnavailable. /global/homes filesystem was unavailable and may have affected Genepool, Hopper and Carver. The problem has been resolved.
05/01/13 9:00 PDT05/01/13 13:00 PDTJesup TestbedScheduled maintenance. Carvers testbed Jesup was unavailable during the timeframe of 0900 to 1300 PDT.
04/30/13 9:00 PDT05/01/13 11:25 PDTDiracSystem in degraded mode. Batch submissions to Dirac were unavailable.
05/01/13 9:00 PDT05/01/13 10:00 PDTHPSS BackupScheduled maintenance.
04/25/13 11:00 PDT04/25/13 11:18 PDTGenepoolScheduled maintenance. From 11-11:30 this morning, one node of House will be rebooted to address hardware issues. Clients may notice pauses in I/O for 10-20 seconds during this period.
04/24/13 11:00 PDT04/24/13 11:15 PDTGenepoolScheduled maintenance. From 11-11:15 PDT this morning, two nodes of House were rebooted to address client locked issues. Clients may have noticed pauses in I/O for 10-20 seconds during that period.
04/24/13 9:00 PDT04/24/13 10:38 PDTHPSS BackupScheduled maintenance.
04/21/13 15:45 PDT04/21/13 17:00 PDTCarverSystem in degraded mode. Due to problems with Carver nodes, NERSC Global Filesystem was experiencing problems that may interfere with accessing certain files and directories.
04/21/13 15:35 PDT04/21/13 16:45 PDTNERSC Global FilesystemSystem in degraded mode. The NERSC Global Filesystem was experiencing problems that may interfere with accessing certain files and directories.
04/21/13 1:11 PDT04/21/13 2:22 PDTNERSC Global FilesystemSystem in degraded mode. The NERSC Global Filesystem was experiencing problems that may interfere with accessing certain files and directories.
04/21/13 1:11 PDT04/21/13 2:22 PDTCarverSystem in degraded mode. Due to problems with Carver nodes, NERSC Global Filesystem was experiencing problems that may interfere with accessing certain files and directories.
04/19/13 20:45 PDT04/19/13 21:10 PDTData Transfer NodesUnavailable. We are currently experiencing system problem and rebooting DTN01/ESG Gateway.
04/19/13 13:42 PDT04/19/13 14:50 PDTProjectSystem in degraded mode. Project filesystem was experiencing problems.
04/18/13 16:00 PDT04/18/13 23:37 PDTEdisonScheduled maintenance. Dedicated test time.
04/17/13 14:20 PDT04/17/13 15:30 PDTCarverSystem in degraded mode. System was in degraded mode due to a network issue.
04/17/13 14:20 PDT04/17/13 14:41 PDTNetworkUnavailable. Network disruption was due to hardware issues affected several systems including Carver, Genepool and the NERSC website.
04/17/13 14:20 PDT04/17/13 14:41 PDTGenepoolSystem in degraded mode. System was in degraded mode due to a network hardware issue.
04/16/13 16:00 PDT04/17/13 11:37 PDTHopperScheduled maintenance. Hopper was unavailable due to emergency facilities maintenance on April 16-17 at Oakland Scientific Facility. While we do not expect other systems to be affected, due to the nature of the work being performed, we may have to power down other NERSC systems at short notice during this time period.
04/16/13 21:50 PDT04/16/13 22:50 PDTNetworkUnavailable. Network disruption was due to hardware issues affected several systems including Carver, Genepool and the NERSC website.
04/16/13 8:00 PDT04/16/13 19:20 PDTCarverScheduled maintenance. Carver/Dirac will be unavailable due to emergency facilities maintenance on April 16-17 at Oakland Scientific Facility. While we do not expect other systems to be affected, due to the nature of the work being performed, we may have to power down other NERSC systems at short notice during this time period.
04/16/13 13:00 PDT04/16/13 15:00 PDTScience Gateway NodesScheduled maintenance. Science gateway nodes (portal, portal-auth, esg) will be down for filesystem maintenance.
04/15/13 13:24 PDT-EdisonBatch queue was stopped at 13:20-13:35PT, 4/15 due to Lustre problem. Problem has been resolved.
04/12/13 12:44 PDT04/12/13 16:00 PDTEdisonLogins available, batch jobs not running. /scratch1 is not available.
04/11/13 9:00 PDT04/11/13 12:05 PDTJesup TestbedScheduled maintenance.
04/10/13 7:00 PDT04/10/13 17:10 PDTEdisonScheduled maintenance.
04/05/13 14:20 PDT04/05/13 15:40 PDTPDSFSystem in degraded mode.
04/05/13 14:20 PDT04/05/13 15:31 PDTGenepoolSystem in degraded mode. Genepool Phase2 was in a degraded state.
04/05/13 14:20 PDT04/05/13 15:31 PDTCarverSystem in degraded mode.
04/03/13 7:00 PDT04/03/13 19:20 PDTEdisonScheduled maintenance.
04/03/13 9:00 PDT04/03/13 10:46 PDTHPSS UserScheduled maintenance.
04/02/13 22:30 PDT04/03/13 0:45 PDTData Transfer Nodes 3 & 4Unavailable. DTN03 and DTN04 were down. Problem resolved.

Show Older Outages: