NERSCPowering Scientific Discovery Since 1974

Outage Log

This table lists events reported, ongoing, and resolved on NERSC systems. It is a historical record and may not be updated while a system event is in progress.

Event Date/TimeUp Date/TimeSystemComment
08/17/17 4:48 PDT08/17/17 7:00 PDTEdisonSystem in degraded mode. No new jobs are running on Edison while engineers investigate a possible filesystem issue. Logins are available and jobs can be submitted.
08/15/17 14:00 PDT08/15/17 17:23 PDTCoriSystem in degraded mode. cscratch1 is unavailable while engineers investigate filesystem issues.
08/15/17 14:00 PDT08/15/17 17:23 PDTEdisonSystem in degraded mode. cscratch1 is unavailable while engineers investigate filesystem issues.
08/15/17 11:45 PDT08/15/17 13:30 PDTEdisonSystem in degraded mode.
08/14/17 10:35 PDT08/14/17 11:13 PDTEdisonSystem in degraded mode. Edison is experiencing filesystem issues. Engineering are actively working on the situation.
08/11/17 20:55 PDT-CoriCreation of new Datawarp Persistent Reservations (PR) does not work. A workaround is available if needed.
08/08/17 12:00 PDT08/08/17 12:15 PDTData Transfer NodesScheduled maintenance.
08/08/17 11:00 PDT08/08/17 11:30 PDTJGI Oracle DatabaseScheduled maintenance.
08/08/17 10:00 PDT08/08/17 11:00 PDTNERSC WebsiteScheduled maintenance. The website will be down for 5 to 10 minutes during the scheduled maintenance window.
08/08/17 10:00 PDT08/08/17 11:00 PDTNIMScheduled maintenance. NIM will be down briefly (5 to 10 minutes) during the maintenance window.
08/08/17 9:40 PDT08/08/17 12:15 PDTSeqFSScheduled maintenance.
08/08/17 9:00 PDT08/08/17 14:00 PDTGenepool web and database servicesScheduled maintenance. Web and database servers will be down for up to 90 minutes within the scheduled maintenance window for system software upgrades. Genepool web filesystem will be patched, but no additional outage is expected.
08/08/17 9:00 PDT08/08/17 12:15 PDTScience Gateway ServicesScheduled maintenance.
08/08/17 9:00 PDT08/08/17 12:00 PDTNX ServicesScheduled maintenance.
08/08/17 9:00 PDT08/08/17 12:18 PDTMyProxyScheduled maintenance. MyProxy will be down briefly (5 to 10 minutes) during the scheduled maintenance window.
08/08/17 9:00 PDT08/08/17 10:14 PDTLicense serversScheduled maintenance. This service will be down briefly (5 to 10 minutes) within the scheduled maintenance window
08/08/17 9:00 PDT08/08/17 10:14 PDTFTPScheduled maintenance. This service will be down briefly (5 to 10 minutes) within the scheduled maintenance window
08/08/17 9:00 PDT08/08/17 10:14 PDTLDAPScheduled maintenance. There will be scheduled maintenance on this service, but no outage is expected.
08/08/17 9:00 PDT08/08/17 14:00 PDTSpinScheduled maintenance. There will be scheduled maintenance on this service, but no outage is expected.
08/08/17 8:00 PDT08/08/17 10:00 PDTHPSS BackupScheduled maintenance.
08/08/17 8:00 PDT08/08/17 10:00 PDTHPSS UserScheduled maintenance.
08/08/17 5:30 PDT08/10/17 21:45 PDTCoriScheduled maintenance. Cori will be unavailable for Quarterly Maintenance.
08/08/17 5:30 PDT08/08/17 18:26 PDTNERSC CenterScheduled maintenance. NERSC Quarterly Maintenance.
08/08/17 5:30 PDT08/08/17 18:26 PDTEdisonScheduled maintenance. Edison will be unavailable for Quarterly Maintenance.
08/07/17 11:00 PDT08/07/17 11:23 PDTCoriSystem in degraded mode. Cori in degraded mode. Engineers are working now.
08/05/17 20:38 PDT08/06/17 11:35 PDTCoriSystem in degraded mode. /cscratch1 is currently unavailable. Engineers have identified the issue and are in the process of implementing a solution.
08/05/17 20:38 PDT08/06/17 11:35 PDTEdisonSystem in degraded mode. /cscratch1 is currently unavailable. Engineers have identified the issue and are in the process of implementing a solution.
08/04/17 12:50 PDT08/04/17 16:15 PDTEdisonLogins available, batch jobs not running. Batch queues on Edison are currently stopped. Engineers are actively working to resolve the issue.
08/04/17 10:30 PDT08/04/17 11:15 PDTCoriSystem in degraded mode. New logins on cori are experiencing Luster filesystem issues. Engineers are working on the issue.
08/03/17 20:31 PDT08/04/17 4:43 PDTCoriSystem in degraded mode. cscratch1 is currently unavailable. Engineers are investigating the issue.
08/03/17 20:31 PDT08/04/17 12:00 PDTEdisonUnavailable. cscratch1 is currently unavailable. Engineers are investigating the issue.
08/02/17 23:31 PDT-PDSFFollowing a center-wide outage, all previously running jobs on PDSF have been deleted. Please resubmit these jobs.
08/02/17 14:30 PDT08/02/17 23:55 PDTNERSC CenterUnavailable. Lab power is being shut down and the NERSC center will lose all connectivity. *** UPDATE: We are in the process of restoring NERSC systems, and expect them to be available soon.***
08/02/17 14:30 PDT08/02/17 23:42 PDTCoriUnavailable. We are in the process of restoring NERSC systems, and expect them to be available soon.
08/02/17 14:30 PDT08/02/17 19:04 PDTDNAUnavailable. NERSC is unavailable due to an imminent power outage at LBNL.
08/02/17 14:30 PDT08/02/17 20:59 PDTData Transfer NodesUnavailable. NERSC is unavailable due to an imminent power outage at LBNL.
08/02/17 14:30 PDT08/02/17 23:55 PDTEdisonUnavailable. We are in the process of restoring NERSC systems, and expect them to be available soon.
08/02/17 14:30 PDT08/02/17 23:55 PDTGenepoolUnavailable. We are in the process of restoring NERSC systems, and expect them to be available soon.
08/02/17 14:30 PDT08/02/17 19:04 PDTGlobal CommonUnavailable. NERSC is unavailable due to an imminent power outage at LBNL.
08/02/17 14:30 PDT08/02/17 19:04 PDTGlobal HomesUnavailable. NERSC is unavailable due to an imminent power outage at LBNL.
08/02/17 14:30 PDT08/02/17 23:54 PDTPDSFUnavailable. We are in the process of restoring NERSC systems, and expect them to be available soon.
08/02/17 14:30 PDT08/02/17 19:04 PDTProjectUnavailable. NERSC is unavailable due to an imminent power outage at LBNL.
08/02/17 14:30 PDT08/02/17 19:04 PDTProjectAUnavailable. NERSC is unavailable due to an imminent power outage at LBNL.
08/02/17 14:30 PDT08/02/17 19:04 PDTProjectBUnavailable. NERSC is unavailable due to an imminent power outage at LBNL.
08/02/17 14:30 PDT08/02/17 23:55 PDTSeqFSUnavailable. We are in the process of restoring NERSC systems, and expect them to be available soon.
08/02/17 8:58 PDT-EdisonGlobus transfers to/from Edison scratch are unavailable. Collaboration accounts can be accessed via corigrid.nersc.gov.
08/01/17 10:06 PDT08/01/17 11:52 PDTNX ServicesUnavailable. Engineers are investigating the issue.
08/01/17 7:33 PDT08/01/17 8:52 PDTNX ServicesSystem in degraded mode. Issues are being investigated
07/30/17 23:05 PDT07/31/17 8:00 PDTCoriSystem in degraded mode. lustre file system access is degraded. Engineers are implementing a solution.
07/30/17 11:30 PDT07/31/17 16:24 PDTCoriLogins available, batch jobs not running. Cori is back production, correcting the issue required all running jobs be terminated.
07/30/17 2:45 PDT07/30/17 11:30 PDTCoriSystem in degraded mode. Compute, Datawarp, and service nodes in the c2-1 cabinet are currently unavailable. New jobs are currently not starting. Engineers are actively working to resolve this issue. UPDATE: Cori is currently draining for a system reboot at approx. 11:00 PDT.
07/28/17 16:26 PDT-CoriCori back in service as 16:24. Correcting the issue required terminating all running jobs.
07/27/17 16:08 PDT-EdisonShifter functionality is unavailable. New jobs that require shifter images will not work and new image pulling is unavailable at this time. Engineers are investigating the issue.
07/27/17 16:07 PDT-CoriShifter functionality is unavailable. New jobs that require shifter images will not work and new image pulling is unavailable at this time. Engineers are investigating the issue.
07/26/17 23:07 PDT-EdisonDue to a configuration problem, all compute nodes of Edison had to be rebooted between 10:00-10:30PM. All running jobs were terminated
07/26/17 9:00 PDT07/26/17 13:54 PDTHPSS BackupScheduled maintenance.
07/22/17 18:53 PDT07/23/17 3:24 PDTCoriUnavailable. Cori back up at 3:24
07/17/17 7:00 PDT07/26/17 16:00 PDTEdisonScheduled maintenance. Edison will be unavailable for an operating system upgrade.
07/12/17 9:15 PDT07/12/17 11:01 PDTHPSS BackupScheduled maintenance.
07/10/17 12:19 PDT07/10/17 12:30 PDTCoriSystem in degraded mode. Partitions have been downed in order to do maintenance work.
07/05/17 22:40 PDT07/06/17 2:00 PDTCoriDedicated runs. System is open
07/05/17 10:00 PDT07/05/17 10:19 PDTNX ServicesScheduled maintenance. System will be rebooted and all connected login sessions will be terminated.
07/05/17 9:00 PDT07/05/17 13:54 PDTHPSS UserScheduled maintenance.
07/05/17 7:00 PDT07/05/17 22:40 PDTCoriScheduled maintenance. Hardware maintenance. Logins will be unavailable, however /global/cscratch1 will remain available.
07/03/17 10:00 PDT07/03/17 17:00 PDTEdisonUnavailable. System will be rebooted, interactive login sessions terminated.
06/30/17 9:30 PDT06/30/17 11:05 PDTGenepool Web ServicesScheduled maintenance. This service will experience a brief outage, during the maintenance window.
06/29/17 15:34 PDT06/29/17 18:35 PDTGenepoolSystem in degraded mode. Genepool queues have been stopped to investigate an ongoing issue.

Show Older Outages: