NERSCPowering Scientific Discovery Since 1974

Outage Log

This table lists events reported, ongoing, and resolved on NERSC systems. It is a historical record and may not be updated while a system event is in progress.

Event Date/TimeUp Date/TimeSystemComment
09/13/17 9:10 PDT-HPSS BackupHPSS will remain available during the NERSC scheduled maintenance 10/06/17 13:00 - 10/10/17 17:00 PDT
09/13/17 9:10 PDT-HPSS UserHPSS will remain available during the NERSC scheduled maintenance 10/06/17 13:00 - 10/10/17 17:00 PDT
09/13/17 8:00 PDT09/13/17 13:37 PDTHPSS UserScheduled maintenance.
09/12/17 14:21 PDT09/12/17 14:32 PDTCoriSystem in degraded mode. Logins are available, batch jobs are running. New jobs will not start due to hardware work.
09/06/17 18:42 PDT09/07/17 6:00 PDTCoriDedicated runs. All KNL nodes are reserved for large scale science runs. KNL job submission is available, and Haswell nodes are open.
09/06/17 8:00 PDT09/06/17 18:42 PDTCoriScheduled maintenance.
09/05/17 15:40 PDT09/05/17 18:09 PDTCoriSystem in degraded mode. Due to extreme weather conditions in Berkeley the KNL partitions are down. New KNL jobs won't start.
09/05/17 13:31 PDT09/05/17 15:40 PDTCoriLogins available, batch jobs not running. Due to extreme weather conditions in Berkeley the batch scheduling partitions are down.
09/05/17 13:31 PDT09/05/17 15:40 PDTEdisonLogins available, batch jobs not running. Due to extreme weather conditions in Berkeley the batch scheduling partitions are down.
09/04/17 17:01 PDT09/04/17 20:40 PDTEdisonUnavailable.
09/04/17 13:42 PDT09/04/17 14:05 PDTCoriSystem in degraded mode. Slurm commands and job submission was unavailable during this time due to software issues, which have been corrected.
09/02/17 14:25 PDT09/02/17 18:35 PDTEdisonUnavailable. All queues have been paused due to high temperature conditions in Berkeley.
09/02/17 11:30 PDT09/02/17 19:00 PDTCoriSystem in degraded mode. All queues have been paused due to high temperature conditions in Berkeley.
09/02/17 11:30 PDT09/02/17 14:25 PDTEdisonSystem in degraded mode. All queues have been paused due to high temperature conditions in Berkeley.
09/01/17 18:58 PDT-EdisonDue to extreme temperatures in the Bay Area, the scheduler will be paused during the hot parts of the day this weekend. Queues will resume as the temperature permits.
09/01/17 18:57 PDT-CoriDue to extreme temperatures in the Bay Area, the scheduler will be paused during the hot parts of the day this weekend. Queues will resume as the temperature permits.
09/01/17 15:30 PDT09/01/17 19:30 PDTGenepoolLogins available, batch jobs not running. Due to extreme temperatures in the Bay Area, the scheduler will be paused during the hot parts of the day this weekend. Queues will resume as the temperature permits.
09/01/17 15:30 PDT09/01/17 19:30 PDTPDSFLogins available, batch jobs not running. Due to extreme temperatures in the Bay Area, the scheduler will be paused during the hot parts of the day this weekend. Queues will resume as the temperature permits.
09/01/17 14:43 PDT09/01/17 18:29 PDTCoriLogins available, batch jobs not running. Due to extreme temperatures in the Bay Area, the scheduler will be paused during the hot parts of the day this weekend. Queues will resume as the temperature permits.
09/01/17 14:43 PDT09/01/17 18:34 PDTEdisonLogins available, batch jobs not running. Due to extreme temperatures in the Bay Area, the scheduler will be paused during the hot parts of the day this weekend. Queues will resume as the temperature permits.
08/31/17 8:23 PDT08/31/17 8:30 PDTNetworkUnavailable. Brief network interruption on circuits between ESnet, NERSC and LBL.
08/30/17 19:36 PDT08/30/17 22:00 PDTCoriSystem in degraded mode. Cori is in a degraded state. Engineers are investigating the issue
08/30/17 9:00 PDT08/30/17 13:11 PDTNX ServicesScheduled maintenance. NX will be unavailable for maintenance
08/25/17 7:00 PDT08/25/17 8:22 PDTNIMUnavailable. NIM will be unavailable while engineers update to the new ERCAP interface
08/24/17 8:52 PDT-EdisonLogins to edisongrid is currently unavailable.
08/23/17 18:24 PDT08/23/17 22:24 PDTEdisonLogins unavailable, batch jobs running. Logins are temporarily unavailable. Engineers are investigating the issue.
08/23/17 7:00 PDT08/23/17 18:24 PDTEdisonScheduled maintenance. Edison maintenance. System and logins will not be available.
08/22/17 1:53 PDT08/22/17 4:44 PDTHPSS UserUnavailable. Archive is unavailable. Engineers are investigating
08/17/17 4:48 PDT08/17/17 7:00 PDTEdisonSystem in degraded mode. No new jobs are running on Edison while engineers investigate a possible filesystem issue. Logins are available and jobs can be submitted.
08/15/17 14:00 PDT08/15/17 17:23 PDTCoriSystem in degraded mode. cscratch1 is unavailable while engineers investigate filesystem issues.
08/15/17 14:00 PDT08/15/17 17:23 PDTEdisonSystem in degraded mode. cscratch1 is unavailable while engineers investigate filesystem issues.
08/15/17 11:45 PDT08/15/17 13:30 PDTEdisonSystem in degraded mode.
08/14/17 10:35 PDT08/14/17 11:13 PDTEdisonSystem in degraded mode. Edison is experiencing filesystem issues. Engineering are actively working on the situation.
08/11/17 20:55 PDT-CoriCreation of new Datawarp Persistent Reservations (PR) does not work. A workaround is available if needed.
08/08/17 12:00 PDT08/08/17 12:15 PDTData Transfer NodesScheduled maintenance.
08/08/17 11:00 PDT08/08/17 11:30 PDTJGI Oracle DatabaseScheduled maintenance.
08/08/17 10:00 PDT08/08/17 11:00 PDTNERSC WebsiteScheduled maintenance. The website will be down for 5 to 10 minutes during the scheduled maintenance window.
08/08/17 10:00 PDT08/08/17 11:00 PDTNIMScheduled maintenance. NIM will be down briefly (5 to 10 minutes) during the maintenance window.
08/08/17 9:40 PDT08/08/17 12:15 PDTSeqFSScheduled maintenance.
08/08/17 9:00 PDT08/08/17 14:00 PDTGenepool web and database servicesScheduled maintenance. Web and database servers will be down for up to 90 minutes within the scheduled maintenance window for system software upgrades. Genepool web filesystem will be patched, but no additional outage is expected.
08/08/17 9:00 PDT08/08/17 12:15 PDTScience Gateway ServicesScheduled maintenance.
08/08/17 9:00 PDT08/08/17 12:00 PDTNX ServicesScheduled maintenance.
08/08/17 9:00 PDT08/08/17 12:18 PDTMyProxyScheduled maintenance. MyProxy will be down briefly (5 to 10 minutes) during the scheduled maintenance window.
08/08/17 9:00 PDT08/08/17 10:14 PDTLicense serversScheduled maintenance. This service will be down briefly (5 to 10 minutes) within the scheduled maintenance window
08/08/17 9:00 PDT08/08/17 10:14 PDTFTPScheduled maintenance. This service will be down briefly (5 to 10 minutes) within the scheduled maintenance window
08/08/17 9:00 PDT08/08/17 10:14 PDTLDAPScheduled maintenance. There will be scheduled maintenance on this service, but no outage is expected.
08/08/17 9:00 PDT08/08/17 14:00 PDTSpinScheduled maintenance. There will be scheduled maintenance on this service, but no outage is expected.
08/08/17 8:00 PDT08/08/17 10:00 PDTHPSS BackupScheduled maintenance.
08/08/17 8:00 PDT08/08/17 10:00 PDTHPSS UserScheduled maintenance.
08/08/17 5:30 PDT08/10/17 21:45 PDTCoriScheduled maintenance. Cori will be unavailable for Quarterly Maintenance.
08/08/17 5:30 PDT08/08/17 18:26 PDTNERSC CenterScheduled maintenance. NERSC Quarterly Maintenance.
08/08/17 5:30 PDT08/08/17 18:26 PDTEdisonScheduled maintenance. Edison will be unavailable for Quarterly Maintenance.
08/07/17 11:00 PDT08/07/17 11:23 PDTCoriSystem in degraded mode. Cori in degraded mode. Engineers are working now.
08/05/17 20:38 PDT08/06/17 11:35 PDTCoriSystem in degraded mode. /cscratch1 is currently unavailable. Engineers have identified the issue and are in the process of implementing a solution.
08/05/17 20:38 PDT08/06/17 11:35 PDTEdisonSystem in degraded mode. /cscratch1 is currently unavailable. Engineers have identified the issue and are in the process of implementing a solution.
08/04/17 12:50 PDT08/04/17 16:15 PDTEdisonLogins available, batch jobs not running. Batch queues on Edison are currently stopped. Engineers are actively working to resolve the issue.
08/04/17 10:30 PDT08/04/17 11:15 PDTCoriSystem in degraded mode. New logins on cori are experiencing Luster filesystem issues. Engineers are working on the issue.
08/03/17 20:31 PDT08/04/17 4:43 PDTCoriSystem in degraded mode. cscratch1 is currently unavailable. Engineers are investigating the issue.
08/03/17 20:31 PDT08/04/17 12:00 PDTEdisonUnavailable. cscratch1 is currently unavailable. Engineers are investigating the issue.
08/02/17 23:31 PDT-PDSFFollowing a center-wide outage, all previously running jobs on PDSF have been deleted. Please resubmit these jobs.
08/02/17 14:30 PDT08/02/17 23:55 PDTNERSC CenterUnavailable. Lab power is being shut down and the NERSC center will lose all connectivity. *** UPDATE: We are in the process of restoring NERSC systems, and expect them to be available soon.***
08/02/17 14:30 PDT08/02/17 23:42 PDTCoriUnavailable. We are in the process of restoring NERSC systems, and expect them to be available soon.
08/02/17 14:30 PDT08/02/17 19:04 PDTDNAUnavailable. NERSC is unavailable due to an imminent power outage at LBNL.
08/02/17 14:30 PDT08/02/17 20:59 PDTData Transfer NodesUnavailable. NERSC is unavailable due to an imminent power outage at LBNL.
08/02/17 14:30 PDT08/02/17 23:55 PDTEdisonUnavailable. We are in the process of restoring NERSC systems, and expect them to be available soon.
08/02/17 14:30 PDT08/02/17 23:55 PDTGenepoolUnavailable. We are in the process of restoring NERSC systems, and expect them to be available soon.
08/02/17 14:30 PDT08/02/17 19:04 PDTGlobal CommonUnavailable. NERSC is unavailable due to an imminent power outage at LBNL.

Show Older Outages: