NERSCPowering Scientific Discovery Since 1974

Outage Log

This table lists events reported, ongoing, and resolved on NERSC systems. It is a historical record and may not be updated while a system event is in progress.

Event Date/TimeUp Date/TimeSystemComment
09/22/16 14:40 PDT09/22/16 15:05 PDTHPSS BackupUnavailable.
09/18/16 18:31 PDT09/18/16 21:00 PDTNetworkSystem in degraded mode. Engineers are performing emergency maintenance to apply security updates. There may be network interruptions during this time.
09/17/16 10:10 PDT09/17/16 11:00 PDTNX ServicesUnavailable. Users may have observed connection refusals during this time. Engineers have fixed the issue and are investigating the root cause.
09/14/16 9:32 PDT-EdisonThe
09/14/16 7:34 PDT09/14/16 9:27 PDTEdisonLogins available, batch jobs not running. New jobs may not be submitted and new jobs are not starting. Engineers are currently investigating.
09/13/16 18:42 PDT09/13/16 20:14 PDTEdisonSystem in degraded mode. Jobs running, no new jobs starting. Engineers are investigating.
09/09/16 10:00 PDT09/09/16 10:30 PDTGenepoolScheduled maintenance. gpint209, gpint210 will be rebooted.
09/07/16 17:08 PDT09/07/16 18:00 PDTCoriDedicated runs.
09/07/16 9:00 PDT09/07/16 11:48 PDTHPSS BackupScheduled maintenance.
09/07/16 9:00 PDT09/07/16 12:00 PDTHPSS UserScheduled maintenance.
09/07/16 8:00 PDT09/07/16 17:08 PDTCoriScheduled maintenance. Cori will be unavailable for a system reboot
09/02/16 23:31 PDT09/03/16 5:38 PDTEdisonUnavailable. Edison compute nodes are currently unavailable. All running jobs were lost at approximately 23:30. Engineers are working on the issue. Logins are available.
09/02/16 13:00 PDT09/02/16 16:50 PDTEdisonSystem in degraded mode. Intermittent timeouts from queue commands. Logins are available and jobs are running. Job scheduling has been paused.
08/30/16 23:30 PDT08/31/16 10:46 PDTCoriSystem in degraded mode. Cori logins are available, Batch is down for new job starts.
08/30/16 12:00 PDT08/30/16 17:00 PDTHPSS UserScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
08/30/16 8:00 PDT08/30/16 22:00 PDTNERSC CenterScheduled maintenance. NERSC Quarterly Maintenance. All systems are affected. Global filesystems will be unmounted across all systems. Logins and batch scheduler will be disabled. Network connectivity will be disrupted. Please check status on MOTD for uptime on the various items.
08/30/16 8:00 PDT08/30/16 13:41 PDTNetworkScheduled maintenance. Network upgrades. Disruptions to internal and external connectivity.
08/30/16 8:00 PDT08/30/16 23:00 PDTEdisonScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
08/30/16 8:00 PDT08/30/16 19:10 PDTPDSFScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
08/30/16 8:00 PDT08/30/16 19:53 PDTGenepoolScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
08/30/16 8:00 PDT08/30/16 18:55 PDTJGI ServicesScheduled maintenance. Various server and web service maintenance.
08/30/16 8:00 PDT08/30/16 18:30 PDTGlobal HomesScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
08/30/16 8:00 PDT08/30/16 18:30 PDTProjectScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
08/30/16 8:00 PDT08/30/16 18:30 PDTProjectAScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
08/30/16 8:00 PDT08/30/16 23:30 PDTCoriScheduled maintenance. Cori will be unavailable for the Quarterly Maintenance.
08/30/16 7:00 PDT08/30/16 8:30 PDTNIMScheduled maintenance.
08/29/16 8:00 PDT09/09/16 11:58 PDTEdisonScheduled maintenance. Edison /scratch1 and /scratch2 unavailable for filesystem re-formatting and upgrade. All data on Edison /scratch1 and /scratch2 will be deleted.
08/24/16 9:00 PDT08/24/16 12:30 PDTHPSS UserScheduled maintenance.
08/24/16 8:00 PDT08/24/16 16:28 PDTCoriScheduled maintenance. Cori will be unavailable for a system reboot.
08/22/16 19:26 PDT08/23/16 19:26 PDTCoriUnavailable. /global/cscratch1 is currently unavailable. Engineers are investigating the issue.
08/22/16 19:26 PDT08/23/16 19:26 PDTEdisonSystem in degraded mode. /global/cscratch1 is currently unavailable. 7 of the 12 login nodes are currently unavailable. Engineers are investigating these issues.
08/22/16 15:49 PDT08/22/16 17:04 PDTNX ServicesScheduled maintenance. NX will be down for a reboot.
08/22/16 7:25 PDT08/22/16 8:59 PDTProjectASystem in degraded mode.
08/21/16 9:50 PDT08/21/16 13:48 PDTEdisonSystem in degraded mode. /scratch1 is currently unavailable, jobs requiring access to /scratch1 may hang. Engineers are currently investigating the issue.
08/17/16 9:00 PDT08/17/16 12:30 PDTHPSS BackupScheduled maintenance.
08/16/16 9:00 PDT08/17/16 14:00 PDTData Transfer NodesScheduled maintenance. DTN02 was unavailable. DTN01, DTN03, and DTN04 will remain available.
08/14/16 9:43 PDT-GenepoolGenepool jobs are being held while /projectb is in maintenance.
08/14/16 9:00 PDT08/14/16 18:10 PDTCori/projectb scheduled maintenance.
08/14/16 9:00 PDT08/14/16 18:10 PDTProjectBScheduled maintenance.
08/14/16 9:00 PDT08/14/16 18:10 PDTEdison/projectb scheduled maintenance.
08/14/16 9:00 PDT08/14/16 18:10 PDTGenepool/projectb scheduled maintenance.
08/14/16 9:00 PDT08/14/16 18:00 PDTData Transfer Nodes/projectb scheduled maintenance.
08/14/16 9:00 PDT08/14/16 18:00 PDTScience Gateway Services/projectb scheduled maintenance.
08/12/16 10:00 PDT08/15/16 10:00 PDTData Transfer NodesSystem in degraded mode. DTN01 was unavailable. DTN02, 03, 04, and 06 remain available.
08/11/16 5:00 PDT08/11/16 7:55 PDTEdisonSystem in degraded mode. Edison is degraded due to Lustre issue on /scratch2. New jobs are not starting if they require /scratch2. Cray is working on the issue.
08/10/16 8:00 PDT08/10/16 16:45 PDTCoriScheduled maintenance. Cori is be unavailable for a system reboot.
08/09/16 8:00 PDT08/09/16 13:59 PDTPDSFScheduled maintenance. Logins and the batch system were unavailable, and no jobs were running.
08/09/16 8:00 PDT08/11/16 6:00 PDTProjectAScheduled maintenance. /projecta filesystem is now available.
08/05/16 11:00 PDT08/05/16 12:07 PDTData Transfer NodesScheduled maintenance.
08/03/16 8:00 PDT08/03/16 15:02 PDTCoriScheduled maintenance. Cori is unavailable for a system reboot.
07/29/16 3:57 PDT07/29/16 4:48 PDTEdisonSystem in degraded mode. /scratch3 was degraded due to file access problems. Engineers have resolved the problems and /scratch3 has returned to service.
07/27/16 9:00 PDT07/27/16 10:30 PDTHPSS BackupScheduled maintenance.
07/27/16 8:00 PDT07/27/16 14:24 PDTCoriScheduled maintenance. Cori is unavailable for a system reboot.
07/26/16 15:32 PDT07/26/16 18:38 PDTHPSS UserUnavailable. Archive is down for an unscheduled maintenance.
07/24/16 17:57 PDT07/24/16 20:46 PDTCoriSystem in degraded mode. Jobs are running, but new jobs will not start.
07/22/16 16:00 PDT07/22/16 17:20 PDTEdisonLogins available, batch jobs not running. New jobs are not running or starting.
07/21/16 8:00 PDT07/21/16 17:35 PDTEdisonScheduled maintenance.
07/20/16 18:00 PDT07/20/16 19:00 PDTNetworkScheduled maintenance. NERSC WAN will be at a reduced bandwidth to ESnet with no interruption of service.
07/20/16 8:00 PDT07/20/16 15:15 PDTCoriScheduled maintenance.
07/19/16 14:00 PDT07/19/16 14:50 PDTmy.nersc.govScheduled maintenance.
07/15/16 18:00 PDT07/16/16 15:45 PDTProjectSystem in degraded mode. /project is degraded and there is no ETA at this time.
07/15/16 12:08 PDT-CoriThe shared partition is currently unavailable on Cori.
07/15/16 11:03 PDT07/15/16 11:30 PDTCoriSystem in degraded mode. Logins were available, however jobs could not be submitted at this time.

Show Older Outages: