NERSCPowering Scientific Discovery Since 1974

Outage Log

This table lists events reported, ongoing, and resolved on NERSC systems. It is a historical record and may not be updated while a system event is in progress.

Event Date/TimeUp Date/TimeSystemComment
06/24/16 15:00 PDT06/24/16 15:20 PDTEdisonLogins unavailable, batch jobs running.
06/24/16 15:00 PDT06/24/16 15:20 PDTData Transfer NodesLogins unavailable, batch jobs running.
06/24/16 15:00 PDT06/24/16 15:20 PDTGenepoolLogins unavailable, batch jobs running.
06/23/16 22:40 PDT06/24/16 1:30 PDTLDAPUnavailable. Logins to NERSC services are now available.
06/23/16 12:50 PDT06/23/16 13:25 PDTEdisonLogins unavailable, batch jobs running. Logins to Edison are currently hanging. Engineers are aware and actively investigating.
06/23/16 12:50 PDT06/23/16 13:25 PDTGenepoolLogins unavailable, batch jobs running. Engineers are actively investigating.
06/23/16 8:00 PDT06/23/16 20:35 PDTEdisonScheduled maintenance. The /global/cscratch1 filesystem (Cori scratch) will be unavailable to users from Edison login nodes.
06/22/16 13:00 PDT06/22/16 15:00 PDTNERSC WebsiteScheduled maintenance. Maintenance on my.nersc.gov.
06/22/16 8:00 PDT06/22/16 12:00 PDTNetworkScheduled maintenance. NERSC WAN will be at a reduced bandwidth to ESnet with no interruption of service.
06/20/16 14:15 PDT06/20/16 15:45 PDTEdisonSystem in degraded mode. /global/cscratch1 is unavailable from Edison login nodes. Engineers are working to resolve the issue.
06/17/16 8:00 PDT06/21/16 15:53 PDTData Transfer NodesScheduled maintenance. dtn04 will be unavailable.
06/15/16 9:00 PDT06/15/16 14:43 PDTNIMScheduled maintenance. NIM will be moving to new hardware and upgrading to ORACLE 12c database. This should not affect running jobs - the standby database will be up in Read only mode.
06/13/16 9:39 PDT06/13/16 11:00 PDTEdisonSystem in degraded mode. /scratch2 filesystem currently unavailable. Engineers are aware and working on the problem.
06/11/16 13:00 PDT06/11/16 14:50 PDTEdisonSystem in degraded mode. /scratch1 filesystem is intermittently available. Jobs using this filesystem may hang.
06/11/16 4:30 PDT06/11/16 17:45 PDTNERSC CenterUnavailable. NERSC Scheduled Centerwide Outage
06/11/16 4:30 PDT06/11/16 16:51 PDTNX ServicesScheduled maintenance. NERSC Scheduled Centerwide Outage
06/11/16 4:30 PDT06/11/16 16:51 PDTGenepoolUnavailable. NERSC Scheduled Centerwide Outage
06/11/16 4:30 PDT06/11/16 17:08 PDTPDSFUnavailable. NERSC Scheduled Centerwide Outage
06/11/16 4:30 PDT06/11/16 17:08 PDTMongoDBScheduled maintenance. NERSC Scheduled Centerwide Outage.
06/11/16 4:30 PDT06/11/16 17:45 PDTScience Gateway ServicesScheduled maintenance. Centerwide Outage
06/11/16 4:30 PDT06/27/16 8:00 PDTCoriUnavailable. Scheduled Power Outage
06/09/16 22:11 PDT06/10/16 0:05 PDTCoriSystem in degraded mode. /cscratch1 degraded due to hardware problems. New job scheduling has been paused.
06/09/16 11:00 PDT06/09/16 12:00 PDTdmv1, dmv2.nersc.gov (License server)Scheduled maintenance. Software license maintenance
06/08/16 11:00 PDT06/08/16 11:50 PDTdmv.nersc.gov (License server)Scheduled maintenance. Software license maintenance
06/08/16 9:00 PDT06/08/16 14:50 PDTHPSS UserScheduled maintenance.
06/07/16 8:00 PDT06/07/16 17:00 PDTEdisonScheduled maintenance. Scheduled file system upgrade for /scratch3. Login nodes, /scratch1, and /scratch2 filesystems will be available during the maintenance, and batch jobs will continue to run.
06/07/16 7:30 PDT06/07/16 8:30 PDTNIMScheduled maintenance. The NIM interface may be intermittently unavailable during this system upgrade.
05/30/16 13:06 PDT05/31/16 13:46 PDTEdisonSystem in degraded mode. Engineers were working on hardware issues involving a limited number of compute nodes.
05/28/16 20:00 PDT05/29/16 7:30 PDTEdisonLogins available, batch jobs not running. Engineers are currently working on a /scratch1 issue.
05/24/16 15:00 PDT05/25/16 13:00 PDTScience Database ServicesSystem in degraded mode. Upgrade complete, but service may be degraded while post-upgrade cleanup tasks run overnight.
05/24/16 9:30 PDT05/24/16 13:26 PDTHPSS UserScheduled maintenance. Center Wide Outage due to Quarterly Maintenance. HPSS will be unavailable.
05/24/16 9:30 PDT05/24/16 12:35 PDTHPSS BackupScheduled maintenance. Center Wide Outage due to Quarterly Maintenance. HPSS will be unavailable.
05/24/16 9:30 PDT05/24/16 16:00 PDTScience Database ServicesScheduled maintenance. MySQL databases unavailable during this period for version update and other database services unavailable for short periods due to reboots.
05/24/16 7:00 PDT05/24/16 14:00 PDTGlobal CommonScheduled maintenance. Center Wide Outage due to Quarterly Maintenance. Filesystems will be available at 14:00 but unavailable on systems until they return to service. Please check the systems uptime for filesystem availability.
05/24/16 7:00 PDT05/24/16 14:00 PDTGlobal HomesScheduled maintenance. Center Wide Outage due to Quarterly Maintenance. Filesystems will be available at 14:00 but unavailable on systems until they return to service. Please check the systems uptime for filesystem availability.
05/24/16 7:00 PDT05/24/16 14:00 PDTProjectScheduled maintenance. Center Wide Outage due to Quarterly Maintenance. Filesystems will be available at 14:00 but unavailable on systems until they return to service. Please check the systems uptime for filesystem availability.
05/24/16 7:00 PDT05/24/16 14:00 PDTProjectAScheduled maintenance. Center Wide Outage due to Quarterly Maintenance. Filesystems will be available at 14:00 but unavailable on systems until they return to service. Please check the systems uptime for filesystem availability.
05/24/16 7:00 PDT05/24/16 14:00 PDTProjectBScheduled maintenance. Center Wide Outage due to Quarterly Maintenance. Filesystems will be available at 14:00 but unavailable on systems until they return to service. Please check the systems uptime for filesystem availability.
05/24/16 7:00 PDT05/24/16 14:00 PDTDNAScheduled maintenance. Center Wide Outage due to Quarterly Maintenance. Filesystems will be available at 14:00 but unavailable on systems until they return to service. Please check the systems uptime for filesystem availability.
05/24/16 7:00 PDT05/24/16 14:00 PDTSeqFSScheduled maintenance. Center Wide Outage due to Quarterly Maintenance. Filesystems will be available at 14:00 but unavailable on systems until they return to service. Please check the systems uptime for filesystem availability.
05/24/16 7:00 PDT05/24/16 20:00 PDTNERSC CenterScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
05/24/16 7:00 PDT05/24/16 16:00 PDTScience Gateway ServicesScheduled maintenance. Center Wide Outage due to Quarterly Maintenance. Web Portals, JupyterHub and MQ Services will be down for upgrades during filesystem outage.
05/24/16 7:00 PDT05/24/16 16:40 PDTNX ServicesScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
05/24/16 6:00 PDT05/25/16 21:52 PDTCoriScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
05/24/16 6:00 PDT05/24/16 20:15 PDTEdisonScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
05/24/16 6:00 PDT05/24/16 14:29 PDTGenepoolScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
05/24/16 6:00 PDT05/24/16 17:00 PDTPDSFScheduled maintenance. Center Wide Outage due to Quarterly Maintenance.
05/20/16 2:40 PDT05/20/16 3:38 PDTEdisonSystem in degraded mode. /scratch1 is currently unavailable. Engineers are working to resolve the outage.
05/16/16 10:01 PDT-EdisonNIM will be updating MPP usage (Edison & Cori) Monday 6:00am - 2:00pm, 05/23/2015. The MPP usage will be inconsistent when viewed through the NIM interface
05/16/16 10:00 PDT-CoriNIM will be updating MPP usage (Edison & Cori) Monday 6:00am - 2:00pm, 05/23/2015. The MPP usage will be inconsistent when viewed through the NIM interface
05/13/16 19:11 PDT05/13/16 19:21 PDTCoriSystem in degraded mode. /cscratch1 degraded due to Hardware problem.
05/12/16 12:45 PDT05/12/16 13:50 PDTDNAUnavailable. /global/dna is unavailable. Engineers are currently working on it.
05/11/16 11:58 PDT05/11/16 12:26 PDTDNAUnavailable. The /global/dna filesystem was unavailable.
05/11/16 9:00 PDT05/11/16 12:45 PDTHPSS BackupScheduled maintenance.
05/07/16 15:30 PDT05/07/16 17:27 PDTCoriSystem in degraded mode.
05/04/16 7:00 PDT05/04/16 17:46 PDTCoriScheduled maintenance. Login nodes will be unavailable. Maintenance will include DataWarp updates.
04/29/16 9:55 PDT04/29/16 10:40 PDTCoriSystem in degraded mode. Engineers are investigating an issue with the Cori scratch filesystem. Logins are available but may hang, jobs may be submitted, however new jobs will not run.
04/28/16 6:00 PDT04/28/16 14:00 PDTCoriDedicated runs. During system dedicated time, users can submit jobs but no user jobs will run.
04/27/16 8:00 PDT04/27/16 17:35 PDTEdisonScheduled maintenance. Login nodes will be unavailable.
04/25/16 14:53 PDT04/25/16 17:00 PDTCoriSystem in degraded mode. There is a software issue on Cori. Queues have been paused. Engineers were investigating.
04/25/16 10:05 PDT04/27/16 8:00 PDTEdisonSystem in degraded mode. There are hardware issues on Edison. Job scheduling is currently running and new jobs can start. Engineers are investigating.
04/24/16 8:40 PDT04/24/16 13:15 PDTESnet (WAN network)System in degraded mode. There were intermittent network issues connecting to NERSC from the Chicago area. ESnet engineers have re-routed traffic while they work to resolve this issue fully.

Show Older Outages: