NERSCPowering Scientific Discovery Since 1974

Outage Log

This table lists events reported, ongoing, and resolved on NERSC systems. It is a historical record and may not be updated while a system event is in progress.

Event Date/TimeUp Date/TimeSystemComment
04/11/18 9:00 PDT04/11/18 15:30 PDTHPSS UserScheduled maintenance.
04/11/18 7:00 PDT04/11/18 15:03 PDTEdisonScheduled maintenance. Update: please note updated end time. Edison will be unavailable due to software upgrades.
04/01/18 10:06 PDT-EdisonJobs using the /global/project filesystem may be submitted, but will not start at this time due to a hardware issue.
04/01/18 10:06 PDT-CoriJobs using the /global/project filesystem may be submitted, but will not start at this time due to a hardware issue.
04/01/18 8:59 PDT04/01/18 10:30 PDTProjectSystem in degraded mode. /project has a hardware issue and is in degraded mode. NERSC engineers are working to resolve the matter. Another update will be at Noon.
03/28/18 10:50 PDT03/28/18 16:12 PDTNIMScheduled maintenance. NIM will be unavailable due to db upgrades.
03/27/18 10:00 PDT03/27/18 13:00 PDTScience GatewaysScheduled maintenance. NEWT will be unavailable for 2-3 hours while being migrated to new hardware.
03/22/18 7:00 PDT03/22/18 14:00 PDTCoriScheduled maintenance. Cori will be unavailable while NERSC engineers perform system software maintenance.
03/21/18 15:11 PDT03/21/18 18:08 PDTGenepoolSystem in degraded mode. Denovo queues have been paused, due to ongoing problems with filesystem stability. NERSC system administrators continue to investigate.
03/21/18 9:00 PDT03/21/18 13:09 PDTHPSS UserScheduled maintenance. HPSS systems will be unavailable while NERSC engineers perform a scheduled maintenance.
03/21/18 9:00 PDT03/21/18 13:09 PDTHPSS BackupScheduled maintenance. HPSS systems will be unavailable while NERSC engineers perform a scheduled maintenance.
03/21/18 7:00 PDT03/21/18 12:10 PDTEdisonScheduled maintenance. Planned maintenance event for Edison system upgrade. Edison will be unavailable during this window of time.
03/17/18 2:30 PDT03/17/18 9:42 PDTCoriSystem in degraded mode. Cori is currently in a degraded mode, with issues pertaining to the cscratch1 file system. Engineers are working to resolve the matter. Updates will be added as work progresses.
03/15/18 11:00 PDT03/15/18 12:00 PDTmysql service on nerscdb04Scheduled maintenance. Mysql services on scidb (aka nerscdb04) may be unavailable, they will be restarted for a reconfiguration.
03/12/18 12:00 PDT03/12/18 18:53 PDTNIMSystem in degraded mode. Some NIM functions are currently unavailable. Our Engineers are working to address the problem.
03/12/18 10:00 PDT03/12/18 10:25 PDTNIMUnavailable. NIM will be unavailable during maintenance.
03/09/18 10:00 PST03/09/18 11:32 PSTGenepoolSystem in degraded mode. Ongoing filesystem issues. Engineers are investigating.
03/09/18 8:52 PST-GenepoolDenovo: Possible filesystem issues occurred from 0600-0730. Engineers are investigating. Report any ongoing issues to consult@nersc.gov.
03/07/18 11:00 PST03/07/18 12:00 PSTServiceNowScheduled maintenance. We anticipate a possible outage for NERSC ServiceNow instance.
03/05/18 13:03 PST03/05/18 14:15 PSTCoriSystem in degraded mode. Jobs continue to run, no new jobs will start.
03/05/18 11:07 PST03/05/18 11:15 PSTNX ServicesScheduled maintenance. NX maintenance: sessions may be interrupted
03/02/18 3:00 PST03/02/18 5:00 PSTIDL licenseScheduled maintenance. IDL license will be updated Friday, March 2nd. 3-5pm and may be unavailable at times.
02/24/18 14:07 PST02/24/18 14:43 PSTCoriSystem in degraded mode. Logins are available. Job submissions are available. Queues are paused while engineers investigate the scheduler.
02/21/18 9:00 PST02/21/18 9:58 PSTNERSC WebsiteScheduled maintenance. The site will be unavailable while database software is upgraded.
02/21/18 9:00 PST02/21/18 13:49 PSTHPSS UserScheduled maintenance.
02/14/18 9:00 PST02/14/18 13:50 PSTHPSS BackupScheduled maintenance. Scheduled maintenance of the HPSS Backup system. The system will be unavailable during this window of time.
02/14/18 9:00 PST02/14/18 14:00 PSTHPSS UserScheduled maintenance. Scheduled maintenance of the HPSS Backup system. The system will be unavailable during this window of time.
02/13/18 12:43 PST02/13/18 14:22 PSTHPSS UserUnavailable. The HPSS User system is temporarily unavailable. Engineers are troubleshooting the issue.
02/11/18 18:45 PST02/11/18 19:45 PSTCoriSystem in degraded mode. Cori is in degraded mode due to DataWarp issues. Engineers are investigating the issue
02/09/18 13:15 PST02/09/18 14:22 PSTEdisonLogins unavailable, batch jobs running. Engineers are working to address a filesystem issue. Logins may be unavailable till issue is resolved. Jobs requiring the /scratch2 filesystem will not start.
02/06/18 20:45 PST02/07/18 18:32 PSTEdisonScheduled maintenance. Edison is currently degraded due to /cscratch1 filesystem being unavailable for NERSC quarterly maintenance. Logins and job submission are available. Jobs requesting /cscratch1 will not run.
02/06/18 19:10 PST02/06/18 20:07 PSTData Transfer NodesScheduled maintenance. NERSC quarterly maintenance.
02/06/18 13:31 PST02/06/18 14:15 PSTNX ServicesScheduled maintenance. NERSC quarterly maintenance.
02/06/18 9:10 PST02/06/18 9:50 PSTCS and NERSC web sites, MyProxy, NIMScheduled maintenance. NERSC quarterly maintenance. Services will be down briefly (5-15 minutes) within the maintenance window.
02/06/18 8:42 PST02/06/18 17:25 PSTHPSS UserScheduled maintenance. NERSC quarterly maintenance.
02/06/18 8:17 PST02/06/18 15:00 PSTProjectScheduled maintenance. NERSC quarterly maintenance.
02/06/18 8:17 PST02/06/18 15:00 PSTProjectAScheduled maintenance. NERSC quarterly maintenance.
02/06/18 8:17 PST02/06/18 15:00 PSTProjectBScheduled maintenance. NERSC quarterly maintenance.
02/06/18 8:17 PST02/06/18 15:00 PSTGlobal CommonScheduled maintenance. NERSC quarterly maintenance.
02/06/18 8:17 PST02/06/18 15:00 PSTGlobal HomesScheduled maintenance. NERSC quarterly maintenance.
02/06/18 8:17 PST02/06/18 15:00 PSTDNAScheduled maintenance. NERSC quarterly maintenance.
02/06/18 7:39 PST02/06/18 11:29 PSTHPSS BackupScheduled maintenance. NERSC quarterly maintenance.
02/06/18 7:36 PST02/06/18 17:52 PSTScience Gateways/SpinScheduled maintenance. NERSC quarterly maintenance. As of 3:35pm, all services have been restored with the exception of Science Gateways dependent on global filesystems.
02/06/18 7:27 PST02/06/18 18:28 PSTGenepoolScheduled maintenance. NERSC quarterly maintenance.
02/06/18 7:27 PST02/06/18 17:27 PSTPDSFScheduled maintenance. NERSC quarterly maintenance.
02/06/18 7:04 PST02/06/18 15:30 PSTJGI Web and Database ServicesScheduled maintenance. NERSC quarterly maintenance. JGI Web services dependent on global filesystems remain unavailable; all other JGI Web and JGI database services were restored at approximately 10:40am.
02/06/18 7:02 PST02/06/18 20:45 PSTEdisonScheduled maintenance. NERSC quarterly maintenance.
02/06/18 7:01 PST02/07/18 21:22 PSTCoriScheduled maintenance. NERSC quarterly maintenance.
02/06/18 6:00 PST02/06/18 15:00 PSTData Transfer NodesScheduled maintenance. NERSC quarterly maintenance.
02/06/18 6:00 PST02/06/18 15:00 PSTSeqFSScheduled maintenance. NERSC quarterly maintenance.
02/06/18 6:00 PST02/06/18 15:00 PSTmongoDBScheduled maintenance. NERSC quarterly maintenance.
02/05/18 23:49 PST02/06/18 6:00 PSTEdisonUnavailable. Partitions are down, logins are unavailable however batch jobs are running.
02/05/18 20:00 PST02/06/18 6:00 PSTEdisonSystem in degraded mode. Edison /scratch3 filesystem is unavailable to batch jobs. We expect to return /scratch3 to service at the end of the quarterly maintenance on 2/6.
02/05/18 8:45 PST02/05/18 20:00 PSTEdisonScheduled maintenance. Scheduled file system maintenance for /scratch3. Login nodes, /scratch1, and /scratch2 file system will be available during the maintenance, and batch jobs will continue to run.
02/02/18 14:33 PST02/02/18 15:50 PSTHPSS BackupUnavailable. HPSS Regent is currently unavailable due to a suspected power glitch. Engineers are working to resolve the issue.
02/01/18 14:00 PST02/01/18 15:35 PSTNIMUnavailable.
01/31/18 9:00 PST01/31/18 12:00 PSTHPSS BackupScheduled maintenance. The HPSS systems will not be available due to network maintenance.
01/31/18 9:00 PST01/31/18 12:00 PSTHPSS UserScheduled maintenance. The HPSS systems will not be available due to network maintenance.
01/30/18 17:51 PST01/30/18 21:11 PSTHPSS UserUnavailable. System is temporarily unavailable. Engineer are working on troubleshooting.
01/29/18 20:59 PST01/29/18 21:40 PSTCoriSystem in degraded mode. Cori was in degraded mode while the batch scheduler was paused.
01/29/18 20:35 PST01/29/18 23:10 PSTEdisonSystem in degraded mode. Edison is currently degraded due to filesystem issues with scratch2. Logins and job submission are available, however no new jobs are starting during this issue.
01/29/18 16:00 PST01/29/18 18:49 PSTCoriSystem in degraded mode. The "cscratch1" filesystem is currently unavailable. No new jobs are starting at this time. Engineers are aware and actively working to resolve this issue.
01/29/18 16:00 PST01/29/18 18:49 PSTEdisonSystem in degraded mode. The "cscratch1" filesystem is currently unavailable. No new jobs are starting at this time. Engineers are aware and actively working to resolve this issue.

Show Older Outages: