NERSCPowering Scientific Discovery Since 1974

Outage Log

This table lists events reported, ongoing, and resolved on NERSC systems. It is a historical record and may not be updated while a system event is in progress.

Event Date/TimeUp Date/TimeSystemComment
04/21/14 13:20 PDT-PDSFApril 23 11:00 - 12:00 PDT: Rolling reboot of login nodes for software upgrade.
04/20/14 21:27 PDTNot AvailableHPSS UserUnavailable.
04/23/14 9:00 PDT04/23/14 13:20 PDTHPSS BackupScheduled maintenance.
04/21/14 14:00 PDT04/21/14 16:00 PDTLDAPScheduled maintenance. Updates made through https://nim.nersc.gov may be delayed.
04/21/14 11:00 PDT04/21/14 12:07 PDTnerscca2Scheduled maintenance. NERSC Certificate Services nerscca2.nersc.gov was down for system upgrades. Globus Online / NEWT and Grid Services may be unavailable during this period.
04/16/14 14:50 PDT04/16/14 15:20 PDTCarverSystem in degraded mode. Intermittent login problems to Carver. Engineers are actively investigating.
04/16/14 9:00 PDT04/16/14 11:16 PDTHPSS UserScheduled maintenance.
04/15/14 14:00 PDT04/15/14 16:00 PDTMongoDBScheduled maintenance. MongoDB service will be unavailable intermittently from 2-4pm today for security patches and service upgrade.
04/14/14 14:00 PDT04/14/14 15:00 PDTnerscca1Scheduled maintenance. NERSC Certificate Services nerscca1.nersc.gov will be be down for system upgrades. Globus Online / NEWT and Grid Services may be unavailable during this period.
04/14/14 9:00 PDT04/14/14 11:19 PDTEdisonScheduled maintenance.
04/09/14 13:35 PDT04/09/14 15:40 PDTgenepool12Unavailable. Node genepool12 was unavailable. Some processes terminated prior to recovery.
04/09/14 9:00 PDT04/09/14 10:45 PDTHPSS UserScheduled maintenance.
04/09/14 10:00 PDT04/09/14 10:20 PDTNIMScheduled maintenance.
04/08/14 14:00 PDT04/08/14 17:00 PDTmailmanUnavailable. Mailman server (mailman.nersc.gov) will be down for maintenance.
04/07/14 6:42 PDT04/07/14 8:35 PDTGlobal HomesSystem in degraded mode. Global Homes (/global/homes) filesystem was experiencing problems resulting to intermittent logins to Hopper, Edison, Carver, and Genepool. Problem has been resolved.
04/03/14 8:00 PDT04/03/14 14:10 PDTHopperScheduled maintenance.
03/26/14 7:30 PDT03/26/14 16:00 PDTEdisonScheduled maintenance.
03/25/14 8:00 PDT03/25/14 18:20 PDTCarverScheduled maintenance.
03/22/14 21:51 PDT-ProjectFrom 20:18 PDT, 03/22/2014, until 00:30 PDT, 03/23/2014, /project was unavailable due to an NGF problem. The problem has been fixed.
03/22/14 20:18 PDT03/23/14 0:30 PDTProject/project unavailable.
03/22/14 3:15 PDT03/22/14 10:30 PDTLDAPSystem in degraded mode. LDAP was having intermittent authentication login issues to NERSC resources since 03:15PT, 03/22. Engineers have resolved the issues.
03/19/14 12:20 PDT03/19/14 12:50 PDTLicense ServerScheduled maintenance. DDT, IDL, MAP, MATLAB, Mathematica and TotalView will be unavailable.
03/19/14 9:00 PDT03/19/14 11:26 PDTHPSS BackupScheduled maintenance.
03/14/14 9:30 PDT03/14/14 10:45 PDTProjectSystem in degraded mode.
03/12/14 2:35 PDT03/12/14 19:40 PDTHopperUnavailable.
03/12/14 9:00 PDT03/12/14 12:05 PDTHPSS UserScheduled maintenance.
03/12/14 10:00 PDT03/12/14 10:50 PDTNIMScheduled maintenance.
03/11/14 7:00 PDT03/11/14 19:26 PDTEdisonScheduled maintenance.
03/10/14 10:50 PDT03/10/14 11:40 PDTEdisonSystem in degraded mode. The /scratch1 filesystem was experiencing problems. The problem has been resolved.
03/08/14 17:44 PST03/09/14 14:45 PDTEdisonSystem in degraded mode. The Edison system was degraded: (17:44 Mar 8 - 12:00 Mar 9) - The /scratch1 filesystem was experiencing problems. Jobs using /scratch1/ may have failed. (07:30 Mar 9 - 13:00 Mar 9) Batch commands were intermittently unavailable. (03:00 Mar 9 - 14:45 Mar 9) - Filesystem performance was degraded.
03/05/14 9:00 PST03/05/14 10:44 PSTHPSS BackupScheduled maintenance.
02/26/14 9:00 PST02/26/14 11:28 PSTHPSS BackupScheduled maintenance.
02/21/14 10:00 PST02/21/14 12:00 PSTCarverSystem in degraded mode. It is suggested that users check status of their jobs.
02/21/14 9:55 PST02/21/14 10:20 PSTNetworkUnavailable. There were intermittent login problems to Carver/Dirac, Edison, Hopper, PDSF and Genepool due to a load balancer issue. The problem has been resolved.
02/18/14 7:00 PST02/19/14 18:54 PSTEdisonScheduled maintenance.
02/11/14 8:00 PST02/11/14 23:59 PSTGenepoolScheduled maintenance.
02/11/14 8:00 PST02/11/14 22:30 PSTDiracScheduled maintenance.
02/11/14 8:00 PST02/11/14 21:25 PSTEdisonScheduled maintenance.
02/11/14 8:00 PST02/11/14 21:20 PSTPDSFScheduled maintenance.
02/11/14 8:00 PST02/11/14 19:50 PSTCarverScheduled maintenance.
02/11/14 8:00 PST02/11/14 19:42 PSTHopperScheduled maintenance.
02/11/14 8:00 PST02/11/14 18:55 PSTScience Gateway ServicesScheduled maintenance.
02/11/14 8:00 PST02/11/14 18:00 PSTGlobal HomesScheduled maintenance.
02/11/14 8:00 PST02/11/14 18:00 PSTGlobal ScratchScheduled maintenance.
02/11/14 8:00 PST02/11/14 18:00 PSTProjectScheduled maintenance.
02/11/14 8:00 PST02/11/14 18:00 PSTProjectBScheduled maintenance.
02/11/14 8:00 PST02/11/14 17:28 PSTHPSS BackupScheduled maintenance.
02/11/14 8:00 PST02/11/14 17:28 PSTHPSS UserScheduled maintenance.
02/11/14 8:00 PST02/11/14 17:10 PSTData Transfer NodesScheduled maintenance.
02/11/14 9:00 PST02/11/14 12:30 PSTNetworkScheduled maintenance. Network connectivity to NERSC resources will experience 3 brief interruptions within the scheduled maintenance window.
02/11/14 10:00 PST02/11/14 10:40 PSTNIMScheduled maintenance. NIM services will be unavailable during the maintenance window.
02/06/14 16:28 PST-EdisonThere are batch system issues on Edison now. System engineers are investigating.
02/06/14 14:57 PST-EdisonBatch system is experiencing some problems. System Engineers are investigating.
01/24/14 12:45 PST01/29/14 18:00 PSTiperfUnavailable. iperf.nersc.gov was down due to hardware failure. Iperf services were unavailable.
01/23/14 14:33 PST-Edison/scratch3 unaccessible from 1:30pm today. System people investigating.
01/23/14 8:00 PST01/23/14 12:24 PSTEdisonScheduled maintenance.
01/15/14 7:00 PST01/15/14 16:50 PSTHopperScheduled maintenance. Scheduled maintenance for filesystem repair. Hopper and logins will not be available for users.
01/14/14 14:00 PST01/14/14 14:15 PSTCarverSystem in degraded mode. MOAB will be restarted at 14:00. Should return to normal by 14:20.
01/13/14 7:00 PST01/13/14 16:20 PSTEdisonScheduled maintenance.
01/09/14 8:00 PST01/10/14 0:30 PSTEdisonScheduled maintenance. Logins were unavailable.
01/07/14 8:00 PST01/07/14 19:13 PSTEdisonScheduled maintenance. Logins will not be available.
01/07/14 14:15 PST01/07/14 14:35 PSTHopperLogins unavailable, batch jobs running. Hardware problems resulted in problems logging into Hopper and with access to /scratch.
01/04/14 2:10 PST-Hopper/scratch2 was unavailable and the batch system was taken offline. This event has been completed and the system has been returned to full production.
01/03/14 11:48 PST01/04/14 1:50 PSTHopperUnavailable. (01/03/14 11:48 PST) - Scratch2 has been unavailable and batch queues are stopped. Engineers are working to resolve this problem. No Estimated Uptime and update will be provided at 2AM.
01/02/14 22:00 PST01/03/14 17:55 PSTEdisonScheduled maintenance. Logins unavailable.
01/02/14 8:00 PST01/02/14 22:00 PSTEdisonScheduled maintenance. Logins are available.

Show Older Outages: