NERSCPowering Scientific Discovery Since 1974

Outage Log

This table lists events reported, ongoing, and resolved on NERSC systems. It is a historical record and may not be updated while a system event is in progress.

Event Date/TimeUp Date/TimeSystemComment
04/03/13 7:00 PDT04/03/13 19:20 PDTEdisonScheduled maintenance.
04/03/13 9:00 PDT04/03/13 10:46 PDTHPSS UserScheduled maintenance.
04/02/13 22:30 PDT04/03/13 0:45 PDTData Transfer Nodes 3 & 4Unavailable. DTN03 and DTN04 were down. Problem resolved.
04/02/13 9:25 PDT-HopperBatch Queues stopped from 08:30 - 10:07.
03/27/13 14:30 PDT03/28/13 0:36 PDTEdisonScheduled maintenance. Dedicated test time. Done
03/27/13 13:05 PDT03/27/13 15:34 PDTGenepoolScheduled maintenance. Management server maintenance. User jobs and logins should not be affected.
03/26/13 11:00 PDT03/26/13 11:10 PDTScience Gateway DatabaseScheduled maintenance. The science gateway database will be rebooted. Downtime is expected to be approximately 10 minutes.
03/25/13 6:00 PDT03/25/13 21:04 PDTEdisonScheduled maintenance.
03/25/13 14:30 PDT03/25/13 15:00 PDTHPSS UserScheduled maintenance. *Emergency System Restart *
03/25/13 11:23 PDT03/25/13 12:28 PDTHopperLogins available, batch jobs not running. /scratch is in a degraded state.
03/25/13 9:10 PDT03/25/13 11:23 PDTHopperLogins available, batch jobs not running. /global/project is unavailable at this time. NERSC system engineers are currently working on resolving this issue.
03/25/13 10:30 PDT03/25/13 11:23 PDTHopperLogins available, batch jobs not running. /global/scratch is unavailable at this time. NERSC system engineers are currently working on resolving this issue.
03/25/13 9:10 PDT03/25/13 10:31 PDTGenepool/project unavailable.
03/25/13 9:10 PDT03/25/13 10:31 PDTCarver/project unavailable.
03/25/13 9:10 PDT03/25/13 10:31 PDTDirac/project unavailable.
03/25/13 9:10 PDT03/25/13 10:31 PDTPDSF/project unavailable.
03/25/13 9:10 PDT03/25/13 10:10 PDTProject/project unavailable.
03/23/13 10:36 PDT03/23/13 11:04 PDTHPSS UserUnavailable.
03/19/13 16:21 PDT-CarverIntermittent batch server problems affected Carver/Dirac. Logins were available. Jobs were running. Batch queue outages: (03/19/13 2:16-2:25), (03/19/13 3:30-3:53), (03/19/13 6:15-6:40), (03/19/13 8:13-8:20), (03/19/13 14:55-15:30)
03/19/13 7:00 PDT03/22/13 15:48 PDTHPSS UserScheduled maintenance. HPSS Upgrade.
03/21/13 15:09 PDT03/21/13 15:14 PDTNERSC WebsiteUnavailable. The NERSC public website (www.nersc.gov) was unavailable due to a server configuration issue.
03/20/13 5:00 PDT03/21/13 3:56 PDTEdisonScheduled maintenance.
03/19/13 14:55 PDT03/19/13 15:30 PDTCarverSystem in degraded mode. Intermittent batch server problems affected Carver/Dirac. Logins were available. Jobs were running.
03/19/13 14:55 PDT03/19/13 15:30 PDTDiracSystem in degraded mode. Intermittent batch server problems affected Carver/Dirac. Logins were available. Jobs were running.
03/18/13 13:00 PDT03/18/13 18:00 PDTCarverScheduled maintenance. Carver/Dirac - Today 13:00-18:00 Degraded mode - Job Scheduler paused for important software update. Logins unaffected, jobs continue to run, new jobs delayed.
03/18/13 13:00 PDT03/18/13 18:00 PDTDiracScheduled maintenance. Carver/Dirac - Today 13:00-18:00 Degraded mode - Job Scheduler paused for important software update. Logins unaffected, jobs continue to run, new jobs delayed.
03/14/13 11:50 PDT03/14/13 13:10 PDTNERSC WebsiteUnavailable. Access to www.nersc.gov and www.es.net were down due to hardware failure.
03/13/13 9:00 PDT03/13/13 13:48 PDTHPSS UserScheduled maintenance.
03/13/13 11:23 PDT03/13/13 13:00 PDTEdisonUnavailable. Problem Resolved.
03/12/13 17:33 PDT03/12/13 20:45 PDTGenepoolUnavailable. Problem resolved.
03/08/13 17:50 PST03/11/13 10:11 PDTNIMUnavailable. NIM Services were unavailable due to a problem with the database.
03/10/13 6:45 PDT03/10/13 10:45 PDTCarverSystem in degraded mode.
03/10/13 6:45 PDT03/10/13 10:45 PDTDiracSystem in degraded mode.
03/08/13 10:41 PST03/08/13 11:20 PSTHopperSystem in degraded mode. Batch scheduler was hanging. Problem has been resolved.
03/07/13 14:38 PST03/07/13 16:10 PSTCarverSystem in degraded mode. Queues are stopped. Jobs continue to run, however some system executables are unavailable (/usr/common/bin & Modules). UPDATE: 16:20 PST estimated uptime.
03/07/13 14:38 PST03/07/13 16:10 PSTDiracSystem in degraded mode. Queues are stopped. Jobs continue to run, however some system executables are unavailable (/usr/common/bin & Modules). UPDATE: 16:20 PST estimated uptime.
03/06/13 18:00 PST03/06/13 20:30 PSTTelephone OutageScheduled maintenance. Direct lines to NERSC (510-x) will be affected. The 800 numbers will not be affected.
03/06/13 9:00 PST03/06/13 13:00 PSTEdisonScheduled maintenance. Edison will be unavailable due to system dedicated testing. Note: Extended maintenance to 13:00.
03/06/13 9:00 PST03/06/13 12:55 PSTHPSS UserScheduled maintenance.
03/06/13 8:00 PST03/06/13 12:00 PSTPDSFScheduled maintenance. Rolling upgrade of interactive nodes to new hardware. One host upgraded at a time.
03/06/13 9:40 PST03/06/13 10:05 PSTHopperSystem in degraded mode. Batch queues stopped. No new batch jobs are starting.
03/05/13 13:07 PST03/05/13 14:25 PSTHopperSystem in degraded mode. Batch queues stopped, no new batch jobs are starting at this time.
03/04/13 22:31 PST-PDSFPossible network issues on some compute nodes are causing filesystem issues since 20:00PST. We are investigating the issues. Estimated of repair 23:59PST.
03/04/13 22:29 PST-GenepoolPossible network issues on some compute nodes are causing filesystem issues since 20:00PST. We are investigating the issues. Estimated of repair 23:59PST.
02/27/13 7:00 PST02/27/13 20:30 PSTHopperScheduled maintenance.
02/27/13 9:00 PST02/27/13 12:36 PSTHPSS UserScheduled maintenance.
02/22/13 7:00 PST02/22/13 7:27 PSTCarverSystem in degraded mode. System in degraded mode. Batch system unavailable. Logins still available. Jobs are still running.
02/22/13 7:00 PST02/22/13 7:27 PSTDiracSystem in degraded mode. System in degraded mode. Batch system unavailable. Logins still available. Jobs are still running.
02/20/13 6:00 PST02/20/13 21:00 PSTEdisonScheduled maintenance.
02/20/13 12:48 PST02/20/13 14:03 PSTPDSFSystem in degraded mode. Interactive node pdsf1 was down briefly; users may have experienced delays in getting to PDSF
02/20/13 8:45 PST02/20/13 12:45 PSTHPSS UserScheduled maintenance.
02/14/13 14:15 PST-EdisonEdison Maintenance. The estimated uptime is 13:00 PST 2/15/13.
02/13/13 9:29 PST-EdisonEdison internal test is extended. The estimated up time is 3:00pm PST 2/14/13. Edison is reserved for the internal tests. It will be available to early users at 2:00pm PST on 2/14/2013.
02/12/13 22:57 PST-DiracBatch is currently unavailable.
02/12/13 22:29 PST-CarverBatch is currently unavailable.
02/12/13 19:30 PST-PDSF/project is currently unavailable.
02/11/13 0:01 PST02/18/13 14:00 PSTGenepoolScheduled maintenance. Genepool phase 2 nodes were unavailable. Maintenance has been completed.
02/12/13 18:00 PST02/15/13 14:45 PSTEdisonUnavailable. Edison was unavailable.
02/13/13 0:05 PST02/13/13 11:45 PSTDiracSystem in degraded mode. Queues have been stopped until 13:00 to investigate a batch problem.
02/13/13 2:00 PST02/13/13 5:33 PSTGenepoolUnavailable. System was unavailable.
02/12/13 7:00 PST02/13/13 0:07 PSTGenepoolScheduled maintenance. The entire Genepool cluster will be unavailable for quarterly maintenance. Batch queues will be turned off one hour prior to the maintenance window. All web services that depend on/house and /projectb will be unavailable during this time.
02/12/13 7:00 PST02/12/13 22:45 PSTHopperScheduled maintenance. NERSC Center Wide Outage
02/12/13 7:00 PST02/12/13 22:18 PSTCarverScheduled maintenance. NERSC Center Wide Outage
02/12/13 7:00 PST02/12/13 22:18 PSTDiracScheduled maintenance. NERSC Center Wide Outage
02/12/13 7:00 PST02/12/13 21:56 PSTNGFScheduled maintenance. NERSC Center Wide Outage
02/12/13 19:36 PST02/12/13 21:56 PSTNERSC Resources/project unavailable. /project was unavailable after planned maintenance.
02/12/13 7:00 PST02/12/13 20:15 PSTJesupScheduled maintenance. NERSC Center Wide Outage
02/12/13 7:00 PST02/12/13 19:36 PSTNERSC ResourcesScheduled maintenance. *Note extended time* There will be a NERSC Centerwide Outage Tuesday, Feb. 12, 2013. Internal network maintenance will affect all computational and storage systems between 07:00 2/12/13 - 19:36 PST 2/13/13. There will also be intermittent outages to the NERSC webservers 13:00 - 19:36 PST 2/13/13.
02/12/13 7:00 PST02/12/13 18:00 PSTPDSFScheduled maintenance. NERSC Center Wide Outage

Show Older Outages: