NERSCPowering Scientific Discovery Since 1974

Outage Log

This table lists events reported, ongoing, and resolved on NERSC systems. It is a historical record and may not be updated while a system event is in progress.

Last updated: Wed May 23 16:57:49 2012

Down Date/TimeUp Date/TimeSystemComment
05/23/12-14:37 05/23/12-15:25 EUCLID Unscheduled maintenance.
05/23/12-15:12 05/23/12-15:15 SERVER DTN02 unscheduled maintenance.
05/23/12-13:54 05/23/12-14:16 EUCLID Euclid Unscheduled maintenance
05/23/12-09:45 05/23/12-12:38 ARCHIVE Archive maintenance
05/23/12- 05/23/12-09:48 EUCLID Euclid unscheduled maintenance
05/23/12-09:01 05/23/12-09:48 DTN02 DTN02 unscheduled maintenance
05/23/12-09:00 05/23/12-12:05 REGENT Regent maintenance
05/22/12-16:40 05/22/12-17:13 DTN02 DTN02 unscheduled maintenance.
05/21/12-18:54 05/22/12-12:04 EUCLID Euclid unscheduled maintenance.
05/21/12-18:06 05/21/12-18:29 DTN01 DTN01 unscheduled maintenance.
05/21/12-17:24 05/21/12-17:51 EUCLID Euclid unscheduled maintenance.
05/21/12-14:29 05/21/12-14:55 DTN02 Unscheuled maintenance.
05/21/12-14:37 05/21/12-17:00 EUCLID Euclid unscheduled maintenance.
05/21/12-14:02 05/21/12-14:18 EUCLID Euclid unscheduled maintenance.
05/21/12-13:02 05/21/12-13:24 EUCLID Euclid unscheduled maintenance.
05/21/12-10:00 05/21/12-12:06 DIRAC DIRAC maintenance.
05/21/12-10:00 05/21/12-16:49 PDSF PDSF network troubleshooting.
05/21/12-08:55 05/21/12-09:25 DTN01 DTN01 unscheduled maintenance.
00:05/12- 05/21/12-01:05 SERVER DTN01 unscheduled maintenance.
05/20/12-02:00 05/20/12-14:45 NGF /projecb unscheduled manintenance.
05/17/12-18:32 05/17/12-18:53 EUCLID Euclid unscheduled maintenance.
05/16/12-20:19 05/16/12-21:15 EUCLID Euclid was unavailable,
05/16/12-10:30 05/16/12-12:37 SERVER License Server DMV1 and DMV2 scheduled maintenance.
05/16/12-09:00 05/16/12-12:32 ARCHIVE Scheduled Maintenance.
05/15/12-08:10 05/15/12-08:25 EUCLID Euclid powered down, unplanned. Powercycled and restored at 08:25.
05/14/12-21:10 05/14/12-21:31 EUCLID Euclid unscheduled maintnaenance.
05/12/12-19:04 05/12/12-20:51 NX NX Services unavailable due to network issue.
05/12/12-19:04 05/12/12-20:51 EUCLID Euclid unavailable due to network issue.
05/12/12-17:24 05/12/12-17:42 NX NX Services unavailable due to network issue.
05/12/12-17:24 05/12/12-17:42 EUCLID Euclid unavailable due to network issue.
05/12/12-15:40 05/12/12-16:30 NX NX Services unavailable due to network issue.
05/12/12-15:40 05/12/12-16:30 EUCLID Euclid unavailable due to network issue.
05/10/12-09:00 05/10/12-12:00 PDSF pdsfdtn1.nersc.gov maintenance.
05/09/12-11:20 05/09/12-12:45 DMV Urgent maintenance to replace failing hardware.
05/08/12-08:00 05/09/12-03:30 CARVER Scheduled maintenance. Estimated uptime 05/09/12 01:00PT.
05/08/12-08:00 05/09/12-03:40 DIRAC Scheduled maintenance. Estimated uptime 05/09/12 01:00PT.
05/08/12-08:00 05/09/12-02:00 DTN Scheduled maintenance.
05/08/12-08:00 05/09/12-02:00 EUCLID Scheduled maintenance. Estimated uptime 05/09/12 01:00PT.
05/08/12-08:00 05/09/12-03:00 GENEPOOL Scheduled maintenance.
05/08/12-08:00 05/09/12-02:46 HOPPER Scheduled maintenance.
05/08/12-08:00 05/09/12-02:36 NGF Scheduled maintenance.
05/08/12-08:00 05/09/12-02:00 NX Scheduled maintenance. Estimated uptime 05/09/12 01:00PT.
05/08/12-07:00 05/08/12-23:34 REGENT REGENT maintenance.
05/08/12-07:00 05/08/12-23:42 ARCHIVE Archive Scheduled maintenance.
05/07/12-15:35 05/07/12-16:04 EUCLID EUCLID unscheduled maintenance.
05/04/12-12:00 05/04/12-16:00 PDSF PDSF DTN maintenance
05/03/12-08:00 05/03/12-17:30 DTN DTN scheduled maintenance.
04/29/12-16:44 04/29/12-17:53 Hopper /scratch and /scratch2 unscheduled maintenance.
04/25/12-10:53 04/25/12-13:00 PDSF GPFS issues impacting file system access.
04/25/12-10:53 04/25/12-13:00 GENEPOOL GPFS issues impacting file system access.
04/25/12-10:53 04/25/12-13:00 FRANKLIN GPFS issues impacting file access.
04/25/12-10:53 04/25/12-13:00 EUCLID GPFS issues impacting file access.
04/25/12-10:53 04/25/12-13:00 DIRAC GPFS issues impacting file access.
04/25/12-10:53 04/25/12-13:00 CARVER GPFS issues impacting file access.
04/25/12-10:53 04/25/12-13:00 NGF
04/25/12-11:09 04/25/12-13:00 HOPPER Logins degraded due to GPFS issues.
04/24/12-11:40 04/24/12-16:30 EUCLID Urgent Maintenance for stale NFS file handle.
04/24/12-02:50 04/24/12-07:53 GENEPOOL Logins intermittent due to /global/scratch issue.
04/24/12-02:50 04/24/12-07:37 DIRAC Logins intermittent due to /global/scratch issue.
04/24/12-02:50 04/24/12-07:41 EUCLID Logins intermittent due to /global/scratch issue.
04/24/12-02:50 04/24/12-07:53 HOPPER Logins intermittent due to /global/scratch issue.
04/24/12-02:50 04/24/12-07:37 CARVER Logins intermittent due to /global/scratch issue.
04/24/12-01:39 04/24/12-07:37 NGF Global scratch is intermittently effecting login.
04/23/12-19:22 04/23/12 23:12 System was down due to Link Inactive.
04/19/12-16:15 04/20/12-14:11 FRANKLIN Batch queues disabled due to /project maintenance.
04/19/12-11:00 04/20/12-12:00 PORTAL/PORTAL-AUTH Unavailable due to /project issues.
04/19/12-11:00 04/20/12-12:00 NGF /project unavailable.
04/19/12-12:05 04/19/12-13:45 NGF /global/scratch
04/18/12-09:38 04/18/12-13:25 HOPPER Batch queues disabled by Cray to prep for the big job run.
04/18/12-09:00 04/18/12-12:51 REGENT Scheduled maintenance.
04/18/12-09:00 04/18/12-12:51 ARCHIVE Scheduled outage.
04/17/12-16:48 04/17/12-17:30 HOPPER Hopper /scratch unavailable.
04/17/12-15:01 04/17/12-16:00 HOPPER Hopper /scratch & /scratch2 unavailable.
04/17/12-13:30 04/17/12-14:15 HOPPER Hopper batch queues disabled.
04/17/12-12:51 04/17/12-14:15 HOPPER Hopper Service node / Scratch2 issue
04/15/12-04:57 04/15/12-09:50 FRANKLIN Franklin unscheduled maintenance.
04/13/12-14:30 04/13/12-14:45 CARVER NGF system wide outage.
04/13/12-14:30 04/13/12-14:45 DIRAC NGF system wide outage.
04/13/12-14:30 04/13/12-14:45 EUCLID NGF system wide outage.
04/13/12-14:30 04/13/12-14:45 FRANKLIN NGF system wide outage.
04/13/12-14:30 04/13/12-14:45 HOPPER NGF system wide outage.
04/13/12-14:30 04/13/12-14:45 GENEPOOL NGF system wide outage.
  04/13/12-14:30 04/13/12-14:45 NGF
04/13/12-12:00 04/13/12-12:30 DTN01 DTN unscheduled maintenance
04/11/12-13:00 04/11/12-14:45 GENEPOOL Genepool network issue affecting half the compute nodes.
04/10/12-11:00 04/10/12-11:53 MATHMATICA Scheduled license server maintenance
04/10/12-07:54 04/10/12-13:05 FRANKLIN Link inactive.
04/10/12-07:18 04/10/12-07:56 EUCLID Euclid powered off. Restarted.
04/09/12-12:12 04/09/12-17:15 FRANKLIN Franklin unscheduled maintenance, /scratch issue.
04/09/12-09:00 04/09/12-09:15 PDSF Bestman service restart.
04/06/12-10:00 04/06/12-12:00 NIM Nim Maintenance
04/05/12-06:00 04/05/12-07:30 NETWORK NERSC/JGI Scheduled network maintenance.
04/04/12-13:35 04/04/12-14:57 PDSF Logins unavailable due to NGF issues.
04/04/12-13:35 04/04/12-14:57 EUCLID Logins unavailable due to NGF issues.
04/04/12-13:35 04/04/12-14:57 GENEPOOL Logins unavailable due to NGF issues.
04/04/12-13:35 04/04/12-14:57 CARVER NGF Issues impacting logins.
04/04/12-13:35 04/04/12-14:57 HOPPER Logins unavailable due to NGF issues.
04/04/12-13:20 04/04/12-15:50 FRANKLIN Link inactive.
04/04/12-13:00 04/04/12-15:58 DTN DTN maintenance, OS upgrade.
04/03/12-08:55 04/03/12-10:54 FRANKLIN Franklin SWO
04/03/12-08:00 04/03/12-16:27 HOPPER Hopper Scheduled maintenance.
04/02/12-16:20 04/04/12-13:00 PDSF PDSF - Eliza17 down. Estimated uptime 10:00 04/03/12.
04/02/12-10:52 04/02/12-12:57 PDSF PDSF SWO to deal with filesystem issues.
04/02/12-10:18 04/02/12-12:52 PDSF eliza17 down.
03/29/12-15:00 03/29/12-15:15 MATLAB MATLAB License Server Maintenance.
03/28/12-09:00 03/28/12-13:23 ARCHIVE Archive Maintenance
03/28/12-05:40 03/28/12-10:40 FRANKLIN Franklin is down for unscheduled maintenace. estimated uptime is 10:00PT.
03/27/12-02:14 03/27/12-06:14 FRANKLIN FRANKLIN URGENT MAINTENANCE.
03/26/12-09:00 03/26/12-12:45 PDSF Scheduled maintenance of PDSF [1-4].
03/25/12-12:58 03/25/2012-15:58 FRANKLIN Franklin Link inactive.
03/23/12-00:10 03/23/12-09:20 NGF Unscheduled maintenance on NGF F/S issues.
03/23/12-00:10 03/23/12-06:25 HOPPER Unscheduled maintenance due to NGF F/S issues.
03/23/12-00:10 03/23/12-08:35 FRANKLIN Unscheduled maintenance due to NGF F/S issues.
03/23/12-00:10 03/23/12-06:25 EUCLID Unscheduled maintenance due to NGF issues with the F/S.
03/23/12-00:10 03/23/12-06:25 CARVER Filesystem problems are affecting logins.
03/21/12-15:01 03/21/12-15:32 PDSF PDSF2 interactive node unscheduled maintenance.
03/21/12-09:00 03/21/12-12:06 ARCHIVE Scheduled Maintenance.
03/21/12-09:00 03/21/12-11:53 REGENT Regent scheduled maintenance.
03/20/12-17:20 03/20/12-18:04 PDSF2 pdsf2 interactive node unscheduled maintenance.
03/20/12-16:52 03/21/12-04:10PT HOPPER Hopper extended maintenance.
03/20/12-09:00 03/20/12-13:00 PDSF PDSF rolling upgrade to login nodes
03/20/12-09:00 03/20/12-10:00 PDSF PDSF bestman restart
03/20/12-08:00 03/20/12-09:01 NX NX server unscheduled maintenance
03/20/12-08:00 03/20/12-16:38 HOPPER Hopper extended scheduled maintenance.
03/19/12-15:40 03/19/12-16:00 NX NX unscheduled maintenance.
03/19/12-11:20 03/19/12-11:40 FRANKLIN Queues disabled at 11:20 for cooling issues.
03/18/12-04:41 03/18/12-08:55 EUCLID Euclid unscheduled maintenance.
03/17/12-18:45 03/17/12-22:47 FRANKLIN Unscheduled maintenance.
03/16/12-12:00 03/16/12-14:02 TESLA Scheduled maintenance.
03/15/12-11:50 03/15/12-13:00 Portal.nersc.gov Emergency maintenance.
03/15/12-09:50 03/15/12-11:20 HOPPER Hopper unscheduled maintenance.
03/14/12-08:00 03/14/12-16:30 DIRAC Dirac scheduled maintenance.
03/14/12-08:00 03/14/12-16:30 CARVER Carver scheduled maintenance.
03/14/12-15:00 03/14/12-15:33 DTN02 DTN02 urgent maintenance.
03/14/12-15:00 03/14/12-15:05 DTN01 DTN01 urgent maintenance.
03/13/12-14:30 03/13/12-15:30 PDSF PDSF3 scheduled maintenance.
03/12/12-07:10 03/12/12-07:25 DTN01 DTN01 outage
03/11/12-00:01 03/11/12-04:43 FRANKLIN Franklin unscheduled maintenance.
03/08/12-23:14 03/08/12-23:39 EUCLID Euclid Unscheduled maintenance.
03/08/12-04:09 03/08/12-04:48 EUCLID Euclid Unscheduled Maintenance.
03/07/12-09:00 03/07/12-11:42 ARCHIVE HPSS archive maintenance
03/07/12-07:21 03/07/12-07:52 EUCLID Euclid Swo
03/04/12-20:46 03/04/12-22:17 DTN01 DTN01 data transfer node unscheduled maintenance.
03/02/12-16:49 03/02/12-17:25 EUCLID Euclid was down for unscheduled maintenance.
02/29/12-13:00 02/29/12-14:10 LDAP LDAP maintenance
02/29/12-10:00 02/29/12-12:21 PDSF PDSF eliza 10 maintenance
02/29/12-09:00 02/29/12-11:44 HPSS HPSS regent downtime
02/29/12-08:35 02/29/12-11:55 FRANKLIN Franklin SWO
02/28/12-14:00 02/28/12-15:29 PDSF Scheduled maintenance on PDSF4.
02/25/12-23:42 02/26/12-04:14 FRANKLIN Franklin unscheduled maintenance completed.