NERSCPowering Scientific Discovery Since 1974

Cori Timeline

This page records a brief timeline of significant events and user environment changes on Cori (in reverse chronological order). 

Aug 8-10, 2017      
     OS upgrade from CLE6.0UP03 to CLE6.0UP04.  
     SW default change to CDT 17.06 after scheduled maintenance:
      -- cray-libsci/17.06.1 (from 16.09.1)
      -- cray-mpich/7.6.0 (from 7.4.4)
      -- cray-shmem/7.6.0 (from 7.4.4)
      -- craype/2.5.12 (from 2.5.7)
      -- cray-fftw/3.3.6.2 (from 3.3.4.10)
      -- papi/5.5.1.2 (from 5.5.1.1)
      -- perftools, perftools-base, perftools-lite/6.5.0 (from 6.4.6)
      -- cce/8.6.1 (from 8.5.4)
      -- gcc/6.3.0 (from 6.2.0)
      -- atp/2.1.1 (from 2.0.3)
      -- stat/3.0.1.0 (from 2.2.0.3)
      -- cray-ccdb/3.0.3 (from 2.0.3)
      -- cray-lgdb/3.0.6 (from 3.0.4)
      -- cray-netcdf/4.4.1.1.3 (from 4.4.1)
      -- cray-netcdf-hdf5parallel/4.4.1.1.3 (from 4.4.1)
      -- cray-petsc, cray-petsc-complex, cray-petsc-complex-64/3.7.6.0 (from 3.7.2.1)
      -- cray-tpsl, cray-tpsl-64/17.06.1 (from 16.07.1)
      -- cray-trilinos/12.10.1.1 (from 12.6.3.3)
      -- cray-cti/1.0.6 (from 1.0.3)
      -- cray-mpich-abi/7.6.0 (from 7.4.4)
      -- craypkg-gen/1.3.5 (from 1.3.4)
      -- modules/3.2.10.6 (from 3.2.10.5)

July 1, 2017
      Charging on Cori KNL begins.  Large Jobs using 1,024 or more KNL nodes receive 20% charging discount. 

May 30, 2017 
     
All users are enabled on Cori KNL without restriction.

Apr 18 - Apr 21, 2017 
     
Two new Haswell cabinets (384 compute nodes) added to the system.  The new total number of Haswell nodes becomes 2,388.  The total number of all nodes (2,388 Haswell plus 9,688 KNL) on Cori becomes 12,076.

Mar 22 - Mar 24, 2017 
     OS upgrade from CLE6.0UP01 to CLE6.0UP03.  
     Software default change: vtune from 2017.up01 to 2017.up02; perftools from 6.4.2 to 6.4.6.

Mar 16, 2017 
     In order to work around an Intel compiler bug in versions 17.0.1.132 and 17.0.2.144, the default setting of Fortran buffered IO is turned off, i.e.,(the environment variable of FORT_BUFFERED=1 has been removed. 

Feb 28 - Mar 3, 2017 
     Two new KNL cabinets (384 compute nodes) added to the system.  The new total number of KNL nodes becomes 9,688.
     Slurm updated from version 16.05 to 17.02.

Feb 6, 2017 
     
Selected users' Cori scratch directories now managed by new Meta Data Servers.

Jan 30, 2017 
     
Cori scratch is mounted on NERSC Data Transfer Nodes (DTNs) to allow fast data moving between NERSC and other facilities.

Dec 20, 2016 
     All users have access to Cori KNL.  
     Intel compiler default version changed from 16.0.3.210 to 17.0.1.132.

Nov 19, 2016
     
SW default change to CDT 16.10 after scheduled maintenance:
     
-- cray-ga/5.3.0.7 (from 5.3.0.6)
      -- cray-libsci/16.09.1 (from 16.06.1)
      -- cray-mpich/7.4.4 (from 7.4.0)
      -- cray-shmem/7.4.4 (from 7.4.0)
      -- craype/2.5.7 (from 2.5.5)
      -- fftw/3.3.4.10 (from 3.3.4.8)
      -- papi/5.4.3.3 (from 5.4.3.2)
      -- perftools, perftools-base, perftools-lite/6.4.2 (from 6.4.0)
      -- cce/8.5.4 (from 8.5.0)
      -- gcc/6.2.0 (from 5.3.0)
      -- atp/2.0.3 (from 2.0.2)
      -- cray-ccdb/2.0.3 (from 2.0.1)
      -- cray-lgdb/3.0.4 (from 3.0.2)
      -- cray-netcdf/4.4.1 (from 4.4.0)
      -- cray-netcdf-hdf5parallel/4.4.1 (from 4.4.0)
      -- cray-petsc, cray-petsc-complex, cray-petsc-complex-64/3.7.2.1 (from 3.7.0.0)
      -- cray-tpsl, cray-tpsl-64/16.07.1 (from 16.06.1)
      -- cray-trilinos/12.6.3.3 (from 12.6.3.0)
      -- cray-cti/1.0.3 (from 1.0.1)
      -- cray-mpich-abi/7.4.4 (from 7.4.0)
      -- craypkg-gen/1.3.4 (from 1.3.3)
      -- modules/3.2.10.5 (from 3.2.10.4)

Sept 19 - Oct 31, 2016 
     
Merge for Cori Haswell and KNL cabinets completed. Haswell nodes returned to users on Oct 31.  Running jobs changed for getting optimal process and thread affinity. Use sun "-c" and "--cpu_bind=cores" when needed. Also enforce "-C haswell" to requrest Haswell nodes

Jul 20, 2016 
     
Cori $SCRATCH is available as $CSCRATCH on Cori and Edison.

Jul 4, 2016 
     
Introduced SLURM file license features.

Jun 13 - 30, 2016 
     
OS upgrade to Rhine/Redwood (CLE6) to prepare for KNL arrival.

     SW default change to CDT 16.06 after CRT power outage
      -- cray-ga/5.3.0.6 (from 5.3.0.6)
      -- cray-libsci/16.06.1 (from 13.3.0)
      -- cray-mpich/7.4.0 (from 7.3.1)
      -- cray-shmem/7.4.0 (from 7.3.1)
      -- craype/2.5.5 (from 2.5.1)
      -- fftw/3.3.4.8 (from 3.3.4.6)
      -- papi/5.4.3.2 (from 5.4.1.3)
      -- perftools, perftools-lite/6.4.0 (from 6.3.1)
      -- cce/8.5.0 (from 8.4.3)
      -- gcc/5.3.0 (from 5.2.0)

May 20, 2016 
     
 
Burst Buffer on Cori Phase 1 accepted. 

May 11, 2016 
     
 CUG Best Paper Award for Burst Buffer Early User Program

May 9, 2016 
     
"long" (1 node, 96-hr) job qos available. 

Mar 21, 2016

      Cori Phase 1 compute nodes accepted. 

Mar 1, 2016 
      Scratch file system regular purge started.

Feb 27, 2016 
      SW default change to CDT 16.01 after CRT power outage
      -- pmi/5.0.10-1.0000.11050.0.0.ari (from 5.0.9-1.0000.10911.0.0.ari)
      -- cray-ga/5.3.0.5 (from 5.3.0.3)
      -- cray-hdf5, cray-hdf5-parallel/1.8.16 (from 1.8.14)
      -- cray-libsci/13.3.0 (from 13.2.0)
      -- cray-mpich/7.3.1 (from 7.2.5)
      -- cray-shmem/7.3.1 (from 7.2.5)
      -- craype/2.5.1 (from 2.4.2)
      -- fftw/3.3.4.6 (from 3.3.4.5)
      -- papi/5.4.1.3 (from 5.4.1.2)
      -- perftools, perftools-lite/6.3.1 (from 6.3.0)
      -- cce.8.4.3 (from 8.4.0)
      -- gcc/5.2.0 (from 5.1.0)

Jan 12, 2016 
      New allocation year AY16 starts. Cori usage starts charging.  New SSH Key Authentication Mechanism became mandatory.

Dec 4, 2015 
      "r
ealtime" partition enabled.

Nov 17, 2015 
      SSH host key changed to use 4096-bit new RSA key. Host based SSH authentication works.   

Nov 11, 2015 
     
Burst Buffer enabled for early users.

Oct 29 - Nov 12, 2015 
      Early users were enabled in 7 phases. All users were enabled by Nov 12, 2015.

Sept 29, 2015
      Cori Phase 1 (along with Burst Buffer) delivered.