Cray Compiling Environment (CCE) 8.6.5 ===================================== Release Date: ------------- December 14, 2017 Purpose: -------- CCE 8.6.5 provides Fortran, C, and C++ compilers for Cray XC and Cray CS systems. The following key enhancements are included in this CCE release: CCE 8.6.5 --------- Bugfixes only. CCE 8.6.4 --------- Bugfixes only. CCE 8.6.3 --------- Bugfixes only. CCE 8.6.2 --------- Bugfixes only. CCE 8.6.1 --------- On Cray XC systems, the -h system_alloc option is now default for static linking when CrayPE 2.5.12 (or later) is used. - The -h default_alloc option can be specified to use the previous default memory allocator for static linking. - The -h default_alloc option remains the default for dynamic linking. CCE 8.6.0 --------- Support for the Intel® Xeon® processor Scalable family C++14 support is added and enabled by default - See the crayCC(1) man page for more information. C11 support is enabled by default - See the craycc(1) man page for more information. The gcc emulation mode is gcc 6.1 Reduced the performance penalty of C++ exception handling for the common case where an exception is not thrown. OpenMP 4.5 full support - See the intro_openmp(7) man page for more information. Increased use of arithmetic approximations at default for some architectures - The -hfp2=noapprox command line option can be used to disable this optimization. New -h alias command line option controls how aliasing is performed - See the crayftn(1), craycc(1), and crayCC(1) man pages for more information. Optimization of omp simd private() constructs New 'capacity' attribute for the "memory" directive for placing data in DDR memory - See the memory(7) man page for more information. The -g option is now ignored if any optimization option is specified - See the crayftn(1), craycc(1), or crayCC(1) man page for more information. Improved vectorization of Fortran array syntax An API for "thread hot" UPC is introduced for mixed OpenMP threads/UPC performance - See the intro_pgas(7) man page for more information. Performance improvements for all supported systems Important information regarding compatibility: ---------------------------------------------- Please note that a cdt module is provided on Cray XC systems to help users load required product versions for compatibility with CCE 8.6. There are two important changes in the CCE 8.6 C++ compiler that will most likely require that users rebuild their C++ codes. First, the implementation of C++ exception handling in CCE has changed for the 8.6 release. Unlike CCE 8.5, C++ code compiled with CCE 8.6 is exception-compatible with code generated by the GNU C++ compiler. This means that most C++ code that was compiled with CCE 8.5 is incompatible with most C++ code compiled with CCE 8.6. If you try to link an older C++ library that makes use of C++ exception handling with newly compiled code, you will see errors about undefined references to __eh_curr_region and __curr_eh_stack_entry. The older code will need to be recompiled to be compatible with CCE 8.6. Second, the gcc emulation mode for CCE 8.6 is gcc 6.1.0. This means the default C++ mode is C++ 14, and system headers and libraries from /opt/gcc/6.1.0/ are used. Loading a gcc module that is older than 6.1.0 along with a CCE 8.6 module leads to linker errors. Please unload your gcc module, or swap to gcc/6.1.0, when using CCE 8.6. A new cray-mpich 7.6 module is required to work with CCE 8.6. All MPI codes (Fortran, C, and C++) built with CCE 8.6 must use cray-mpich 7.6. The CCE 8.6 C++ changes affect all MPI codes since MPI uses C++ exception handling. If you need to go back to a cray-mpich 7.5 module or a cce 8.5 module, you should change both cce and cray-mpich. New versions of HDF5, NetCDF, parallel-NetCDF, and Trilinos are required to work with CCE 8.6 for C++ applications. If you need to go back to a previous version of these products or a cce 8.5 module, you should change both cce and these products. For Intel MIC (KNL) targets where exact values are required for division, square root, and exponentiation at default optimization levels (specifically -hfp2), the use of -hfp2=noapprox may be required to disable the newly default arithmetic approximations. Dependencies: ------------- This CCE release is supported on - Cray XC systems with CLE 6.0 or CLE 5.2. - Cray CS systems running CentOS 7.2/7.3 or RedHat 7.2/7.3. For Cray XC systems the following products are required: - CrayPE 2.5.11 - GCC 6.1.0 must be installed but does not need to be the default GCC - GMP 6.1.1 - MPFR 3.1.4 - MPC 1.0.3 - LibSci 17.06.1 or later - MPT 7.6.0 - PMI 5.0.12 or later For Cray CS systems the following products are required: - CrayPE 2.5.11 - GCC 6.1.0 must be installed but does not need to be the default GCC - GMP 6.1.1 - MPFR 3.1.4 - MPC 1.0.3 - LibSci 17.06.1 or later - MVAPICH 2.2rc1.0.3 This CCE release requires the following minimum versions of these products if they are used: - HDF5 1.10.0.2 - NETcdf 4.4.1.1.2 - parallel-NETcdf 1.8.1 - GA 5.3.0.7 - LibSci_acc 17.03.1 - TPSL 17.06.1 - PETSc 3.7.6.0 - fftw3 3.3.6.2 - fftw2 2.1.5.9 - Trilinos 12.10.11 - Perftools 6.5.0 Installation instructions: -------------------------- For XC systems, Craype-installer 1.24.0 or later must be used to install this release. Using an earlier version of Craype-installer with this release will result in a non-functioning Cray Programming Environment installed on the system. For CS systems, please see S-2800 CS System Programming Environments Installation Guide. License: Except for the third party components and software licensed by Cray through proprietary agreements, components, files or programs contained within this package or product are Copyright -2017 Cray Inc. All rights reserved. Attribution notices for open source licensed software contained in this package are detailed in the file: /opt/cray/pe/cce/8.6.0/ATTRIBUTIONS_8.6.txt Issues Closed: -------------- CCE 8.6.5 --------- CAST-16649 ESMF library build fails with CCE CAST-16515 Icon compile error in mo_nh_pa_test (OMP directive) CAST-16297 CCE does not allow symbolic debugging for OpenMP regions; Intel, GCC, and PGI does CAST-16109 unexplained performance degradation CAST-16025 Standard output of Japanese character with CRAY C compiler CAST-15949 Cray C++ compiler segmentation fault in CCE 8.6.0 CAST-6921 FTN: Runtime crash in assignment with permutation vector CCE 8.6.4 --------- CAST-16590 Internal compiler error CAST-16526 ftn: 2nd time regression with overloading of operator(.x.) CAST-16522 File name used in open statement in CRAY Fortran CAST-16457 Change of value of array element without update in program CAST-16108 /opt/cray/cce/8.6.1/cce/x86_64/bin/optcg" was terminated due to receipt of signal 013 CAST-15923 cce/8.6.x has unclear internal compiler error (worse than cce/8.5.8 error message) CAST-15884 Erroneous ftn-1014 errors for use of type parameters CAST-15713 Compile error with OpenMP directive CAST-8010 FRISTPRIVATE clause fails for an array argument whose size is a shared parameter CCE 8.6.3 --------- CAST-16048 Fortran compiler in CCE 8.6.1 encounters a segmentation fault on a Fortran 77 file with OpenMP CAST-16042 memory leak in Cray compiler CAST-16025 Standard output of Japanese character with CRAY C compiler CAST-15958 Local variable declaration of a derived type with private components produces a false error CAST-15767 ICE for example with multiple type extensions CAST-15766 Incorrect result from kind type parameter usage CAST-15728 ICE for deferred-length declaration CAST-6612 ftn: regression with overloading of operator(.x.) CCE 8.6.2 --------- CAST-15695 Compile error caused by CCE/8.6.0 CAST-15666 Result fault caused by inline optimization in Cray fortran CAST-15742 cce/8.6.0 error with bupc compilation CAST-7991 cce fortran fails to compile code that compiles with gnu, intel CAST-7966 C++ not catching ifstream failure exception CAST-7708 OpenMP 4.5 Support in CCE - incorrect error message for "doacross" constructs CAST-6623 Cray compiler generates an error on OpenACC unstructured data region when a static array member of a type is copied in CCE 8.6.1 --------- CAST-7913 crayftn compiler bug (internal compiler error) CAST-7844 Error using OpenMP simd aligned with const array of const CAST-7828 CCE Fortran ICE CAST-7788 Wrong results generated for vectorized and collapsed loop for CCE on KNL CAST-7464 20170511 Errors (both frontend and ICEs) when compiling Boost 1.64.0 with Cray compiler using C++11 mode. CCE 8.6.0 --------- CAST-7827 CCE fails to vectorize strided copy (CC-6254) CAST-7767 CCE C++ compiler segmentation fault CAST-7741 ftn-645 issued for correct use of name as generic and type CAST-7579 perftools-lite-hbm fails to compile fortran code using ieee_arithmetic CAST-7421 cce 8.5.6 C++ too many compiler warnings CAST-7354 Invalid bitcast -- LLVM ERROR: Broken function found, compilation aborted! CAST-7127 Performance decrease in the OpenACC code (physics was about 4x slower). CAST-7095 cuMemFree returned CUDA_ERROR_INVALID_VALUE CAST-7061 8.6.0 cc internal error CAST-6934 ftn-2116 crayftn: INTERNAL "/opt/cray/cce/8.5.7/cftn/x86-64/lib/optcg" was terminated CAST-6840 Cray fortran compiler cce/8.5.5 ignores DEFAULT(NONE) clause in the nested $OMP PARALLEL construct CAST-6784 A cray compiler bug? CAST-6763 Cray Fortran compiler does not vectorize a do loop nested within an openmp parallel do loop due to "potential hazard in conditional code" CAST-6730 OpenMP and perftools not honoring: CALL PAT_REGION_BEGIN(1,'MYREGION',pat_err) CAST-6458 cray c compiler generates inefficient binary from an user code CAST-6392 ICE in GPU code CAST-6356 Full c++11 support CAST-6341 Wrong parameter pass with optimization CAST-6304 Cray compiler ICE on C++ library "Elemental" CAST-6265 AVX512 intrinsics needed for Agner Fog's C++ vector class library and UMESIMD CAST-6153 problem with std::regex_replace CAST-5722 ccfe process persists even after controlling CC process is killed CAST-5721 unusually long compile times CAST-5500 cray internal compiler error CAST-5214 CCE 8.4.1 (OpenACC) INTERNAL COMPILER ERROR(s) CAST-5053 CCE not respecting OpenMP collapse clause CAST-4537 code using OpenMP task depend does not distribute across threads CAST-4300 Cray ftn cannot compile code in a directory containing a space in the name CAST-4074 Symbol tables for libraries of C++ objects generated with -g exceed size limit CAST-4021 Cray OpenMP compiled code run with one thread is about 50% slower than the serial version CAST-2237 Cray Fortran compiler cannot be run in a directory with spaces CAST-1592 Runtime bug under Cray compile - unable to parse grass_rbcL.tre [Boost Ticket #9152] CAST-1446 Allow commas in directory paths passed to CCE compilers via options. CAST-306 ERROR message for out-of-range constants ################################################################################ FFTW 3.3.6.3 ============ Release Date: ------------- December 14, 2017 Purpose: -------- The Cray FFTW 3.3.6.3 release is supported on Cray XC and CS Systems. FFTW is supported on the host CPU but not on the accelerator of Cray systems. The Cray FFTW 3.3.6.3 release provides the following: - Improved FASTPLAN optimizations for Intel Xeon processor Scalable family CPUs on XC and CS systems. The FASTPLAN feature is enabled by default. See the intro_fftw3 manual page for information on FASTPLAN usage. Product and OS Dependencies: ---------------------------- The Cray FFTW 3.3.6.3 release is supported on the following Cray systems: * Cray XC systems with CLE 5.2 (or later) or CLE 6.0 (or later). * Cray CS systems with CentOS and either MVAPICH2 2.2 or Intel MPI. The FFTW 3.3.6.3 release requires the following software products: For Cray XC series systems: craype 2.1.2 or later MPT 7.2.5 or later One or more of the following major compiler versions: CCE 8.6 GCC 4.9 GCC 5.1 or later GCC 6.1 or later GCC 7.1 or later Intel 17 For Cray CS systems: craype 2.1.2 or later MVAPICH2 2.2 or Intel MPI (cray-impi) as appropriate for the network target One or more of the following major compiler versions: CCE 8.6 Notes and Limitations: ---------------------- Starting with cray-fftw/3.3.6.1 the fftw module has been renamed from fftw to cray-fftw. Documentation: -------------- http://www.fftw.org/index.html#documentation See the intro_fftw3 manual page for additional information. Modulefile: ----------- module load cray-fftw Installation ------------ On CLE 5.2: rpm -ivh --prefix=/opt/cray cray-fftw-3.3.6.3-201711300344.75dd253a6cac3-3.x86_64.rpm On CLE 6.0: rpm -ivh cray-fftw-3.3.6.3-201711300344.75dd253a6cac3-3.x86_64.rpm To make this the default version, On CLE 5.2 execute /opt/cray/admin-pe/set_default_files/set_default_fftw_3.3.6.3 On CLE 6.0 execute /opt/cray/pe/admin-pe/set_default_files/set_default_fftw_3.3.6.3 Certain components, files or programs contained within this package or product are Copyright 2011-2017 Cray Inc. All rights reserved. ################################################################################ cray-hdf5 ================= Purpose: -------- To release HDF5-1.10.0-patch1 (1.10.1.1) Product and OS Dependencies: ---------------------------- The HDF5 release is supported on on the following Cray systems: * Cray XE, XK and XC systems with CLE 5.2 and later. The HDF5 1.10.1.1 release requires the following software products: One or more compilers: CCE 8.6.0 or later GCC 4.9 GCC 5.1 Intel 16.0 or later PGI 15.3 or later For Cray XE, XK and XC systems: craype 2.1.2 or later Notes and Limitations: ---------------------- The HDF5 compiler scripts (h5cc, h5fc, h5c++) are not included in the release. The user should use the Cray compiler scripts (cc, ftn, CC) to include the HDF5 header files and link in the HDF5 libraries. Documentation: -------------- http://www.hdfgroup.org/HDF5/doc/index.html Modulefile: ----------- module load cray-hdf5 OR module load cray-hdf5-parallel Product description: -------------------- HDF5 is a data model, library, and file format for storing and managing data. It supports an unlimited variety of datatypes, and is designed for flexible and efficient I/O and for high volume and complex data. HDF5 is portable and is extensible, allowing applications to evolve in their use of HDF5. The HDF5 Technology suite includes tools and applications for managing, manipulating, viewing, and analyzing data in the HDF5 format. Installation: ------------- Installation instructions for CLE 6.0 and later: ================================================ rpm -ivh cray-hdf5-1.10.1.1-*.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version, execute: /opt/cray/pe/admin-pe/set_default_files/set_default_hdf5_1.10.1.1 Installation instructions for CLE 5.2: ============================================= rpm -ivh --prefix=/opt/cray cray-hdf5-1.10.1.1-*.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version, execute: /opt/cray/admin-pe/set_default_files/set_default_hdf5_1.10.1.1 Certain components, files or programs contained within this package or product are Copyright -2017 Cray Inc. All rights reserved. ################################################################################ cray-pmi 5.0.13 ============================================================================== Release Date: -------------- December 07, 2017 Purpose: -------- The Cray Process Manager Interface Library provides the interface between the application launching facility (ALPS) and other communication libraries such as MPICH and SHMEM. Some internal administrative changes have occurred that should not affect users of PMI. The following bugs were fixed since the PMI 5.0.12 release: * "man pmi" will now display the intro_pmi man page. Installation: ------------- On CLE 5.2: rpm -ivh --prefix=/opt/cray cray-libpmi0-5.0.13-*.rpm cray-libpmi-devel-5.0.13-*.rpm The "*" in the install command represents compiler version combinations. To make this the default version, execute: /opt/cray/admin-pe/set_default_files/set_default_cray-libpmi-5.0.13 On CLE 6.0 or later: rpm -ivh cray-libpmi0-5.0.13-*.rpm cray-libpmi-devel-5.0.13-*.rpm The "*" in the install command represents compiler version combinations. To make this the default version, execute: /opt/cray/pe/admin-pe/set_default_files/set_default_cray-libpmi-5.0.13 ################################################################################ LibSci 17.12.1 ============== Release Date: ------------- December 14, 2017 Purpose: -------- Cray LibSci 17.12.1 provides scientific libraries for Cray CS and XC systems. Cray LibSci is supported on the host CPU but not on the accelerator of these systems. The Cray LibSci 17.12.1 release provides the following: * QDWH 2.0.0 and KSVD 1.0.0 major package updates * Additional optimizations for the Intel Xeon processor Scalable family * Miscellaneous updates Cray LibSci 17.12.1 includes the following versions of publicly available libraries: * LAPACK 3.6.1 - For further information, see http://www.netlib.org/lapack * ScaLAPACK 2.0.2 - (Scalable LAPACK) For further information, see http://www.netlib.org/scalapack. * QDWH 2.0.0 KSVD 1.0.0 - Polar decomposition and SVD packages, see https://github.com/ecrc/qdwh https://github.com/ecrc/ksvd Product and OS Dependencies: ---------------------------- The Cray LibSci 17.12.1 release is supported on the following Cray systems: * Cray CS systems with a December 2017 PE supported OS and MVAPICH2 or Intel MPI * Cray XC systems with CLE 5.2 UP04 or CLE 6.0 The Cray LibSci 17.12.1 release requires the following software products: For Cray XC series systems: craype 2.5.11.5 or later MPT 7.6.0 or later One or more of the following major compiler versions: CCE 8.6 GCC 4.9 GCC 5.1 GCC 6.1 Intel 17.0 For Cray CS systems: CCE 8.6 craype for CS MVAPICH2 or Intel MPI Notes and Limitations: ---------------------- OMP threaded versions: The CrayPE 2.1.2 and later releases add support for link line generation for the multi-threaded versions of the libsci library based on the OpenMP flags the user specifies for each compiler: * CCE by default links to the OpenMP LibSci library. CrayPE will link in the serial version of LibSci when the CCE flag -hnoomp is used. * GNU by default links serial LibSci library. CrayPE will link in the OpenMP version of LibSci when the GNU flag -fopenmp is used. * INTEL by default links serial LibSci library. CrayPE will link in the OpenMP version of LibSci when the INTEL flag -qopenmp is used. Stack size limit: The 'ulimit -s unlimited' system stack size setting is required for cray-libsci on all supported Cray platforms. This is typically set as a system default by admin but may otherwise need to be set at runtime. QDWH and KSVD: These packages are currently included for CCE, GNU, and Intel compilers. Non-default dynamic linking: When using a non-default version of cray-libsci with dynamic linking users should set at runtime and at linktime after loading the desired cray-libsci module--or set the equivalent for their linux shell: export LD_LIBRARY_PATH=$CRAY_LD_LIBRARY_PATH:$LD_LIBRARY_PATH Documentation: -------------- See the intro_libsci man page for additional information. See the csmlversion man page for information to display version information on the currently loaded scientific libraries. Modulefile: ----------- module load cray-libsci Installation instructions: -------------------------- LibSci is now packaged into separate compiler specific RPMs to allow rpmbuild to correctly include compiler dependencies. On CLE 5.2: rpm -ihv --prefix=/opt/cray cray-libsci-17.12.1-*-1.201711302012.fa973ac6f35c3.x86_64.rpm On CLE 6.0: rpm -ihv cray-libsci-17.12.1-*-1.201711302012.fa973ac6f35c3.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version: On CLE 5.2, execute /opt/cray/admin-pe/set_default_files/set_default_libsci_17.12.1 On CLE 6.0, execute /opt/cray/pe/admin-pe/set_default_files/set_default_libsci_17.12.1 The csmlversion RPM is now packaged with the LibSci distribution. On CLE 5.2: rpm -ihv --prefix=/opt/cray csmlversion-1-3.x86_64.rpm On CLE 6.0: rpm -ihv csmlversion-1-3.x86_64.rpm csmlversion does not have a module file so the last installed version is the only version available. License: -------- Except for the third party modules and software licensed by Cray through proprietary agreements, components, files or programs contained within this package or product are Copyright 2001-2017 Cray Inc. All rights reserved. Attribution notices for open source licensed software contained in this package are detailed in the file: /opt/cray/libsci/17.12.1/ATTRIBUTIONS_libsci17.12.1.txt ################################################################################ Cray Message Passing Toolkit 7.7.0: ======================================= Release Date: ------------- December 07, 2017 Purpose: -------- The following features were added to MPT 7.7.0 over MPT 7.6.3: - Cray MPI one-sided has been improved. The MPI_Win_lock and MPI_Win_lock_all routines now take into account the MPI_MODE_NOCHECK assert value. Specifically, when MPI_MODE_NOCHECK is specified, passive synchronization functions will only establish communication epochs and complete messages, but will not provide mutual exclusion. - Several changes to the MPI-IO area of Cray MPI were made. The default for romio_ds_write was changed to "automatic" instead of "disable" and data sieving improvements were also made which increases MPI-IO performance when the user data are small chunks of non-contiguous data shared across a large number of ranks. To set the data sieving write behavior to match previous release, set "MPICH_MPIIO_HINTS=*:romio_ds_write=disable". Another MPI-IO change was improving the lock ahead lock mode for Lustre file systems when sequential access of large amounts of data were being performed. - Cray SHMEM has been improved in include a number of features for the OpenShmem 1.4 draft standard. See the intro_shmem man page for more information. The changes include the following: * Expand support for typed RMA and AMO routines to include exact-width integer types as defined in stdint.h by C99 - 7.18.1.1 and C11 - 7.20.1.1. * Deprecate existing AMO routines and added support for the shmem_atomic_* prefixed routines. * Added support for fetching and non-fetching bitwise AND, OR and XOR atomic operations. * Added support for the shmem_calloc routine. * Deprecate support for the existing shmem_wait() routines and adding support for the new shmem_test() routines for non-blocking point-to-point synchronization. * Added support for SHMEM_SYNC_SIZE constants and deprecated support for all SMA_ prefixed environmental variables with SHMEM_ prefixed environmental variables. In addition, the following features were added in MPT updates since the MPT 7.6.0 release in June 2017: * Cray MPI has been optimized to improve network communication bandwidth performance for the Intel Skylake processor. Two new environment variables have also been added to allow finer control over network bandwidth protocol. See the MPICH_GNI_GET_MAXSIZE and MPICH_GNI_MAX_PENDING_GETS environment variables in the intro_mpi man page for more information. Performance improvements of up to 22% have been seen when running with more than 8 ranks per node. * Improved support for hugepages in Cray MPICH and Cray SHMEM by allowing larger page sizes including 1G and 2G. This feature is available on CLE versions starting from CLE 6.0.UP05. The following bugs were fixed since the MPT 7.6.3 release: - CAST-7067 fix for bcastlength test from MPICH test suite - Misc. fixes for multithreaded RMA - Misc. fixes involving Cray SHMEM all-reduce operations In addition, the following bugs were fixed since the MPT 7.6.0 release in June 2017: * CAST-15916 - Fix for a deadlock issue in MPI_Win_lock/unlock * Fix for segfault in MPI_Init for Cray MPI one-sided when running on CLE 6.0 * Fix for bug 849255 in Cray MPICH that was causing MPI to silently fall back to 4K base pages when hugepages are not mounted. * Fix for a bug in MPI-3 RMA to correctly detect and handle FMA handle exhaustion. Product and OS Dependencies: ---------------------------- The Cray MPT 7.7.0 release is supported on the following Cray systems: * Cray XC systems with CLE version 5.2 or later Product and OS Dependencies by network type: ------------------------------------------------------------------------------------+ | Gemini (XE) | Aries (XC30) | --------------------------+---------------------------+---------------------------+ craype | >= 2.4.0 | >= 2.4.0 | --------------------------+---------------------------+---------------------------+ pmi | >= 5.0.4 | >= 5.0.4 | --------------------------+---------------------------+---------------------------+ cray-libugni | >= 5.0 | >= 5.0 | --------------------------+---------------------------+---------------------------+ cray-libugni-devel | >= 5.0 | >= 5.0 | --------------------------+---------------------------+---------------------------+ cray-libudreg | >= 2.3.2 | >= 2.3.2 | --------------------------+---------------------------+---------------------------+ cray-libudreg-devel | >= 2.3.2 | >= 2.3.2 | --------------------------+---------------------------+---------------------------+ cray-libxpmem | >= 0.1 | >= 0.1 | --------------------------+---------------------------+---------------------------+ cray-libxpmem-devel | >= 0.1 | >= 0.1 | --------------------------+---------------------------+---------------------------+ cray-libdmapp | >= 4.0.1 | >= 7.0.1 | --------------------------+---------------------------+---------------------------+ cray-libdmapp-devel | >= 4.0.1 | >= 7.0.1 | --------------------------+---------------------------+---------------------------+ alps | default | default | --------------------------+---------------------------+---------------------------+ One or more compilers: * CCE 8.6 or later * PGI 15.3 or later * GNU 4.9 or later * Intel 16.0 or later Documentation: -------------- For more information see the intro_mpi and intro_shmem man pages. Modulefile: ----------- module load cray-mpich/7.7.0 Installation: ------------- On CLE 5.2: rpm -ivh --prefix=/opt/cray cray-mpt-7.7.0-*-201711291545.40259d59c6a15-0.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version, execute: /opt/cray/admin-pe/set_default_files/set_default_mpt_7.7.0 On CLE 6.0 or later: rpm -ivh cray-mpt-7.7.0-*-201711291545.40259d59c6a15-0.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version, execute: /opt/cray/pe/admin-pe/set_default_files/set_default_mpt_7.7.0 Certain components, files or programs contained within this package or product are Copyright 2007-2017 Cray Inc. All rights reserved. ################################################################################ cray-netcdf ================= Purpose: -------- New netCDF-C Release Product and OS Dependencies: ---------------------------- The NetCDF release is supported on the following Cray systems: * Cray XE, XK and XC systems with CLE 5.2 or later The NetCDF 4.4.1.1.6 release requires the following software products: One or more compilers: CCE 8.6 or later GCC 4.9 GCC 5.1 Intel 16.0 or later PGI 15.3 or later For Cray XE, XC, XC systems: CrayPE 2.1.2 or later Notes and Limitations: --------------------- Unidata now packages Netcdf-4 and legacy netcdf-3 separately. Cray has decided not to continue supplying the legacy Netcdf-3 package. Due to CCE changes a version of netcdf built with "-sreal64" is neither needed nor provided. NetCDF is supported on the host CPU but not on the accelerator on Cray XC and XK systems. Documentation: -------------- http://www.unidata.ucar.edu/software/netcdf/docs Modulefile: ----------- module load cray-netcdf OR module load cray-netcdf-hdf5parallel Product description: -------------------- NetCDF (network Common Data Form) is a set of interfaces for array-oriented data access and a freely-distributed collection of data access libraries for C, Fortran, C++, Java, and other languages. The netCDF libraries support a machine-independent format for representing scientific data. Together, the interfaces, libraries, and format support the creation, access, and sharing of scientific data. Installation: ------------- Installation instructions for CLE 6.0 and later: ================================================ rpm -ivh cray-netcdf-4.4.1.1.6-*.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version, execute: /opt/cray/pe/admin-pe/set_default_files/set_default_netcdf_4.4.1.1.6 Installation instructions for CLE 5.2: ============================================= rpm -ivh --prefix=/opt/cray cray-netcdf-4.4.1.1.6-*.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version, execute: /opt/cray/admin-pe/set_default_files/set_default_netcdf_4.4.1.1.6 Certain components, files or programs contained within this package or product are Copyright -2017 Cray Inc. All rights reserved. ################################################################################ papi ================= Purpose: -------- New version of papi 5.5.1.4 Product and OS Dependencies: ---------------------------- The papi release is supported on on the following Cray systems: * Cray XE, XK and XC systems with CLE 5.2 or later. Documentation: -------------- Overview: https://bitbucket.org/icl/papi Web Site: http://icl.utk.edu/papi Modulefile: ----------- module load papi Product description: -------------------- PAPI aims to provide the tool designer and application engineer with a consistent interface and methodology for use of the performance counter hardware found in most major microprocessors. PAPI enables software engineers to see, in near real time, the relation between software performance and processor events. Installation instructions: -------------------------- Installation of PAPI for CLE 5.2: --------------------------------- rpm -ivh --prefix=/opt/cray cray-papi-5.5.1.4-5.x86_64.rpm To make this the default version, execute: /opt/cray/admin-pe/set_default_files/set_default_papi_5.5.1.4 Installation of PAPI for CLE 6 and later: ----------------------------------------- rpm -ivh cray-papi-5.5.1.4-5.x86_64.rpm To make this the default version, execute: /opt/cray/pe/admin-pe/set_default_files/set_default_papi_5.5.1.4 Certain components, files or programs contained within this package or product are Copyright -2016 Cray Inc. All rights reserved. ################################################################################ Cray PE ML Plugin 1.0.0: ======================================= Release Date: ------------- December 14, 2017 Purpose: -------- Initial release. Product and OS Dependencies: ---------------------------- The Cray PE ML Plugin 1.0.0 release is supported on the following Cray systems: * Cray XC systems Product and OS Dependencies by network type: --------------------------------------------------------- | Aries (XC) | --------------------------+---------------------------+ cray-mpich | < 7.6.0 | --------------------------+---------------------------+ Documentation: -------------- For more information see the intro_ml_plugin man pages. Modulefile: ----------- module load craype-ml-plugin/1.0.0 Certain components, files or programs contained within this package or product are Copyright 2007-2017 Cray Inc. All rights reserved. ################################################################################ Cray PE ML Plugin 1.0.1: ======================================= Release Date: ------------- December 14, 2017 Purpose: -------- The following bugs were fixed since the CPE ML Plugin 1.0.0 release: o MPT dependency updated from MPT < 7.6.0 to MPT >= 7.6.0 Product and OS Dependencies: ---------------------------- The Cray PE ML Plugin 1.0.1 release is supported on the following Cray systems: * Cray XC systems Product and OS Dependencies by network type: --------------------------------------------------------- | Aries (XC) | --------------------------+---------------------------+ cray-mpich | >= 7.6.0 | --------------------------+---------------------------+ Documentation: -------------- For more information see the intro_ml_plugin man pages. Modulefile: ----------- module load craype-ml-plugin/1.0.1 Certain components, files or programs contained within this package or product are Copyright 2007-2017 Cray Inc. All rights reserved. ################################################################################ PETSc 3.7.6.2 ============= Release Date: ------------- December 14, 2017 Purpose: -------- The Cray PETSc 3.7.6.2 release is supported on Cray XE/XK series systems. Cray PETSc is supported on the host CPU but not on the accelerator of Cray XE/XK series systems. The Cray PETSc 3.7.6.2 release is based on the official patch release of PETSc 3.7.6 by Argonne National Laboratory. For further information about the PETSc 3.7.6 release, see http://www.mcs.anl.gov/petsc/documentation/changes/37.html The Cray PETSc 3.7.6.2 release provides the following: * Support for Cray HDF5 1.10.1.1 Bugs Closed with Cray PETSc 3.7.6.2: ------------------------------------ CAST-16178 openmp flags in craypetsc and cray-trilinos set by default Product and OS Dependencies: ---------------------------- The Cray PETSc 3.7.6.2 release is supported on the following Cray systems: * Cray XC/XK systems with CLE 5.2 or later. The Cray PETSc 3.7.6.2 release requires the following software products: For Cray XE/XK series systems: CrayPE 2.1.2 or later Libsci 13.0.0 or later TPSL 17.06.1 or later MPT 7.6.0 or later HDF5 1.10.1.1 One or more compilers: CCE 8.6.0 or later GCC 4.9.0 or later GCC 5.1.0 or later Intel 16.0.3.210 or later PGI 15.3.0 or later Documentation: -------------- http://www.mcs.anl.gov/petsc/documentation/index.html See the intro_petsc man page for additional information. Modulefile: ----------- module load cray-petsc module load cray-petsc-complex module load cray-petsc-64 module load cray-petsc-complex-64 Installation instructions: -------------------------- On CLE 5.2: rpm -ivh --prefix=/opt/cray cray-petsc-3.7.6.2-*-.x86_64.rpm On CLE 6.0: rpm -ivh cray-petsc-3.7.6.2-*-.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version, on CLE 5.2 execute /opt/cray/admin-pe/set_default_files/set_default_petsc_3.7.6.2 on CLE 6.0 execute /opt/cray/pe/admin-pe/set_default_files/set_default_petsc_3.7.6.2 License: -------- Except for the third party modules and software licensed by Cray through proprietary agreements, components, files or programs contained within this package or product are Copyright 2001-2016 Cray Inc. All rights reserved. Attribution notices for open source licensed software contained in this package are detailed in the file: /opt/cray/petsc/3.7.6.2/ATTRIBUTIONS_petsc3.7.6.2.txt ################################################################################ cray-python 2.7.13.1 =================== Release Date: ------------- December 14, 2017 Purpose: -------- The cray-python 2.7.13.1 release contains python 2.7.13 numpy 1.11.3 scipy 0.19.0 mpi4py 2.0.0 dask 0.14.3 The numpy and scipy packages are configured to call cray-libsci routines. The mpi4py package is configured to call cray-mpt routines. Product and OS Dependencies: ---------------------------- The cray-python 2.7.13.1 release is supported on Cray XC systems with CLE 6.0 and higher. Documentation: -------------- https://www.python.org/doc Modulefile: --------------------- module load cray-python/2.7.13.1 Installation: ------------- rpm -ihv cray-python-2.7.13.1-201711291942.df361259d634a-08.sles12.x86_64.rpm To make this the default version, execute: /opt/admin-pe/set_default_files/set_default_python_2.7.13.1 Certain components, files or programs contained within this package or product are Copyright -2017 Cray Inc. All rights reserved. ################################################################################ cray-python 3.6.1.1 =================== Release Date: ------------- December 14, 2017 Purpose: -------- The cray-python 3.6.1.1 release contains python 3.6.1 numpy 1.11.3 scipy 0.19.0 mpi4py 2.0.0 dask 0.14.3 The numpy and scipy packages are configured to call cray-libsci routines. The mpi4py package is configured to call cray-mpt routines. Product and OS Dependencies: ---------------------------- The cray-python 3.6.1.1 release is supported on Cray XC systems with CLE 6.0 and higher. Documentation: -------------- https://www.python.org/doc Modulefile: --------------------- module load cray-python/3.6.1.1 Installation: ------------- rpm -ihv cray-python-3.6.1.1-201711291942.df361259d634a-08.sles12.x86_64.rpm To make this the default version, execute: /opt/admin-pe/set_default_files/set_default_python_3.6.1.1 Certain components, files or programs contained within this package or product are Copyright -2017 Cray Inc. All rights reserved. ################################################################################ Cray Message Passing Toolkit 7.7.0 ================================== SNP Launcher 7.7.0 ================= Release Date: -------------- December 07, 2017 Purpose: -------- The Single Node Parallel (SNP) Launcher allows a user to launch single node MPI applications on Service MAMU nodes. Please see the CLE documentation for further information about Service MAMU nodes. Product and OS Dependencies: ---------------------------- The Cray SNP Launcher 7.7.0 release is supported on the following Cray systems: - Cray XC systems with CLE version 5.2 or later Product and OS Dependencies by network type: -------------------------------------------------------+ | Aries (XC30) | --------------------------+---------------------------+ craype | >= 2.4.0 | --------------------------+---------------------------+ pmi | >= 5.0.4 | --------------------------+---------------------------+ cray-libugni | >= 5.0 | --------------------------+---------------------------+ cray-libugni-devel | >= 5.0 | --------------------------+---------------------------+ cray-libudreg | >= 2.3.2 | --------------------------+---------------------------+ cray-libudreg-devel | >= 2.3.2 | --------------------------+---------------------------+ cray-libxpmem | >= 0.1 | --------------------------+---------------------------+ cray-libxpmem-devel | >= 0.1 | --------------------------+---------------------------+ cray-libdmapp | >= 7.0.1 | --------------------------+---------------------------+ cray-libdmapp-devel | >= 7.0.1 | --------------------------+---------------------------+ alps | default | --------------------------+---------------------------+ One or more compilers: CCE 8.6 or later PGI 15.3 or later GNU 4.9 or later Intel 16.0 or later Documentation: -------------- For more information see the mpiexec(1) man page after loading the cray-snplauncher module. Installation: ------------ rpm -ivh cray-snplauncher-7.7.0-.40259d59c6a15-0.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version, execute: /opt/cray/admin-pe/set_default_files/set_default_cray-snplauncher_7.7.0 Certain components, files or programs contained within this package or product are Copyright 2007-2015 Cray Inc. All rights reserved. =================================================================== To re-display cray-snplauncher/7.7.0 copyright information, type: less /opt/cray/snplauncher/7.7.0/COPYRIGHT To re-display cray-snplauncher/7.7.0 release information, type: less /opt/cray/snplauncher/7.7.0/release_info =================================================================== ################################################################################ Release Date: December 07, 2017 Purpose: -------- - This package includes the 2017.3.8 release of the Totalview Technologies debugger. - Add support for 'totalview-support' on CLE-5.2 and CLE-6.0 systems. Changes: -------- Installation: ------------- rpm -ivh cray-totalview-2017.3.8-totalview-support-1.2.0.16-1.x86_64.rpm To make this the default version, execute: /opt/admin-pe/set_default_files/set_default_totalview_2017.3.8 /opt/admin-pe/set_default_files/set_default_totalview-support_1.2.0.16 TotalView 2017.3.8 new features can be found at: /opt/totalview/2017.3.8/doc/pdf/TotalView_New_Features.pdf ################################################################################ Third Party Scientific Libraries 17.11.1 ====================================== Release Date: ------------- November 2, 2017 Purpose: -------- The TPSL 17.11.1 release is supported on Cray XE/XK series systems. TPSL is supported on the host CPU but not on the accelerator of Cray systems. The TPSL 17.11.1 release provides the following: * MUMPS upgrade to version 5.1.1, with limited 64-bit integer support * HYPRE upgrade to version 5.11.2 * Support for cray-mpich 7.6.0 * Support for CCE 8.6 * Support for Intel Xeon processor Scalable family TPSL (Third Party Scientific Libraries) contains a collection of mathematical libraries that can be used with PETSc and Trilinos. This module increases the flexibility of PETSc and Trilinos by providing users with multiple options for solving problems in dense and sparse linear algebra. The cray-tpsl module is automatically loaded when PETSc or Trilinos is loaded. The libraries included are MUMPS, SuperLU, SuperLU_DIST, METIS, ParMETIS, HYPRE, SUNDIALS, Scotch, matio, and GLM. The libraries included in cray-tpsl-64 are SuperLU_DIST, METIS, ParMETIS, HYPRE, SUNDIALS, and Scotch. * MUMPS 5.1.1. MUMPS (MUltifrontal Massively Parallel sparse direct Solver) is a package of parallel, sparse, direct linear-system solvers based on a multifrontal algorithm. MUMPS can interface with SCOTCH as well. For further information, see http://graal.ens-lyon.fr/MUMPS/. * SuperLU 5.2.1. SuperLU is a sequential version of SuperLU_DIST and a sequential incomplete LU preconditioner that can accelerate the convergence of Krylov subspace iterative solvers. For further information, see http://crd.lbl.gov/~xiaoye/SuperLU/. * SuperLU_DIST 5.1.3. SuperLU_DIST is a package of parallel, sparse, direct linear-system solvers. For further information, see http://crd.lbl.gov/~xiaoye/SuperLU/. * METIS 5.1.0. METIS is a set of serial programs for partitioning graphs, partitioning finite element meshes, and producing fill reducing orderings for sparse matrices. For further information, see http://glaros.dtc.umn.edu/gkhome/views/metis * ParMETIS 4.0.2. ParMETIS (Parallel Graph Partitioning and Fill-reducing Matrix Ordering) is a library of routines that partition unstructured graphs and meshes and compute fill-reducing orderings of sparse matrices. For further information, see http://glaros.dtc.umn.edu/gkhome/views/metis. * HYPRE 2.11.2. HYPRE is a library of high-performance preconditioners that use parallel multigrid methods for both structured and unstructured grid problems (not included with petsc-complex). For further information, see http://www.llnl.gov/CASC/linear_solvers/. * SUNDIALS 2.7.0 (SUite of Nonlinear and DIfferential/Algebraic equation Solvers) consists of 6 solvers: ARKODE, CVODE, CVODES, IDA, IDAS, and KINSOL. In addition, SUNDIALS provides a MATLAB interface to CVODES, IDAS, and KINSOL that is called sundialsTB. For further information, see https://computation.llnl.gov/casc/sundials/main.html. * Scotch 6.0.4. Scotch is a software package and libraries for sequential and parallel graph partitioning, static mapping, sparse matrix block ordering, and sequential mesh and hypergraph partitioning. For further information, see http://www.labri.fr/perso/pelegrin/scotch. * matio 1.5.2. matio is a C library for reading and writing Matlab MAT files. NOTE: Matlab 7 (or later) is not supported by matio 1.5.2. For further information, see http://sourceforge.net/projects/matio/. * GLM 0.9.6.3: OpenGL Mathematics (GLM) is a header only C++ mathematics library for graphics software based on the OpenGL Shading Language (GLSL) specifications, which it extends with matrix transformations, quaternions, data packing, random numbers, noise, etc. For further information, see http://glm.g-truc.net/0.9.6/index.html Product and OS Dependencies: ---------------------------- The Cray TPSL 17.11.1 release is supported on the following Cray systems: * Cray XE/XK systems with CLE 5.2 or later. The Cray TPSL 17.11.1 release requires the following software products: For Cray XE/XK series systems: craype 2.1.2 or later cray-libsci 13.0.0 or later MPT 7.6.0 or later One or more compilers: CCE 8.6.0 or later GCC 4.9.0 or later GCC 5.1.0 or later Intel 16.0.3.210 or later PGI 15.3.0 or later Documentation: -------------- http://graal.ens-lyon.fr/MUMPS/ http://crd.lbl.gov/~xiaoye/SuperLU/ http://glaros.dtc.umn.edu/gkhome/views/metis/ http://www.llnl.gov/CASC/linear_solvers/ https://computation.llnl.gov/casc/sundials/main.html http://www.labri.fr/perso/pelegrin/scotch/ http://sourceforge.net/projects/matio/ Modulefile: ----------- module load cray-tpsl module load cray-tpsl-64 Installation instructions: -------------------------- On CLE 5.2: rpm -ivh --prefix=/opt/cray cray-tpsl-17.11.1-*-.x86_64.rpm On CLE 6.0: rpm -ivh cray-tpsl-17.11.1-*-.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version, on CLE 5.2, execute /opt/cray/admin-pe/set_default_files/set_default_tpsl_17.11.1 on CLE 6.0, execute /opt/cray/pe/admin-pe/set_default_files/set_default_tpsl_17.11.1 License: -------- Attribution notices for open source licensed software contained in this package are detailed in the file: /opt/cray/tpsl/17.11.1/ATTRIBUTIONS_tpsl17.11.1.txt Certain components, files, or programs contained within this package or product are Copyright 2011-2017 Cray Inc. All rights reserved. ################################################################################ Trilinos 12.10.1.2 ================= Release Date: ------------- December 14, 2017 Purpose: -------- The Cray Trilinos 12.10.1.2 release is supported on Cray XC series systems. Cray Trilinos is supported on the host CPU but not on the accelerator of Cray XC series systems. The Cray Trilinos 12.10.1.2 is based on the official release of Trilinos 12.10.1 by Sandia National Laboratories. For further information about the Trilinos 12.10.1 release, see http://trilinos.org/oldsite/release_notes-12.10.html The Cray Trilinos 12.10.1.2 release provides the following: * Support for Cray HDF5 1.10.1.1 * Support for Cray Netcdf 4.4.1.1.6. Bugs Closed with Cray Trilinos 12.10.1.2: ----------------------------------------- CAST-16178 openmp flags in craypetsc and cray-trilinos set by default Product and OS Dependencies: ---------------------------- The Cray Trilinos 12.10.1.2 release is supported on the following Cray systems: * Cray XC systems with CLE 5.2 or later. The Cray Trilinos 12.10.1.2 release requires the following software products: For Cray XC series systems: CrayPE 2.1.2 or later cray-libsci 16.03.1 or later TPSL 17.06.1 or later MPT 7.6.0 or later NetCDF 4.4.1.1.6 HDF5 1.10.1.1 One or more of the following major compiler versions: CCE 8.6 or later GCC 4.9 or later Intel 16 or later Notes and Limitations: ---------------------- When using Cray Trilinos 12.10.1.2 with PrgEnv-intel, users must load a gcc module >= 4.9.0 for C++11 support. See Bug 836679. Documentation: -------------- For a list of Trilinos documentation, go to http://trilinos.org/about/documentation/ To see descriptions of each individual Trilinos package, go to http://trilinos.org/packages See the intro_trilinos man page for additional information. Modulefile: ----------- module load cray-trilinos Installation instructions: -------------------------- On CLE 5.2: rpm -ivh --prefix=/opt/cray cray-trilinos-12.10.1.2-*-.x86_64.rpm On CLE 6.0: rpm -ivh cray-trilinos-12.10.1.2-*-.x86_64.rpm The "*" in the install command represents compiler version combinations. To make this the default version: on CLE 5.2, execute /opt/cray/admin-pe/set_default_files/set_default_trilinos_12.10.1.2 on CLE 6.0, execute /opt/cray/pe/admin-pe/set_default_files/set_default_trilinos_12.10.1.2 License: ---------- Except for the third party modules and software licensed by Cray through proprietary agreements, components, files or programs contained within this package or product are Copyright 2001-2016 Cray Inc. All rights reserved. Attribution notices for open source licensed software contained in this package are detailed in the file: /opt/cray/trilinos/12.10.1.2/ATTRIBUTIONS_trilinos12.10.1.2.txt ################################################################################ Forge 7.1.0.1 ======== Release Date: ------------- 12/14/2017 Purpose: -------- -Release of Allinea Forge 7.1.0.1 Product and OS Dependencies: ---------------------------- The Cray Forge 7.1.0.1 release is supported on the following Cray systems running Cray Linux Environment(CLE) operating system - Cray XE and Cray XK systems running CLE 5.2 - Cray XC systems with CLE version 5.2 or 6.0 or later Documentation: -------------- http://www.allinea.com/products/ddt-support /opt/allinea/forge/7.1.0.1/doc/RELEASE-NOTES Installation for CLE 5.2: ------------------------- rpm -ivh forge-7.1.0.1-2.sles11.x86_64.rpm To make this the default version, execute: /opt/allinea/forge/7.1.0.1/set_default_forge_7.1.0.1 Certain components, files or programs contained within this package or product are Copyright 2008-2016 Cray Inc. All rights reserved. ################################################################################ Forge 7.1.0.1 ======== Release Date: ------------- 12/14/2017 Purpose: -------- -Release of Allinea Forge 7.1.0.1 Product and OS Dependencies: ---------------------------- The Cray Forge 7.1.0.1 release is supported on the following Cray systems running Cray Linux Environment(CLE) operating system - Cray XE and Cray XK systems running CLE 5.2 - Cray XC systems with CLE version 5.2 or 6.0 or later Documentation: -------------- http://www.allinea.com/products/ddt-support /opt/allinea/forge/7.1.0.1/doc/RELEASE-NOTES Installation for CLE 6.0: ------------------------- rpm -ivh forge-7.1.0.1-2.sles12.x86_64.rpm To make this the default version, execute: /opt/allinea/forge/7.1.0.1/set_default_forge_7.1.0.1 Certain components, files or programs contained within this package or product are Copyright 2008-2016 Cray Inc. All rights reserved. ################################################################################ Perftools 7.0.0 =============== Release Date: December 14, 2017 Purpose: ======== This is a feature and bug fix release for Cray XC and CS/300/400/Storm systems. Key enhancements or changes from the previous release: ====================================================== o pat_report style option that causes the MPICH_RANK_ORDER files to contain a node order o New memory and vector statistics with default report for perftools-lite experiments o Performance improvements for ap2 and report file generation in perftools-lite experiments o Trace wrappers for ZMQ (zeroMQ lightweight messaging kernel library) o Trace wrappers for cURL (data transfer from or to a server using one of many protocols) o Update Chapel trace wrappers to 1.16.0 o Upgrade to PAPI 5.5.1.4 Bugs Fixed: =========== o CAST-3565 - Traffic screendump includes black box where dialog was o CAST-6077 - grid_order command produces no rank ordering output o CAST-7540 - problems with message matching o CAST-17109 - Apprentice2 tooltips do not display when using MobaXterm Xserver on a windows system o CAST-17114 - PerfTools: corrupt XF data for CUDA codes Dependencies: ============= o cdt-prgenv 6.0.4 (perftools-base loaded by default) No longer supported: -------------------- Red Hat(R) Enterprise Linux(R) 6 and CentOS 6 on CS/300/400/Storm systems Cray XC systems running CLE 6 ----------------------------- o craype 2.5.13 o papi/5.5.1.4 o One or more compilers running these minimum versions: CCE 8.6.5 GCC 4.9, 5.3, 6.3 Intel 17 o Cray Scientific Libraries (LibSci) 17.12 o LibSci_ACC 17.03.1 for Cray XC systems with GPUs o Cray MPT 7.7.0 o CUDA 8.0 (including cudatoolkit) on Cray XC systems with GPUs o Chapel 1.16.0 Cray CS Systems: ---------------- o CCE 8.6.5 o papi/5.5.1.4 o libsci 17.12 o libsci_acc 17.03.1 o craype 2.5.13 o CUDA 8.0 (including cudatoolkit) on Cray CS systems with GPUs o mvapich 2.2rc1.0.3 Non-Cray systems: ------------------ Apprentice2 is supported on non-Cray systems running: o Windows 7 (for the desktop version of Cray Apprentice2) o Mac OS X 10.11.6 or later Documentation: ============== Installation instructions: ========================== For Cray XC systems, see the "Cray Programming Environments Installation Guide" for more information. Installation of perftools for CLE 6 and later: ---------------------------------------------- rpm -ivh cray-dwarf-17.2.0-201710122036.6a0004974a8f4-1.sles12.x86_64.rpm rpm -ivh perftools-7.0.0-201712090452.5c29ce28a8c0e-3.sles11.x86_64.rpm To make perftools/7.0.0 the default version of perftools, execute: /opt/cray/pe/admin-pe/set_default_files/set_default_perftools_7.0.0 Installation of PAPI for CLE 6 and later: ----------------------------------------- rpm -ivh cray-papi-5.5.1.4-201711292252.4be8d5444d10d-5.sles12.x86_64.rpm To make PAPI 5.5.1.4 the default version of PAPI, execute: /opt/cray/pe/admin-pe/set_default_files/set_default_papi_5.5.1.4 Installation of perftools for Cray CS/300/400/Storm --------------------------------------------------- See Installing the Cray Programming Environment for the Cray CS Systems for instructions. Installation of app2 remote client (+ server) on Mac systems: ------------------------------------------------------------- Apprentice2Installer-7.0.0-3.sles11.dmg The Cray Apprentice2 installer for Mac is included in the perftools-clients rpm, and placed in $CRAYPAT_ROOT/share/desktop_installers/ on a Cray login node when the perftools-clients rpm is installed. Download the Cray Apprentice2 installer onto a desktop or laptop running Mac OS. Double click on installer to begin installation. The installer will walk you through the process for your system. Installation of app2 remote client (+ server) on Windows 7 systems: ------------------------------------------------------------------- Apprentice2Installer-7.0.0-3.sles11.exe The Cray Apprentice2 installer for Windows is included in the perftools-clients rpm, and placed in $CRAYPAT_ROOT/share/desktop_installers/ on a Cray login node when the perftools-clients rpm is installed. Download the Cray Apprentice2 installer onto a desktop or laptop running Windows 7. Double click on installer to begin installation. The installer will walk you through the process for your system. Documentation: -------------- License: Except for the third party modules discussed below and software licensed by Cray through proprietary agreements, components, files or programs contained within this package or product are Copyright 2001-2017 Cray Inc. All rights reserved. Attribution notices for open source licensed software contained in this package are detailed in the file: $CRAYPAT_ROOT/ATTRIBUTIONS_perftools.txt ################################################################################ Perftools 7.0.0 =============== Release Date: December 14, 2017 Purpose: ======== This is a feature and bug fix release for Cray XC and CS/300/400/Storm systems. Key enhancements or changes from the previous release: ====================================================== o pat_report style option that causes the MPICH_RANK_ORDER files to contain a node order o New memory and vector statistics with default report for perftools-lite experiments o Performance improvements for ap2 and report file generation in perftools-lite experiments o Trace wrappers for ZMQ (zeroMQ lightweight messaging kernel library) o Trace wrappers for cURL (data transfer from or to a server using one of many protocols) o Update Chapel trace wrappers to 1.16.0 o Upgrade to PAPI 5.5.1.4 Bugs Fixed: =========== o CAST-3565 - Traffic screendump includes black box where dialog was o CAST-6077 - grid_order command produces no rank ordering output o CAST-7540 - problems with message matching o CAST-17109 - Apprentice2 tooltips do not display when using MobaXterm Xserver on a windows system o CAST-17114 - PerfTools: corrupt XF data for CUDA codes Dependencies: ============= o cdt-prgenv 6.0.4 (perftools-base loaded by default) No longer supported: -------------------- Red Hat(R) Enterprise Linux(R) 6 and CentOS 6 on CS/300/400/Storm systems Cray XC systems running CLE 6 ----------------------------- o craype 2.5.13 o papi/5.5.1.4 o One or more compilers running these minimum versions: CCE 8.6.5 GCC 4.9, 5.3, 6.3 Intel 17 o Cray Scientific Libraries (LibSci) 17.12 o LibSci_ACC 17.03.1 for Cray XC systems with GPUs o Cray MPT 7.7.0 o CUDA 8.0 (including cudatoolkit) on Cray XC systems with GPUs o Chapel 1.16.0 Cray CS Systems: ---------------- o CCE 8.6.5 o papi/5.5.1.4 o libsci 17.12 o libsci_acc 17.03.1 o craype 2.5.13 o CUDA 8.0 (including cudatoolkit) on Cray CS systems with GPUs o mvapich 2.2rc1.0.3 Non-Cray systems: ------------------ Apprentice2 is supported on non-Cray systems running: o Windows 7 (for the desktop version of Cray Apprentice2) o Mac OS X 10.11.6 or later Documentation: ============== Installation instructions: ========================== For Cray XC systems, see the "Cray Programming Environments Installation Guide" for more information. Installation of perftools for CLE 6 and later: ---------------------------------------------- rpm -ivh cray-dwarf-17.2.0-201710122036.6a0004974a8f4-1.sles12.x86_64.rpm rpm -ivh perftools-7.0.0-201712090452.5c29ce28a8c0e-3.sles12.x86_64.rpm To make perftools/7.0.0 the default version of perftools, execute: /opt/cray/pe/admin-pe/set_default_files/set_default_perftools_7.0.0 Installation of PAPI for CLE 6 and later: ----------------------------------------- rpm -ivh cray-papi-5.5.1.4-201711292252.4be8d5444d10d-5.sles12.x86_64.rpm To make PAPI 5.5.1.4 the default version of PAPI, execute: /opt/cray/pe/admin-pe/set_default_files/set_default_papi_5.5.1.4 Installation of perftools for Cray CS/300/400/Storm --------------------------------------------------- See Installing the Cray Programming Environment for the Cray CS Systems for instructions. Installation of app2 remote client (+ server) on Mac systems: ------------------------------------------------------------- Apprentice2Installer-7.0.0-3.sles12.dmg The Cray Apprentice2 installer for Mac is included in the perftools-clients rpm, and placed in $CRAYPAT_ROOT/share/desktop_installers/ on a Cray login node when the perftools-clients rpm is installed. Download the Cray Apprentice2 installer onto a desktop or laptop running Mac OS. Double click on installer to begin installation. The installer will walk you through the process for your system. Installation of app2 remote client (+ server) on Windows 7 systems: ------------------------------------------------------------------- Apprentice2Installer-7.0.0-3.sles12.exe The Cray Apprentice2 installer for Windows is included in the perftools-clients rpm, and placed in $CRAYPAT_ROOT/share/desktop_installers/ on a Cray login node when the perftools-clients rpm is installed. Download the Cray Apprentice2 installer onto a desktop or laptop running Windows 7. Double click on installer to begin installation. The installer will walk you through the process for your system. Documentation: -------------- License: Except for the third party modules discussed below and software licensed by Cray through proprietary agreements, components, files or programs contained within this package or product are Copyright 2001-2017 Cray Inc. All rights reserved. Attribution notices for open source licensed software contained in this package are detailed in the file: $CRAYPAT_ROOT/ATTRIBUTIONS_perftools.txt ################################################################################