NERSCPowering Scientific Discovery Since 1974

DLFM library tools for large scale dynamic applications

Large scale Python and other dynamic applications may spend huge time at startup. The DLFM library, developed by Mike Davis at Cray, Inc., is a set of functions that can be incorporated into a dynamically-linked application to provide improved performance during the loading of dynamic libraries when running the application at large scale on Edison.  To access this library, do

module load dlfm

Then compile your code using the python available via the dlfm module. To run the DLFM enabled application you need to run in two steps:
  1. Pilot run with small node count, eg., using 2 nodes collect the needed shared libraries and python modules imported
  2. Real run with large number of cores, only one core read in the shared libraries and python imported modules
Please read the user guide to use the tools provided by this library.

 

 

 

 

 

 

 

 

 

 

 

 

This figure shows the startup time for Warp, a python application. With DLFM the code can startup in about 5 minutes with 96K cores! The startup time with 48 cores is the ones without using DLFM for comparison.