ParaView is an open-source, multi-platform data analysis and visualization application. ParaView users can quickly build visualizations to analyze their data using qualitative and quantitative techniques. The data exploration can be done interactively in 3D or programmatically using ParaView's batch processing capabilities. ParaView was developed to analyze extremely large datasets using distributed memory computing resources. It can be run on supercomputers to analyze datasets of terascale as well as on laptops for smaller data.
Remote Visualization with ParaView
ParaView is a client-server application. The ParaView client (or simply paraview) will run on your desktop while the server will run at the remote supercomputing site. The following describes the steps you will take to install ParaView on your desktop and configure it so that you can launch remote-parallel jobs on RDAV systems from within the ParaView GUI. Running ParaView remotely in a client-server configuration involves establishing an ssh tunnel to the login node, lauching the ParaView server, connecting the server to the client over the tunnel via a socket.
Install the ParaView Client
The first step is to install ParaView. It is recommended that you use the binaries provided by Kitware on your workstation matching the NERSC installed version. This ensures client-server compatibility. The version number that you install must identically match the version installed at NERSC. Use the following link to download the correct ParaView client binary version for your desktop environment: ParaView binaries. Version 3.98.1 is currently the recommended version, however versions 3.10.0, 3.12.0, 3.14.0, 3.14.1, 3.98.0, 3.98.1 are installed.
In order to use ParaView remotely you will also need an ssh client and a terminal program. On Linux and Mac these functions are provided by the ssh and xterm programs, both of which should come pre-installed on most Linux and Mac systems. On Windows the ssh and terminal functions are provided by the programs plink.exe and cmd.exe, of which only cmd.exe will come pre-installed. The ssh client, plink.exe, needs to be installed before using ParaView. This program can be installed using the Windows installer from the PuTTY download site. The PuTTY install folder needs to be added to the system path after the install. This can be done in the Windows control panel, by opening "Control Panel\System and Security\System" , opening the "Advanced System Settings" page, and opening the "Environment Variables" dialog box.
Install the NERSC server config
NERSC provides an integrated server configuration that enables "point and click" ssh tunnel configuration, job configuration and submission enabling users to quickly launch the ParaView server on NERSC systems.
- Close any instances of ParaView running on your desktop.
- Download one of the following NERSC server configurations to your workstation. Choose a "win" configuration if you are running a Windows OS. Choose a "unix" configuration if you are running a Mac or Linux OS.
- Open the ParaView client and click the Connect button or from the File menu choose connect. In the choose a server dialog box click the load servers button and select the NERSC server config.
|NERSC System||ParaView Configuration||Recommended Version|
The NERSC server configurations will now show up in ParaView's connect menu.
Configure your account
Ssh is used to create a tunnel from Hopper's MOM nodes to Hopper's liogin nodes. For this process to be automated you will need to setup key based authentication within NERSC. The following commands will do so:
$ ssh firstname.lastname@example.org $ ssh-keygen $ cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
Launching the server on NERSC systems
NOTE: You must load a modulefile to use the software at NERSC. On Carver the modulefile is 'paraview' (module load paraview) and on Hopper it is 'ParaView' (module load ParaView).
With the ParaView client and NERSC server configuration installed one can quickly establish connection to NERSC systems and launch interactive vis jobs.
- Start ParaView on you desktop
- Open the File->Connect menu
- Select a server (Euclid, Franklin, Hopper or Carver) and click Connect
- Configure the job with number of CPUs, walltime and so on. Click Connect to submit the job.
- In the xterm that opens enter your password. This creates the ssh tunnel to the remote system and submits the job.
After a brief wait the newly launched ParaView server will connect back to you desktop. One common issue for Mac users is that ParaView does not find the xterm program. When this occurs, the ParaView client reports "The process failed to start. Either the invoked program is missing...". This is resolved by locating the full path to the xterm program in step 4 above.
If you are connecting over a consumer broadband connection you may get a speed up by using Zlib compression. To enable this option, open Edit->Settings->Render View->Server, set (A) Remote Render Threshold checked 0 MBytes , and select (F) Apply presets for consumer broadband/dsl.
See also this.
Running in Batch Mode
In batch mode the ParaView server runs on its own without a client executing a python script. Batch mode provides a way to automate common visualization tasks and alieviates the necessety of being present when the job executes. Login to the desired system, and submit your job using the batch startup script. For example on Hopper the sequence of command would be:
$ module load ParaView
$ start_pvbatch.sh 4 4 00:30:00 default debug `pwd`/pvbatch-test.py
For more information execute start_pvbatch.sh with no command line arguments and an explanation of the required command line argumnets will be printed.
Example ParaView Batch Python Script
The following ParaView batch script renders a sphere colored by MPI Rank. It can be used for basic testing.
from paraview.simple import *
s = Sphere()
s.ThetaResolution = 128
s.PhiResolution = 128
p = ProcessIdScalars()
rep = Show(p)
lr = p.PointData.GetArray("ProcessId").GetRange()
lut = GetLookupTableForArray("ProcessId",
RGBPoints=[lr, 0.0, 0.0, 1.0, lr, 1.0, 0.0, 0.0],
rep.ColorArrayName = 'ProcessId'
rep.LookupTable = lut
ParaView home page. http://www.ParaView.org