FY 2002 User Survey Results: Software


Legend:
SatisfactionAverage Score
Mostly Satisfied5.5 - 6.4
Somewhat Satisfied4.5 - 5.4
 Significance of Change
significant increase
significant decrease
not significant

Satisfaction with Software (sorted by Average Score):

Software Category No. of ResponsesAverage Score  Std. Dev.Change from 2001
PVP Fortran Compilers346.470.71-0.19
PDSF C/C++ Compilers356.460.70 
PDSF Fortran Compilers226.450.74 
T3E Fortran Compilers496.450.840.05
PDSF User Environment396.380.78 
SP Fortran Compilers1416.361.100.40
PDSF Libraries296.240.95 
T3E User Environment546.240.870.06
PDSF Applications296.210.98 
PVP User Environment346.150.78-0.10
T3E Libraries396.130.92-0.05
SP User Environment1656.121.130.05
SP C/C++ Compilers766.111.090.39
SP Libraries1196.091.030.09
T3E C/C++ Compilers256.041.100.11
PDSF General Tools and Utilities286.041.04 
PDSF Bug Resolution246.001.14 
T3E General Tools and Utilities355.970.860.32
PVP C/C++ Compilers145.931.21-0.07
T3E Bug Resolution265.851.080.15
T3E Applications315.841.040.06
SP General Tools and Utilities1135.801.090.08
T3E Performance and Debugging Tools325.781.070.22
SP Applications905.701.180.03
PVP Libraries285.611.37-0.20
PVP Bug Resolution155.601.240.50
SP Bug Resolution785.591.310.14
PVP General Tools and Utilities215.571.25-0.36
SP Performance and Debugging Tools1125.491.280.80
PVP Applications165.441.59-0.39
PVP Performance and Debugging Tools185.331.57-0.73
PDSF Performance and Debugging Tools285.251.65 

Satisfaction with Software (sorted by Platform):

Software Category No. of ResponsesAverage Score  Std. Dev.Change from 2001
SP Fortran Compilers1416.361.100.40
SP User Environment1656.121.130.05
SP C/C++ Compilers766.111.090.39
SP Libraries1196.091.030.09
SP General Tools and Utilities1135.801.090.08
SP Applications905.701.180.03
SP Bug Resolution785.591.310.14
SP Performance and Debugging Tools1125.491.280.80
PDSF C/C++ Compilers356.460.70 
PDSF Fortran Compilers226.450.74 
PDSF User Environment396.380.78 
PDSF Libraries296.240.95 
PDSF Applications296.210.98 
PDSF General Tools and Utilities286.041.04 
PDSF Bug Resolution246.001.14 
PDSF Performance and Debugging Tools285.251.65 
T3E Fortran Compilers496.450.840.05
T3E User Environment546.240.870.06
T3E Libraries396.130.92-0.05
T3E C/C++ Compilers256.041.100.11
T3E General Tools and Utilities355.970.860.32
T3E Bug Resolution265.851.080.15
T3E Applications315.841.040.06
T3E Performance and Debugging Tools325.781.070.22
PVP Fortran Compilers346.470.71-0.19
PVP User Environment346.150.78-0.10
PVP C/C++ Compilers145.931.21-0.07
PVP Libraries285.611.37-0.20
PVP Bug Resolution155.601.240.50
PVP General Tools and Utilities215.571.25-0.36
PVP Applications165.441.59-0.39
PVP Performance and Debugging Tools185.331.57-0.73


Comments about Software:   26 responses

9   Debuggers / performance analysis and other tools
9   Unix environment (shells, editors, GNU, modules)
6   Compilers
6   Applications (math, viz, chemistry)
3   Satisfied
1   Libraries

Debuggers / performance analysis and other tools:

The present default version of Totalview on the IBM SP does not work correctly with our code, making debugging very difficult. We had been using the previous version, which did work but is no longer available. We would be very grateful if it were returned to service.

Losing Cray's totalview and debuggers is a real loss as they were very superior to what's available on the Cray's. I also don't like XProfiler too much. ...

... The debugging tool was a bit tricky to use, and I should probably come to one of the classes/training sessions. This would allow me to really use the debugger as a tool.

Totalview runs waaaaay too slow when I run it on seaborg. I think it is slow because my network connection is not fast enough to run such a windows intensive piece of software. I would love it if there was some kind of text based debugger I could use like dbx.

More software tools to analyze results (particularly in the netcdf format) would be very helpful. Tools for performing quick visual checks of model outputs in netcdf format (simple stuff like ncview) are missing. Having some of these tools avaialble on seaborg will cut down on ftping in out of HPSS.

My dissatisfaction with the IBM SP is mostly related to tools and compilers provided by IBM. The ACTS group is making good progress putting together a useful tool set for applications.

I think the software could be expanded to include more modules, including other text editors, graphics programs, debuggers, etc. Of course, this should not compromise the performance of the main machines. If I have to choose, I still prefer performance.

Need to have real debuggers that are GUI. [PDSF user]

I am not aware of debugging utilities on PDSF other than gdb and I find gdb very unsatifying. I had looked for some alternative on the PDSF web pages, but I haven't found any documentation indicating a different way to debug FORTRAN and/or C/C++ code.

NERSC response: There are not many alternatives to gdb on linux. STAR is looking into purchasing Totalview (which has a GUI interface and works well with both gcc and pgf). The licenses are expensive ($5700.00 for 8 floating licenses +20%/year maintenance fee - that is a cost of 1TB of disk vault), but we will consult with all the group representatives to find out whether they are interested in financing it.

Unix environment (shells, editors, GNU, modules):

It would help me enormously if you had emacs or some other text editor other than VI on the log in node. I hate VI and have to do editing locally and do more file transfers than I would like. When debugging, it is useful to make quick changes on the local computer.

... A simple editor would be useful for interacting with users who don't know vi or emacs; e.g., pico is pretty good.

... including other text editors, ...

It would be nice if the default environment setup was a little more user friendly (i.e. due to the ubiquity to emacs as an editor I was shocked that I manually had to load the module on startup, etc.)

... I am happy you have made the GNU packages available and I use them every time I log in.

The environment is extreemly difficult. No command history, the term caps aren't set to common keyboards (no arrow keys for command line). I think that these problems can be fixed if I fiddle with the settings, but it seems that it would make more sence to just include them especiall since most UNIX OS's use them as standard (Linux, Irix, DEC).

hard to know which modules to load -- guessing game

I cannot get a reasonably modern ksh. ... [seaborg user]

cray T3E needs better shell like tcsh

Compilers:

The fortran compiler on seaborg is a bit slow, but overall it is good. ...

Our application seems to perform particularly badly on SP machines, where we typically get around 6% peak floating point performance. We've worked at applying various compiler optimisations, but have not succeeded in improving the performance beyond this limit. This is in contrast to other platforms (ia32, compaq, hitachi) where we typically run at 15-25%.

Current version of IBM FORTRAN compiler has a bug. I reported this, but they don't fix it.

My dissatisfaction with the IBM SP is mostly related to ... and compilers provided by IBM. ...

Compiling and running was really very easy. There are lots of little issues to be uncovered as time has passed, but each has been straighforward. ...

... How about being able to use g++ in parallel? ...

Applications (math, viz, chemistry):

It would be very helpful to have matlab since most of my analysis routines are written in matlab and then I wouldn't have to transfer the data to another machine to analyze it.

matlab on seaborg?

Get matlab (is it already there?)

Some ab initio molecular dynamics code (as VASP) will be helpful

... Need a better DX with more modules.

... other graphics programs ...

Satisfied:

I use mostly IBM and I am very satisfied with software performance on this machine

All software I need is available.

My needs are limited to a C compiler and MPI. Everything I have used has been excellent.

Libraries:

Need lapack and scalapack 64 bit libraries!




Next: Training