NERSCPowering Scientific Discovery for 50 Years

2009/2010 User Survey Results

Services

 Legend:

SatisfactionAverage Score
Very Satisfied 6.50 - 7.00
Mostly Satisfied - High 6.00 - 6.49
Mostly Satisfied - Low 5.50 - 5.99
Somewhat Satisfied 4.50 - 5.49
ImportanceAverage Score
Very Important 2.50 - 3.00
Somewhat Important 1.50 - 2.49
Significance of Change
significant increase
not significant
UsefulnessAverage Score
Very Useful 2.50 - 3.00
Somewhat Useful 1.50 - 2.49

 

Satisfaction with NERSC Services - by Score

7=Very satisfied, 6=Mostly satisfied, 5=Somewhat satisfied, 4=Neutral, 3=Somewhat dissatisfied, 2=Mostly dissatisfied, 1=Very dissatisfied

 

Item Num who rated this item as: Total Responses Average Score Std. Dev. Change from 2009
1 2 3 4 5 6 7
CONSULT: Overall 1
1 5 9 59 212 287 6.64 0.74 0.12
SERVICES: Account support and Passwords 1 1 2 6 12 73 243 338 6.60 0.80 -0.06
CONSULT: Response time 1
2 6 12 61 205 287 6.59 0.80 -0.01
CONSULT: Quality of technical advice

1 7 14 67 190 279 6.57 0.74 0.09
Security

2 11 11 69 202 295 6.55 0.79 0.16
WEB: Status Info

1 5 12 104 181 303 6.51 0.68  
CONSULT: Time to solution 1 1 3 10 23 71 172 281 6.40 0.96 0.01
WEB: NIM web interface 1 1 4 6 25 105 180 322 6.38 0.90 -0.00
WEB: Accuracy of information 1
1 10 16 117 155 300 6.37 0.83 0.05
WEB: www.nersc.gov overall
1 4 3 15 147 150 320 6.35 0.77 0.07
CONSULT: On-line help desk 1 1 1 12 11 34 99 159 6.33 1.10 -0.03
WEB: Timeliness of information 1
2 9 22 129 136 299 6.28 0.85 0.08
CONSULT: Special requests (e.g. disk quota increases, etc.) 2

22 11 33 116 184 6.28 1.17 -0.04
SERVICES: Allocations process 1
3 11 23 108 134 280 6.27 0.91 0.24
TRAINING: New User's Guide 2
2 8 15 91 80 198 6.17 0.98 0.02
WEB: Ease of finding information 1 1 7 11 30 142 112 304 6.10 0.97 0.15
TRAINING: Web tutorials 2
2 9 22 60 65 160 6.06 1.09 0.02
WEB: Searching
1 6 22 34 64 57 184 5.77 1.14 0.09
SERVICES: Ability to perform data analysis 1 2 4 18 17 43 43 128 5.73 1.30 -0.21
SERVICES: Data analysis and visualization assistance 3
3 18 14 19 41 98 5.66 1.50 -0.17
TRAINING: Workshops 1 1
19 8 13 18 60 5.38 1.43 -0.21

 

Satisfaction with NERSC Services - by Type of Service

7=Very satisfied, 6=Mostly satisfied, 5=Somewhat satisfied, 4=Neutral, 3=Somewhat dissatisfied, 2=Mostly dissatisfied, 1=Very dissatisfied

 

Item Num who rated this item as: Total Responses Average Score Std. Dev. Change from 2009
1 2 3 4 5 6 7
Accounts and Allocations
Account support and Passwords 1 1 2 6 12 73 243 338 6.60 0.80 -0.06
Allocations process 1
3 11 23 108 134 280 6.27 0.91 0.24
Analytics and Visualization
SERVICES: Ability to perform data analysis 1 2 4 18 17 43 43 128 5.73 1.30 -0.21
SERVICES: Data analysis and visualization assistance 3
3 18 14 19 41 98 5.66 1.50 -0.17
HPC Consulting
CONSULT: Overall 1
1 5 9 59 212 287 6.64 0.74 0.12
CONSULT: Response time 1
2 6 12 61 205 287 6.59 0.80 -0.01
CONSULT: Quality of technical advice

1 7 14 67 190 279 6.57 0.74 0.09
CONSULT: Time to solution 1 1 3 10 23 71 172 281 6.40 0.96 0.01
CONSULT: Special requests (e.g. disk quota increases, etc.) 2

22 11 33 116 184 6.28 1.17 -0.04
Security
Security

2 11 11 69 202 295 6.55 0.79 0.16
Training
TRAINING: New User's Guide 2
2 8 15 91 80 198 6.17 0.98 0.02
TRAINING: Web tutorials 2
2 9 22 60 65 160 6.06 1.09 0.02
TRAINING: Workshops 1 1
19 8 13 18 60 5.38 1.43 -0.21
Web Interfaces
WEB: Status Info

1 5 12 104 181 303 6.51 0.68  
WEB: NIM web interface 1 1 4 6 25 105 180 322 6.38 0.90 -0.00
WEB: Accuracy of information 1
1 10 16 117 155 300 6.37 0.83 0.05
WEB: www.nersc.gov overall
1 4 3 15 147 150 320 6.35 0.77 0.07
WEB: On-line help desk 1 1 1 12 11 34 99 159 6.33 1.10 -0.03
WEB: Timeliness of information 1
2 9 22 129 136 299 6.28 0.85 0.08
WEB: Ease of finding information 1 1 7 11 30 142 112 304 6.10 0.97 0.15
WEB: Searching
1 6 22 34 64 57 184 5.77 1.14 0.09

 

How Useful are these NERSC Services to You?

3=Very useful, 2=Somewhat useful, 1=Not useful

 

Item Num who rated this item as: Total Responses Average ScoreStd. Dev.
1 2 3
TRAINING: New User's Guide 10 35 134 179 2.69 0.57
WEB: Status Info 12 73 221 306 2.68 0.54
SERVICES: E-mail lists 5 102 209 316 2.65 0.51
TRAINING: Web tutorials 14 43 112 169 2.58 0.64
MOTD (Message of the Day) 18 98 187 303 2.56 0.61
TRAINING: Workshops 25 42 29 96 2.04 0.75

 

Are you well informed of changes?

Do you feel you are adequately informed about NERSC changes?

 

AnswerResponsesPercent
Yes 300 99.3%
No 2 0.7%

 

How Important are Analytics Services to You?

3=Very important, 2=Somewhat important, 1=Not important

 

Item Num who rated this item as: Total Responses Average ScoreStd. Dev.
1 2 3
SERVICES: Ability to perform data analysis 33 40 73 146 2.27 0.81
SERVICES: Data analysis and visualization assistance 37 49 50 136 2.10 0.80

 

Where do you perform data analysis and visualization of data produced at NERSC?

 

LocationResponsesPercent
All at NERSC 17 5.1%
Most at NERSC 40 12.0%
Half at NERSC, half elsewhere 67 20.2%
Most elsewhere 94 28.3%
All elsewhere 95 28.6%
I don't need data analysis or visualization 19 5.7%

 

If your data analysis and visualization needs are not being met, please explain why.   21 respondents

Need additional software:

NCAR Graphics is not correctly installed on davinci. (We use a version in Mary Haley's home directory instead.)
NCO is not available on davinci's replacements.

We are using mostly GrADS software to visualize data, so we do it mostly on our own machines. However, for quick preliminary results, visualization could be very helpful to detect any errors in our model simulations.

I use Davinci to use vcdat for my visualization needs. That particular software needs to be upgraded to more recent versions. The present version keeps on crashing with segmentation fault very frequently. That hinders my work progress.

We are using meteorological analysis tools like GrADS. So we have to take data to local machine to perform it.

I would further like to point out that, if you install GrADS on machines, we can readily check the output before we ftp the outputs to our systems.

Most of my pre- and post-processing code is in IDL. Having access to IDL on Franklin would significantly reduce the amount of data which needs to be transferred remotely.

I can't run scripts using ptraj (from Amber) on the Nersc machines, and the queue wait times are long, so I'm not sure it would be good for running serial data analysis scripts.

an installation of 'ecce', courtesy of pacific northwest national laboratory, would be immensely useful to quickly look at nwchem output, though i don't know if it is possible to obtain a license for that software from pnnl.

Performance issues:

I mostly find that the visualization tools are too complicated and the response time is too low. As for data analysis, I mostly use Matlab, but Matlab does not benefit much from parallel architectures and, for serial application, my local machines are faster than NERSC's.

Connecting from Europe prevents many visualization abilities...

Having trouble loading GUI over ssh (e.g. for xmgrace)

As my datasets become too large to transfer rapidly or to fit into the memory of my desktop machine, I increasingly rely on remote visualization from NERSC. Up until recently, I did this by running Visit on Davinci, accessed through the NoMachine desktop application. To the best of my knowledge, the server application (NX) needed for this type of access is not running on Euclid, Davinci's replacement; I have asked NERSC personnel about this and received no response.

I originally started out analyzing data produced by Franklin on Davinci using matlab. However Matlab was very slow loading large data files so I now scp the files to a hard drive and examine the data locally. Despite being annoying at first, this has actually proven to be a very good way for me to work as the transfer speed from Franklin to my remote machine is extremely fast.

Mathematica "Notebook Evaluation" process on Euclid seems much slower than in my local desktop. An actively running Mathematica doing "Evaluation" of cells on Euclid seems only use about 1% of CPU. Don't understand why or how to adjust that.

ViSiT comments:

I use ViSiT to visualize my data. Since my run generates too huge data, sometimes I can't visualize because of quota limit. Or if we want to make a movie out of all the data, my quota is not enough. I know I can ask for quota increase, but is that possible to cancel the disk quota restriction on visualization? I would really appreciate if you consider this.

The tool I mostly use is VisIt, which can be run remotely with a gui, which is nice. However, Franklin lacks the ability to allow using VisIt in cli mode, which is useful for loading python scripts onto visit and perform some set of tasks, like opening all datafiles and outputting one contour plot per datafile in order to create a movie, for example.

PDSF comments:

I installed my data analysis program ROOT myself because I am not the Star group user, there is still a problem, each time I log in, I need to run "source thisroot.csh" to set the Root environment variables manually, and this procedure can't be wrote in log in bash script.
Why can't these data analysis and visualization software be open to all users so they can choose themselves ?

gsl library on pdsf machines would be nice

Other comments:

It would be great if there were shared scratch space between franklin and davinci. As is I do all my analysis on franklin.

The code we use can easily be compiled on NERSC machines we just haven't gotten around to it yet.

Thank you. It is really great.

 

What additional services or information would you like to have on the NERSC web site?   26 respondents

Navigation and functionality suggestions:

Links that don't change font size or weight when you hover over them. This is very distracting.

Better organization. Eliminating conflicting information.

NERSC website has lots of content, I guess you can arrange it better.

drop off menu on the left column.
It is sometimes difficult to find the status link (use to be a tab at the top); or to go to the machine web page from the status page.

The one thing that has been a minor annoyance is that there is not a link to nim in the NERSC home page.

The most valuable things I've found on the site are pages that I only discovered from taking NERSC surveys. This points out to me that the site navigation needs improvement since I didn't discover them by browsing or searching the site itself.
Also, it is not uncommon to find out of date documentation on the site. This is really unfortunate as it undermines the credibility of the rest of the documentation.

More technical documentation:

Debugging software are not always transparent to the user. Maybe better help with the debuggers.

More information about new systems: carver, euclid

More details about the latency of each cluster's network.

Suggestions for new web services:

It would be useful if the MOTD were available as an RSS feed.

I don't know if I can choose environment variables on the web site to customize my needs on the supercomputer.
For example, I am not a Star group user, but I want to use the data analysis software ROOT, then I can choose this option from NERSC web site.

For the love of god, make mercurial and git servers for hosting projects

Suggestions for NIM:

Use plain language rather than contractions or acronyms on the account usage. What's a "repo"? What resources are MPP and STR?

better integration with NIM

Better communication of status:

I work mostly on Franklin. I find that down time for Franklin (unscheduled maintainance) is happening quite frequently. This can be very frustrating to users when you are in the middle of editing/compiling a program. The message often says that there is no estimated time when the machine will come up again. That makes it a little difficult for planning the work especially when this happens towards the end of the week when we are often planning to submit a big job to run over the weekend.

I would like to see some more technical information on the reasons for past unexpected outages.

Other comments:

I am grateful to everyone who contributes to the functionality, resourcefulness, friendliness, and productivity at NERSC. Thank you so much for all of you.

I am not sure at the moment

I find that the overall support and service from NERSC is very satisfying. The technical support and user information are adequate and useful. Though satisfied with the service, I would like to provide improvements in the existing structure. I would like to see either increase in wall time for most machines or decrease in the queue time for most of the machines.

Overall very good.

Best in the DOE! Great facility.

I'd like to be able to use gedit on Franklin. I think it's installed, but there's something wrong with my x-term. I think the problem is on my end, as "xclock" does not work, either. (But it does work for non-NERSC machines.)

As you can tell from all of my "I don't use this" answers, I'm just a lowly grad student doing runs on behalf of MILC.

Allowed length of job is short (24-48 hours or so). I hope that users can make requests for jobs that can't be done in two pieces. Occasionally, one large phonon spectrum calculation can take something like 200 hours on 64-256 processors.

When I have a problem it takes too long for someone to answer my question. For example, if I am stumped and have to wait 3 hours for an e-mail answer, I loose 3 hours of work. It would be much faster for me to directly contact the expert. That avoids e-mail tag.

Hi, pgplot is a simple plot package, useful for a first look at code results. There has been talk of installing it as a public library for a few years, but it hasn't happened yet (to my knowledge). It will be very useful to several heavy users of Franklin. Thanks.