all-announcements mailing list archive
Index average review score in NIM

From: Francesca Verdier (fverdier_at_lbl.gov)
Date: 11/12/2002


Dear NERSC Account Managers,

With the new NIM release you can now see the average review score 
your project received from this year's ERCAP review process.

DOE Base Program requests were reviewed by DOE's COmputational 
Review Panel (CORP). The CORP provides computational ratings to 
the DOE Program Managers on the computational approach, optimization, 
scalability, and communications characteristics of your code. They 
rated how well you answered the code description questions on the 
ERCAP Request Form. 

SciDAC, Startup and small HPSS-only requests were not rated.

Each request that was rated was reviewed and scored by four reviewers:

1. Computational Science reviewers -- they review requests in 
   their science discipline. 
2. Computer Science reviewers -- they review requests across 
   all science disciplines, paying attention to the Computer Science 
   aspects of the projects. 
3. Applied Mathematics reviewers -- they review requests across 
   all science disciplines, paying attention to the algorithmic 
   aspects of the projects. 
4. NERSC staff reviewers 

Each reviewer rated 3 areas of your project with a score of:

   5 for excellent
   4 for very good
   3 for good
   2 for fair
   1 for poor

The areas rated were:

1. Software and Algorithms: this area was given 50% of the weight 
   for the overall score for that reviewer.

2. Code Performance: this area was given 30% of the weight for the 
   overall score. 

3. Communications, Storage and I/O: this area was given 20% of the 
   weight for the overall score.

The weighted average of these three scores produced an overall 
score for each reviewer. 

The average review score you see in NIM is the average of all the 
reviewers' overall scores.

   
-- 
Francesca Verdier                   email: fverdier_at_lbl_dot_gov
Group Lead, NERSC User Services     phone: 510-486-7193