NERSCPowering Scientific Discovery Since 1974

MILC Large Characterization on Seaborg


Step ID s00613.18913.0 Job Name
Owner hjw Account mpccc Status Completed
LL class reg_1 Submit class regular Job type Parallel
Nodes 16 Wall secs 10,631 Wall hrs 2.95
MPP secs 2,721,536 MPP hrs 755.98 Raw Secs 2,721,536
Submit Jul-16-07 09:21:37 Start Jul-16-07 09:22:34 Wait 00:00:57
Completion Jul-16-07 12:19:49 systime 14,214 usrtime 2,681,958
Task Max. Memory (GB) 2.598e-01  
Nodelist s07713, s08109, s06901, s08605, s02205, s05501, s01505, s08301, s09409, s01213, s07505, s10213, s09701, s02113, s09513, s00813
*Indicates dispatch time

Summary | Hardware Counters | MPI Statistics


IPM summary

Executable ./su3_rmd
Number of tasks 256 Aggregate GFlop/sec 32.5808 Average GFlop/sec/task 0.1273
Average wall secs 1.023e+04 Aggregate memory (GB) 66.5001 Average memory/task (GB) 0.2598
Average MPI secs/task 1.587e+03 MPI time % 15.51 Aggregate MPI calls made 1.881e+08

IPM summary statistics - 256 tasks

MetricSum over all tasksAverage (per task)Task CV (%)Task MinimumTask Maxium
Aggregate Floating Point Operations (Flop x 10**9) 3.333e+05 1.302e+03 0.00 1.302e+03 1.302e+03
GFlop/sec 3.258e+01 1.273e-01 0.00 1.273e-01 1.273e-01
Maximum Memory Usage (GBytes) 6.650e+01 2.598e-01 0.00 2.598e-01 2.598e-01
Time Spent in MPI Routines (sec) 4.062e+05 1.587e+03 6.89 1.429e+03 1.778e+03
Wallclock Time (sec) 2.619e+06 1.023e+04 0.00 1.023e+04 1.023e+04
Memory in units of gigabytes; time in seconds.

Hardware counter statistics - 256 tasks

Counter NameSum over all tasksAverage (per task)Task CV (%)Task MinimumTask Maxium
PM_CYC 9.687073e+14 3.784013e+12 0.07 3.774260e+12 3.787949e+12
PM_FPU0_CMPL 1.218138e+14 4.758350e+11 0.04 4.756374e+11 4.770188e+11
PM_FPU1_CMPL 8.335404e+13 3.256017e+11 0.06 3.244011e+11 3.258297e+11
PM_FPU_FMA 1.281695e+14 5.006619e+11 0.00 5.006514e+11 5.006845e+11
PM_INST_CMPL 6.365393e+14 2.486482e+12 3.14 2.292005e+12 2.597565e+12
PM_LD_CMPL 2.111336e+14 8.247406e+11 3.22 7.585956e+11 8.625568e+11
PM_ST_CMPL 1.296745e+14 5.065412e+11 3.59 4.616754e+11 5.328462e+11
PM_TLB_MISS 2.552440e+12 9.970469e+09 12.13 9.584329e+09 1.496572e+10

MPI time statistics - 256 tasks

CallSum over all tasksAverage (per task)Task CV (%)Task MinimumTask Maxium% of MPI% of wall
MPI_Wait 3.170e+05 1.238e+03 9.46 1.083e+03 1.455e+03 78.040 12.103
MPI_Allreduce 6.676e+04 2.608e+02 4.96 2.308e+02 2.878e+02 16.436 2.549
MPI_Isend 1.948e+04 7.607e+01 13.31 5.967e+01 9.792e+01 4.794 0.744
MPI_Irecv 2.946e+03 1.151e+01 20.60 7.981e+00 1.702e+01 0.725 0.112
MPI_Barrier 8.374e+00 3.271e-02 40.32 1.006e-03 3.957e-02 0.002 0.000
MPI_Comm_size 7.725e+00 3.018e-02 11.05 2.850e-02 5.247e-02 0.002 0.000
MPI_Bcast 1.822e+00 7.116e-03 15.26 1.030e-03 9.338e-03 0.000 0.000
MPI_Comm_rank 1.953e-02 7.627e-05 61.03 2.217e-05 2.670e-04 0.000 0.000

Percent of total MPI Time

Pct. MPI Time by function

MPI call frequency statistics - 256 tasks

CallTasksNumber of Calls (per task)Buffer Size (Bytes)
SumAverageCV (%)MinimumMaxiumSumAvg. per taskAvg. per call
MPI_Wait 256 9.037e+07 3.530e+05 0.00e+00 3.530e+05 3.530e+05 0.000e+00 0.000e+00 0.000e+00
MPI_Allreduce 256 9.946e+05 3.885e+03 0.00e+00 3.885e+03 3.885e+03 0.000e+00 0.000e+00 0.000e+00
MPI_Isend 256 4.520e+07 1.765e+05 0.00e+00 1.765e+05 1.765e+05 0.000e+00 0.000e+00 0.000e+00
MPI_Irecv 256 4.520e+07 1.765e+05 0.00e+00 1.765e+05 1.765e+05 0.000e+00 0.000e+00 0.000e+00
MPI_Barrier 256 5.120e+02 2.000e+00 0.00e+00 2.000e+00 2.000e+00 0.000e+00 0.000e+00 0.000e+00
MPI_Comm_size 256 6.368e+06 2.488e+04 2.51e-04 2.488e+04 2.488e+04 0.000e+00 0.000e+00 0.000e+00
MPI_Bcast 256 7.680e+02 3.000e+00 0.00e+00 3.000e+00 3.000e+00 0.000e+00 0.000e+00 0.000e+00
MPI_Comm_rank 256 2.560e+02 1.000e+00 0.00e+00 1.000e+00 1.000e+00 0.000e+00 0.000e+00 0.000e+00