NERSCPowering Scientific Discovery Since 1974

Queues and Policies

Queues

A user's job gets routed to a queue automatically, based on the specifications in the job.  There are 3 main queue, the normal queue (normal.q), the long queue (long.q) and the high priority queue (high.q).  Users DO NOT specify these queue resources.  Instead just specify the wall clock time you need.

 

Resources

 

Resource NamePurposeNode LimitMemory LimitWall Clock LimitJob LimitSlot Limit
normal.c Production workloads. Default queue

none

150**

none

default 12 hours

> 12 hours**

none none
high.c High priority jobs and debugging jobs 1 144GB

no limit
default 12 hours

  2
debug.c For debugging - prefer users use high.c complex above
3 48GB 8 hours 1 16
bg.c Long, low priority jobs none 8 GB none 100 200
timelogic.c Access to Timelogic accelerated blast nodes 150 none none none 1 per node

 

Policies and Best Practices

  • Jobs running longer than 12 hours will be routed to a limited pool of nodes for long jobs
  • The high.c resource is intended for fast turn around jobs.  Users are limited to 2 slots for 12 hours.
  • Always request the shortest wall clock time and the smallest amount of memory you need.  This will allow your job to get scheduled faster.
  • There is currently a 2000 per user job limit.  If this impedes your workflow, please contact us.
  • The long queue currently has the 1664 slots with the following distribution (Note all high memory nodes have the long queue enabled):
    160 48GB nodes => 1280 slots
    10 144GB nodes => 80 slots
    7 256GB nodes => 56 slots
    4 512GB nodes => 128 slots
    3 1TB nodes => 120 slots 

Current Shares

ProjectShare %
annotation.p 7.8
comparative.p 11.9
gbp.p 16.9
img.p 13.6
jgi.p 7.8
mep.p 1.7
pi.p 3.1
plant.p 27.1
rnd.p 10.1

 

New Shares -- 

Each project may determine the subshares appropriate for their project.  For issues concerning share distribution, please talk to the proxy of the appropriate sponsor.

In order to run a job with one of the new projects and corresponding sub-projects, please add the following to your batch script (or just use -P if submitting to qsub from the command line):

#$ -P <user requested resource>

Where the user-requested resource is one of the sub-projects listed in the table below. 

SponsorShare%User-requested Resource

Len Pennachio
(Proxy: Rob Egan, gentech.p)

10.1%
  Relative Share % Total Share %
gentech-rnd.p 40% 4.1%
gentech-reseq.p 30% 3%
gentech-rna.p 30% 3%

Len Pennachio
(Proxy: Rob Egan,gentech-prod.p)

3.1%
  Relative Share % Total Share %
gentec-pi.p 10% 0.31%
gentec-sdm.p 45% 1.4%
gentech-qaqc.p 33% 1.0%
gentech-rqc.p 12% 0.4%
Nikos Kyrpides
(Proxy: Kostas Mavrommatis, prok.p)
37.2%
  Relative Share % Total Share %
prok-IMG.p 36% 13.4%
prok-assembly.p 8% 3%
prok-annotation.p 45% 16.7%
prok-meco.p 5% 1.9%
prok-scell.p 6% 2.2%
Dan Rokhsar
(Proxy: David Goodstein, fungal.p)
13.2%
  Relative Share % Total Share %
fungal-annotation.p 72.7% 9.6%
fungal-assembly.p 27.3% 3.6%
Dan Rokhsar
(Proxy: David Goodstein, plant.p)
 26.7
  Relative Share % Total Share %
plant-analysis.p 14.9% 4%
plant-diversity.p 28.4% 7.6%
plant-assembly.p 28.4% 7.6%
plant-annotation.p 27% 6.84%
plant-support.p 1.4% 0.36%
 Ray Turner (general.p) 9.7%
  Relative Share % Total Share %
other.p                         70% 6.8%
vista.p 30% 2.9%