NERSCPowering Scientific Discovery Since 1974

Queues and Policies

Queues

A user's job gets routed to a queue automatically, based on the specifications in the job.  There are 3 main queue, the normal queue (normal.q), the long queue (long.q) and the high priority queue (high.q).  Users DO NOT specify these queue resources.  Instead just specify the wall clock time and memory that is required for each job.

 

Resources

 

Resource NamePurposeSlot LimitMemory LimitWall Clock LimitJob Limit
normal.c Production workloads. Default queue

none

none

default 12 hours

none
long.c Production workflows that need more than 12 hours

320

 

> 12 hours

 
high.c High priority jobs and debugging jobs 8 144GB

no limit
default 12 hours

 
debug.c For debugging - prefer users use high.c complex above
6 48GB 8 hours 1
bg.c Long, low priority jobs 200 8 GB none 100
timelogic.c Access to Timelogic accelerated blast nodes 1 per node none none none

 

Policies and Best Practices

  • Jobs running longer than 12 hours will be routed to a limited pool of nodes for long jobs
  • The high.c resource is intended for fast turn around jobs.  Users are limited to 2 slots for 12 hours.
  • Always request the shortest wall clock time and the smallest amount of memory you need.  This will allow your job to get scheduled faster.
  • The long queue currently has the 1664 slots with the following distribution (Note all high memory nodes have the long queue enabled):
    160 48GB nodes => 1280 slots
    10 144GB nodes => 80 slots
    7 256GB nodes => 56 slots
    4 512GB nodes => 128 slots
    3 1TB nodes => 120 slots
  • The long queue has a limit of 320 slots per user

Genepool Shares

Each project may determine the subshares appropriate for their project.  For issues concerning share distribution, please talk to the proxy of the appropriate sponsor.

In order to run a job with one of the new projects and corresponding sub-projects, please add the following to your batch script (or just use -P if submitting to qsub from the command line):

#$ -P <user requested resource>

Where the user-requested resource is one of the sub-projects listed in the table below. 

SponsorShare%User-requested Resource

Len Pennacchio
(Proxy: Rob Egan)

10.1%
  Relative Share % Total Share %
gentech-rnd.p 40% 4.1%
gentech-reseq.p 30% 3%
gentech-rna.p 30% 3%

Len Pennacchio
(Proxy: Rob Egan)

3.1%
  Relative Share % Total Share %
gentech-pi.p 10% 0.31%
gentech-sdm.p 45% 1.4%
gentech-qaqc.p 33% 1.0%
gentech-rqc.p 12% 0.4%
Nikos Kyrpides
(Proxy: Amrita Pati)
37.2%
  Relative Share % Total Share %
prok-IMG.p 36% 13.4%
prok-assembly.p 8% 3%
prok-annotation.p 45% 16.7%
prok-meco.p 5% 1.9%
prok-scell.p 6% 2.2%

Dan Rokhsar
(Proxy: David Goodstein)

 

3.6%
  Relative Share % Total Share %
fungal-assembly.p 100% 3.6%

Dan Rokhsar
(Proxy: David Goodstein) 

9.6%
  Relative Share% Total Share %
fungal-annotation.p 100% 9.6%
Dan Rokhsar
(Proxy: David Goodstein)
 26.7%
  Relative Share % Total Share %
plant-analysis.p 14.9% 4.0%
plant-diversity.p 28.4% 7.5%
plant-assembly.p 28.4% 7.5%
plant-annotation.p 27% 6.7%
plant-support.p 1.4% 0.66%
 Ray Turner 9.7%
  Relative Share % Total Share %
other.p                         60% 5.8%
vista.p 30% 2.9%
system.p 10% 1%