Queues and Policies
Queues
A user's job gets routed to a queue automatically, based on the specifications in the job. There are 3 main queue, the normal queue (normal.q), the long queue (long.q) and the high priority queue (high.q). Users DO NOT specify these queue resources. Instead just specify the wall clock time and memory that is required for each job.
Resources
| Resource Name | Purpose | Slot Limit | Memory Limit | Wall Clock Limit | Job Limit |
|---|---|---|---|---|---|
| normal.c | Production workloads. Default queue |
none |
none |
default 12 hours |
none |
| long.c | Production workflows that need more than 12 hours |
320 |
> 12 hours |
||
| high.c | High priority jobs and debugging jobs | 8 | 144GB |
no limit |
|
| debug.c | For debugging - prefer users use high.c complex above |
6 | 48GB | 8 hours | 1 |
| bg.c | Long, low priority jobs | 200 | 8 GB | none | 100 |
| timelogic.c | Access to Timelogic accelerated blast nodes | 1 per node | none | none | none |
Policies and Best Practices
- Jobs running longer than 12 hours will be routed to a limited pool of nodes for long jobs
- The high.c resource is intended for fast turn around jobs. Users are limited to 2 slots for 12 hours.
- Always request the shortest wall clock time and the smallest amount of memory you need. This will allow your job to get scheduled faster.
- The long queue currently has the 1664 slots with the following distribution (Note all high memory nodes have the long queue enabled):
160 48GB nodes => 1280 slots
10 144GB nodes => 80 slots
7 256GB nodes => 56 slots
4 512GB nodes => 128 slots
3 1TB nodes => 120 slots - The long queue has a limit of 320 slots per user
Genepool Shares
Each project may determine the subshares appropriate for their project. For issues concerning share distribution, please talk to the proxy of the appropriate sponsor.
In order to run a job with one of the new projects and corresponding sub-projects, please add the following to your batch script (or just use -P if submitting to qsub from the command line):
#$ -P <user requested resource>
Where the user-requested resource is one of the sub-projects listed in the table below.
| Sponsor | Share% | User-requested Resource | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Len Pennacchio |
10.1% |
|
||||||||||||||||||
|
Len Pennacchio |
3.1% |
|
||||||||||||||||||
| Nikos Kyrpides (Proxy: Amrita Pati) |
37.2% |
|
||||||||||||||||||
|
Dan Rokhsar
|
3.6% |
|
||||||||||||||||||
|
Dan Rokhsar |
9.6% |
|
||||||||||||||||||
| Dan Rokhsar (Proxy: David Goodstein) |
26.7% |
|
||||||||||||||||||
| Ray Turner | 9.7% |
|


