NERSCPowering Scientific Discovery Since 1974

Configuration

Compute Nodes

The Genepool system is made up of a heterogeneous collection of nodes to serve the diverse workload of the JGI users.  Below is a table of the current configuration.

# NodesCores/nodeMemory/nodeLocal diskProcessorHostnameVendor
2 32 1000GB 3.6TB Xeon E5-4650L mndlhm0205-ib,mndlhm0405-ib.nersc.gov Appro/Cray
5 32 500GB 3.6TB Xeon E5-4650L mndlhm[01-05]03.nersc.gov  Appro/Cray
8 16 248GB 1.8TB Xeon E5-2670 mc0xxx.nersc.gov Appro/Cray
212 16 120GB 1.8TB Xeon E5-2670 mc0xxx.nersc.gov Appro/Cray
14 20 120GB     mc1322-33,mc1344  
36 32 120GB     mc1535-48,mc1601-22  
1 20 248GB     mc1359  
78 32 248GB     mc1637-48,mc1705-60  
12 32 500GB     mc1625-36  
1 80 2 TB 300 GB Intel Xeon X7560 2.27 GHz mndlmem03.nersc.gov IBM

Login Nodes

Genepool currently has two login nodes.  Users land on one of the two login nodes when they ssh to genepool.nersc.gov.  The different login nodes sit behind a load balancer and you will land on the login node with the least number of connections, or if you already have active connections, you will be directed to the same login node.   The names of the login nodes are genepool13 and genepool14, however you should always access the login nodes with ssh username@genepool.nersc.gov.  

"gpint" Analysis Nodes

Genepool also has nodes which are used for pipeline control and pre- and post-processing of jobs as well as analysis jobs. At present, these nodes are allocated per group and are called gpintNNN (NN = 200,201,...). Users should refer to the table below to determine which node belongs to their group and only use the nodes allocated to their group.  

Node Name

Assigned Group

Cores

Memory

Per-process

Memory Limit

gpint200.nersc.gov R & D 20 256G 208G
gpint201.nersc.gov R & D 20 256G 208G
gpint202.nersc.gov Plant 20 256G 208G
gpint203.nersc.gov Plant 20 256G 208G
gpint204.nersc.gov IMG 20 128G 101G
gpint205.nersc.gov IMG 20 128G 101G
gpint206.nersc.gov GBP 20 128G 101G
gpint207.nersc.gov SDM 20 128G 101G 
gpint208.nersc.gov RQC 20 128G  101G 
gpint209.nersc.gov Assembly 20 128G  101G
gpint210.nersc.gov Assembly 20 128G  101G 
gpint211.nersc.gov Vista 20 128G  101G 
gpint212.nersc.gov IMG 20 128G 101G 
gpint213.nersc.gov Fungal 20 128G 101G
gpint501.nersc.gov IMG  20 512G  
gpint502.nersc.gov Plant  20 512G  
gpint503.nersc.gov Fungal  20 512G  

 

Other Special Purpose Nodes

Nodes which perform specialized tasks such as running a web-server and/or databases are also part of Genepool, although they may not have all the features of login or analysis nodes (such as NGF filesystems, login access, etc.). These nodes are also currently assigned on a per-group basis. Use of these nodes is restricted to the groups to which they have been assigned.

Oracle Databases

Oracle Database  gpodb05 vortex.jgi-psf.org
Oracle Database  gpodb01 data.jgi-psf.org
Oracle Database  gpodb04 muskrat.jgi-psf.org
Oracle Database   midway.jgi-psf.org
Oracle Database  gpodb03 jericho.jgi-psf.org
Oracle Database   nihdb.jgi-psf.org
Oracle Database   warwick.jgi-psf.org
Oracle Database   troi.jgi-psf.org
Oracle Database   farina.jgi-psf.org
Oracle Database   goku.jgi-psf.org
Oracle Database   catalpa.jgi-psf.org
Oracle Databse   img-nih.jgi-psf.org
Oracle Database   la-oracle.jgi-psf.org
PostgreSQL Database   gbp-db-prod.jgi-psf.org

MySQL Databases

MySQL Database gpdb01.nersc.gov lemur.jgi-psf.org
MySQL Database gpdb02.nersc.gov portal
MySQL Database gpdb03.nersc.gov portal
PostgreSQL Database gpdb04.nersc.gov Plant database
PostgreSQL Database gpdb05.nersc.gov polonium.jgi-psf.org

MySQL Database for Portal group

gpdb07  portal

MySQL Database for Portal group

gpdb08  

MySQL Database

gpdb09 anu.jgi-psf.org

MySQL Database for Plant Group

gpdb10 cigzome.jgi-psf.org

MySQL Database for Plant Group

gpdb11 dbcompgen.jgi-psf.org

Web Services

 

Purpose

Name

Legacy Name

Web server  gpweb01

vista.jgi-psf.org
genome.lbl.gov
pipeline.lbl.gov
pga.lbl.gov
www-pga.lbl.gov
gsd.lbl.gov
www.gsd.lbl.gov
www-gsd.lbl.gov

Web server  gpweb02

hazelton.jgi-psf.org 
atgc.lbl.gov

chr16.lbl.gov
enhancer.lbl.gov
enhancer-test.lbl.gov
genome-test.lbl.gov
hazelton.lbl.gov
pipeline-test.lbl.gov
regprecise.lbl.gov
regpredict.lbl.gov
rviewer.lbl.gov

IMG web nodes gpweb04-07 img-edge[1-4].jgi-psf.org
Web server gpweb08 athena.jgi-psf.org, geneprimp, coal, clams, gold, gold-dev, ani
Galaxy server gpweb09 galaxy.jgi-psf.org
Galaxy dev server gpweb10 galaxy-dev.jgi-psf.org
Portal server gpweb11 frylock.jgi-psf.org
Portal server gpweb12 gp-next.jgi-psf.org
Portal web nodes gpweb13-16 gp-edge[1-4].jgi-psf.org
Portal server gpweb17 gp-test.jgi-psf.org
Portal server gpweb18 portal.jgi-psf.org
Portal server gpweb19 uhura.jgi-psf.org
Plant web nodes gpweb20-22 zome-edge[1-3].jgi-psf.org
Plant dev web node gpweb23 zome-dev.jgi-psf.org
Plant web node gpweb24 zome-private.jgi-psf.org
Plant web node gpweb25 zome-services.jgi-psf.org
Web server gpweb26 jel.jgi-psf.org, seqtechrnd.jgi-psf.org, synbio.jgi-psf.org, rqc.jgi-psf.org, pyrotagger.jgi-psf.org
2nd IP for gpweb26 gpweb27 seqtech.jgi-psf.org
     
Portal load balanced website genome-lb gpweb13 - gpweb16 - genome.jgi.doe.gov, genome.jgi-psf.org
Plant load balanced website zome-lb gpweb20-22 and gpweb24-25 - www.phytozome.net
IMG load balanced website img-lb gpweb04-gpweb07 - img.jgi.doe.gov

Interconnect

The majority of the compute nodes are connected with a 1 Gb/sec Gigabit Ethernet switch.  A few nodes (details forthcoming) are connected via 10Gb/sec ethernet.

File Systems

Genepool will mount a number of file systems.  See the file systems page for more details.

  • Global homes
  • /usr/common
  • JGI 2.7PB GPFS file system "projectb"
  • $SCRATCH

Batch System

Genepool/Phoebe will use a fair share batch scheuler called "UGE".  See our documentation on submitting jobs and queues and policies for more details.