Difference between revisions of "Cluster"

From ITSwiki
Jump to: navigation, search
[unchecked revision][unchecked revision]
 
(48 intermediate revisions by 5 users not shown)
Line 1: Line 1:
−
This page describes the cluster facilities at DTU Informatics.'''<br />'''
+
<div style="background-color: #FFFF00; border-style: dotted;"> This guide is for users at '''DTU Compute''' only</div>
 +
 
 +
 
 +
This page describes the cluster facilities at '''DTU Compute'''.
 +
 
 +
Most CPU resources are available at http://www.hpc.dtu.dk (via the "Compute" queue). The resources here are kept for backward compatibility and to allow for more interactive usage.
 +
 
  
 
The cluster is made of:
 
The cluster is made of:
 +
* 6 servers (grid20, ..., grid27) running Debian 12 64-bit Linux with 2 E5-2660 v3 10 Core CPU  2.60GHz, 128GB RAM
  
−
* 16 servers (grid01, grid02, ...) running 64-bit Linux with 2 X5650 6-Core Processor2.66GHz, 48GB RAM
 
−
* 2 servers (hms1 &amp;hms2) running 64-bit Linux with 8 AMD Quad-Core AMD Opteron(tm) Processor 8356 2.3GHz, 256 GBRAM
 
−
* 3 servers (cimbi2-4) running 64 bit Linux with 4 Dual core AMD Opteron (tm) Processor 880 2.4GHz, 32GB RAM [*]
 
  
−
===Setup===
 
  
−
Access to most of the servers is controlled via sun gridengine. However, in order to submit jobs one has to logon to hms1 or one of grid01-04 (using the normal user account/password which is used for the SunRay servers as well.) The servers hms1 and grid01-04 can be used for developing purposes, i.e. compile, test etc. and to submit jobs to of the other servers using the qsub command. grid01-04 are available from the SunRay servers via the '''gridterm '''command and through the menu system. hms1 is also available for running interactive jobs.
+
The grid is reboot'ed once pr. month, generally first Wednesday after the 15th. Is announced on the ''messaage of today (motd)'' on the grid terminals.
  
−
There are 5 queues defined on the grid.
 
  
−
# '''fast'''<br /> This queue is for very short (test) jobs which requires max 10 min. of WALL time. Jobs takin more time will be killed.<br /> In order to use it jobs have to be submitted with '''qsub -q fast P fast job.sh'''. Submitting jobs without arguments (i.e. '''qsub job.sh''') will not run in this queue.<br /> The queue has access to almost all slots on all machines.
+
=Setup=
−
# '''long<br />'''This queue is for long lasting jobs (more than 12 hours) - there is no enforced upper limit.<br /> The queue can only utilize 4 slots on cimbi2-4, grid05-16 and 16 on hms2, i.e. jobs submitted to this queue can not saturate these machines
+
−
# '''himem'''<br /> For jobs needing up to 12 hours of WALL time and will be executed on either grid05-16, cimbi2-4 or hms1-2.
+
−
# '''himem-long'''<br /> For jobs needing more than 12 hours and running on either grid05-16, cimbi2-4 or hms1-2
+
−
# '''himem2<br />'''For jobs up to 12 hours and will be executed on hms2.
+
  
−
On each node there is a '''/space''' (about 20GB) where everybody can write files to. However, files older than one week will be deleted automatically.
+
There is no longer a job scheduler running.
  
−
The grid has support for openMPI.
 
  
−
For a howto use the grid, submit matlab jobs in parallel and using openmpi see the [[Use the Cluster Facilities | grid howto]].
+
=Software=
  
−
===Software===
+
The cluster currently runs Debian 12 and with that OS comes a suite of standard utilities like gcc compiler suite, emacs, etc. Other software is installed (under /opt/appl if not specficied). The interactive versions of the programs are generally available from the menu system on the [[Linux_Terminal_Server | linuxterm servers]] (either using a linuxterm hardware client or [[Linux_Terminal_Server | Thinlinc]]) or from the command line (text in [] denotes the name of the command).
  
−
The cluster currently runs Ubuntu 10.04 and with that OS comes a suite of standard utilities like gcc compiler suite, emacs, etc. Other software is installed (under /appl if not specficied). The interactive versions of the programs are generally available from the menu system on the [[SunRay thin clients | SunRay servers]] (either using a SunRay client or [[Remote Access to Sun Desktop | Thinlinc]]) or from the command line (text in [] denotes the name of the command).
+
'''''<u>matlab:</u>''''' [matlab] version 2018b (aka version 9.5). 2016b [matlab91], 2017b [matlab93].<br />
 +
'''''<u>mathematica:</u>''''' [mathematica] version 11.3 and version 10.4 [mathematica10]<br />
 +
'''''<u>maple:</u>''''' [maple/xmaple] version 2018<br />
 +
'''''<u>sas:</u>''''' version 9.4 [sas]<br />
 +
'''''<u>R:</u>''''' [R] newest version <br />
 +
'''''<u>Rstudio:</u>''''' [rstudio]<br />
  
−
'''''<u>matlab:</u>''''' [matlab] version 2006b (aka version 7.3). 2008b [matlab77] 2011b [matlab713] as well. Make sure to see the examples in the [[Use the Cluster Facilities | howto ]]for running matlab on the grid<br />'''''<u>mathematica:</u>''''' [mathematica] version 6.0, version 7.0 [mathematica7] and version 8.0 [mathematica8]<br />'''''<u>maple:</u>''''' [maple/xmaple] version 12, version 14 [maple14/xmaple14] and version 15 [maple15/xmaple15] <br />'''''<u>sas:</u>''''' version 9.2 [sas]<br />'''''<u>R:</u>''''' [R] newest version (by February 6th, 2012: 2.14.1)<br />'''''<u>splus:</u>''''' [Splus] version 8.0.4.<br />'''''<u>SUN studio 12u1:</u>''''' [sunstudio] installed under /opt/SS12u1/.... . <br />'''''<u>TotalView debugger:</u>''''' [totalview]<br /><u>'''''OpenMPI:'''''</u> version 1.3.x. See the [[Use the Cluster Facilities | howto]] for usage.<br />'''''<u>Wine</u>''''': [wine] version 1.0.1. See special [[Running wine on linuxgrid | setup instructions]].
 
  
−
[[Category:IT Systems]]
+
[[Category:IT]]

Latest revision as of 13:30, 16 February 2024

This guide is for users at DTU Compute only


This page describes the cluster facilities at DTU Compute.

Most CPU resources are available at http://www.hpc.dtu.dk (via the "Compute" queue). The resources here are kept for backward compatibility and to allow for more interactive usage.


The cluster is made of:

  • 6 servers (grid20, ..., grid27) running Debian 12 64-bit Linux with 2 E5-2660 v3 10 Core CPU 2.60GHz, 128GB RAM


The grid is reboot'ed once pr. month, generally first Wednesday after the 15th. Is announced on the messaage of today (motd) on the grid terminals.


Setup

There is no longer a job scheduler running.


Software

The cluster currently runs Debian 12 and with that OS comes a suite of standard utilities like gcc compiler suite, emacs, etc. Other software is installed (under /opt/appl if not specficied). The interactive versions of the programs are generally available from the menu system on the linuxterm servers (either using a linuxterm hardware client or Thinlinc) or from the command line (text in [] denotes the name of the command).

matlab: [matlab] version 2018b (aka version 9.5). 2016b [matlab91], 2017b [matlab93].
mathematica: [mathematica] version 11.3 and version 10.4 [mathematica10]
maple: [maple/xmaple] version 2018
sas: version 9.4 [sas]
R: [R] newest version
Rstudio: [rstudio]

Retrieved from "https://itswiki.compute.dtu.dk/index.php?title=Cluster&oldid=4177"