Creating a high-memory CASA job on Hydra
For this exampe the following files are in the current working directory. This will be your home directory on Hydra, or the RTDC dedicated space.
- casa has been soft-linked to your casa installation. You can request any version of CASA be installed on the RTDC space like in this example.
- fulldata.ms (your input data file) has been soft-linked to wherever it is located - this saves disk space if you plan to run different jobs from different folders.
- runcasa.job is the job submission script (CONTENT DESCRIBED BELOW)
- tclean-test.py is called from runcasa.job and for this example is the same script found at Running CASA in Parallel Mode.
The job file can be generated online using the QSub Generator. Alternatively you can write it yourself following the template below.
# /bin/csh | Declare the job's shell |
# | |
#$ -cwd -j y | Run from current working directory. -j y combines stdout & stderr messages |
#$ -o runall.log | Set output log file (will append if file exists) |
#$ -q mThM.q | Choose queue. Here it is the high memory (>6GB/cpu) queue mThM.q. |
#$ -l himem,h_data=30G,h_vmem=30G,mres=30G | Required for high-memory queue. This reserves the approximate memory required per cpu. |
#$ -N run_my_test | Set a name for this job (not have to be the script name) |
#$ -pe mthread 5 | Set parallel environment & number of cores/cpus. mthread is a good choice for casa. |
#$ -m bea | Include this if you want email notifications when the job begins/end/aborts |
#$ -M you@cfa.harvard.edu | Provide your email |
# | |
echo $JOB_NAME started `date` on $HOST in $QUEUE | Send an information message to the log file |
echo jobID=$JOB_ID and NSLOTS=$NSLOTS | and more information |
# | |
set CASA = casa/bin/ | Set the variable CASA |
$CASA/mpicasa -n $NSLOTS $CASA/casa --nogui -c tclean-test.py | Run your tclean script |
# | |
echo $JOB_NAME done `date` | Report end time |
NOTE: All jobs that use more than 2 GB of memory (per CPU) should include a memory reservation and requirement with -l mres=X,h_data=X,h_vmem=X.
Find more information on all the queue options at HPC: Available Queues
Find more information on submitting jobs at HPC: Submitting Jobs
.
|