The RTDC
Processing SMA Data
1.2 m Telescopes
AST/RO
Extra

Creating a high-memory CASA job on Hydra


For this exampe the following files are in the current working directory. This will be your home directory on Hydra, or the RTDC dedicated space.

  • casa has been soft-linked to your casa installation. You can request any version of CASA be installed on the RTDC space like in this example.
  • fulldata.ms (your input data file) has been soft-linked to wherever it is located - this saves disk space if you plan to run different jobs from different folders.
  • runcasa.job is the job submission script (CONTENT DESCRIBED BELOW)
  • tclean-test.py is called from runcasa.job and for this example is the same script found at Running CASA in Parallel Mode.


    The job file can be generated online using the
    QSub Generator. Alternatively you can write it yourself following the template below.

    # /bin/csh Declare the job's shell
    #
    #$ -cwd -j y Run from current working directory. -j y combines stdout & stderr messages
    #$ -o runall.log Set output log file (will append if file exists)
    #$ -q mThM.q Choose queue. Here it is the high memory (>6GB/cpu) queue mThM.q.
    #$ -l himem,h_data=30G,h_vmem=30G,mres=30G Required for high-memory queue. This reserves the approximate memory required per cpu.
    #$ -N run_my_test Set a name for this job (not have to be the script name)
    #$ -pe mthread 5 Set parallel environment & number of cores/cpus. mthread is a good choice for casa.
    #$ -m bea Include this if you want email notifications when the job begins/end/aborts
    #$ -M you@cfa.harvard.edu Provide your email
    #
    echo $JOB_NAME started `date` on $HOST in $QUEUE Send an information message to the log file
    echo jobID=$JOB_ID and NSLOTS=$NSLOTS and more information
    #
    set CASA = casa/bin/ Set the variable CASA
    $CASA/mpicasa -n $NSLOTS $CASA/casa --nogui -c tclean-test.py Run your tclean script
    #
    echo $JOB_NAME done `date` Report end time


    NOTE: All jobs that use more than 2 GB of memory (per CPU) should include a memory reservation and requirement with -l mres=X,h_data=X,h_vmem=X.


    Find more information on all the queue options at HPC: Available Queues
    Find more information on submitting jobs at HPC: Submitting Jobs
    .

CENTER FOR ASTROPHYSICS | HARVARD & SMITHSONIAN
60 GARDEN STREET, CAMBRIDGE, MA 02138