SMA Technical Memo #166


Subject:  A METHOD FOR HANDLING SMA DATA FROM SWARM CORRELATOR -
Solving for bandpass of high- or full- spectral resolution data
Date: October 2, 2017$
From: Jun-Hui Zhao (SAO)
___________________
$Updated from the versions since February 25, 2016; Submitted September 21, 2017 
  • 1. Motivation -
  • As the SMA SWARM correlator comes online, reliable bandpass corrections become a pressing 
    issue for probing fine structure of kinematics in imaging molecular lines with a high 
    spectral-resolution as well as for imaging comprehensive distributions of continuum 
    emission sampled with wideband (WB) data. For some special objects, the line width 
    appears to be narrow; for example, the velocity widths of molecular lines from brown 
    dwarf or proto brown dwarf candidates are as narrow as 1 km/s or even less[2,3,4]. The 
    full spectral resolution, 0.1 MHz per channel or 0.1 km/s at 1 mm, provided by the 
    SWARM correlator is needed for the study of the narrow line systems. However, a poor 
    signal-to-noise ratio (S/N) provided for such high-spectral resolution data becomes 
    an issue in solving for a reliable bandpass, given a lack of strong QSOs at higher 
    frequencies and highly variable cores of blazars in the range of wavelengths covered 
    in the radio, millimeter and submillimeter (RMS) bands as well as extended structures 
    of disc-like emission from strong thermal objects in the Solar system. The bandpass 
    solvers that were developed early need to be upgraded with more advanced algorithms 
    to address the inadequate budget in S/N for both spectrally and angularly high 
    resolution observations at submillimeter wavelengths. On other hand, wideband 
    continuum imaging employs the multiple-frequency synthesis (MFS) imaging technique[5], 
    which requires well-calibrated data across the sampled spectral band. In addition to 
    bandpass and delay corrections, the phase between individual spectral chunks or 
    sub-bands (hereafter) must be aligned well and also corrections for time-dependent 
    residual delays need to be carried out in order to achieve high-dynamic range images; 
    both errors in phase become critical issues in sub-arcsec resolution imaging. The 
    relevant algorithms have been developed and implemented in Miriad software. The 
    goal of the efforts is to match the specifications required by a variety of science 
    cases in the reduction of wideband data produced from the SMA SWARM correlator.
    
    In Section 2, a visibility model for a celestial object is discussed concerning 
    calibrations. In Section 3, a method of pre-processing data prior to solving for 
    antenna-based bandpass as well as auto-editing the bandpass solutions are described 
    and discussed. The relevant algorithms have been implemented in a Miriad program 
    smamfcal. Sections 4 and 5 give the in-line document from help deck of smamfcal, 
    and a usage for setting up variables in a c-shell script, respectively. A test data 
    set was given from SMA observations of Sgr B2 North on Feburary 11, 2016 with 
    four SWARM sub-bands. Application and demonstration for this software 
    technique with the test data are given in Section 6. The names of relevant subroutines 
    and functions for SMA Miriad implementation are given in Appendix.
    

  • 2. Visibility model -
  • In the era of new generation interferometer arrays at RMS wavelengths with a capability 
    of wideband sampling, telescope sensitivities in detections of weaker objects have 
    been dramatically improved in recent years. Source structure and variability of a 
    celestial object used as a calibrator become noticeable issues in data calibration 
    and imaging. Previous assumptions of point source models for core-dominant QSOs or 
    blazars in data calibrations appear to be inappropriate, and the issues owing to the 
    nature of sources require special attention and treatment. A visibility function in 
    modeling a calibrator concerning its variability and structure is introduced and 
    discussed. A transformation of actual source structure into a pseudo point-source model 
    and a process of removal of time variability are reviewed as follows.  
    
  • 3. Bandpass solver SMAmfcal -
  • The program smamfcal is a Miriad task which determines calibration solutions for antenna-
    based corrections in aspects of antenna gains, delay terms and passband shapes from a 
    multi-frequency observation. This task is developed based on the original Miriad program 
    mfcal coded by Bob Sault according to the Miriad code signature. In the past decade, 
    smamfcal has been powered by implementing new algorithms as discussed below for handling 
    poor S/N data from observations at submillimter wavelengths. The algorithm of matrix 
    solver in mfcal is retained in smamfcal. The algorithms used for pre-processing 
    visivilities and editing bandpass solutions are listed below along with descriptions 
    and discussions in the following sub-sections.
    

  • 4. Help deck -

  • 5. Usage -
  • The reduction of SMA data has been suggested to use msmooth in bandpass calibration, e.g. 
    CalibrationProcedure for data produced from the ASIC correlator. The function msmooth 
    appears to be critical in solving high-spectral resolution bandpass of ASIC data. This 
    pre-process appears to be essential for handling the high-spectral resolution SWARM 
    data. Here, an example is given for a usage of smamfcal in a C-shell script if 
    one uses a QSO as a bandpass calibrator:
    
    ___________________
    https://www.cfa.harvard.edu/sma/miriad/swarm/pscripts/swarmcali_a.csh.html

  • 6. Application & Testing -
  • Using a recent test data from the observation track on February 11, 2016 with a hybrid 
    configuration of both ASIC and SWARM correlators. This is the first real data set that 
    was produced from a part of the SWARM correlator, consisting of four high-resolution 
    sub-band while the SMA was in an array of five antennas. Here is a report for 
    the lower-side band (LSB) data set, which is produced with uvindex:
    























    Fig. 1 - Raw spectra of 3C 273 from the ten baselines. Each row consists of four sub-bands produced from a part of the SWARM correlator. Each of the spectra shows the amplitudes (top) and phases (bottom). Click the figure for enlargement (for webpage version only).

























    Fig. 2 - Antenna-based solutions in amplitude derived from the bandpass solver smamfcal. Click the figure for enlargement (for webpage version only).






















    Fig. 3 - Antenna-based solutions in phase derived from the bandpass solver smamfcal, corresponding to the solutions in amplitude shown in Fig. 2. Antenna 1 is the reference antenna. Click the figure for enlargement (for webpage version only).




    SWARM sub-band 1 -





















    SWARM sub-band 2 -






















    SWARM sub-band 3 -





















    SWARM sub-band 4 -





















    Fig. 4 - A stack of 10 spectra from each baseline in each of the four SWARM sub-bands towards Sgr B2 North after apply corrections for bandpass. From top to bottom are the sub-bands 1, 2, 3 and 4 produced from a part of the SWARM correlator. Click each of the figures for enlargement (for webpage version only).
  • Appendix: Source code -
  • The Fortran code of the entire smamfcal program exceeds 4600 coding lines. For interested 
    users, a copy of the source code can be found from the SMA Miriad distribution. The code
    of the Fortran 77 subroutines for the relevant pre-processes is highlighted below:
    
  • Reference -
  • [1]Sault, R. J., Teuben, P. J., & Wright, M. C. H. 1995, in ASP Conf. Ser. 77,
         Astronomical  Data  Analysis  Software  and  Systems  IV,  ed.  R.  A.  Shaw,
         H. E. Payne, & J. J. E. Hayes (San Francisco, CA: ASP), 433
    [2]Basmah Riaz, 2016, personel communication based on her SMA project: 2015B-S044
    [3]Long, F. et al. 2017, ApJ, 844, 99
    [4]Ricci, L. et al. 2012, ApJL, 761, L20
    [5]Rau, U. & Cornwell, T. J. 2011, AA, 532, A71, for example
    [6]Jun-Hui Zhao, Mark, R. Morris, & W. M. Goss 2017, in preparation
    [7]Siegmund Brandt, 1999, Data Analysis - Statistical and Computational Methods for 
         Scientists and Engineers, Third Edition, Springer-Verlag New York Inc.
    






    ___________________
    https://www.cfa.harvard.edu/sma/miriad/swarm/SMAmemSWARMBpass/SMAmemSWARMBpass.html