On November 15, 2014, SMA announced that the storage of SMA data taken 
with all the observing modes in the SMA operation is switched to the new format
system. With limited information on the observing modes in details, the Miriad
programs encounter some problems in parsing and interpreting the SMA data
in new format for some of the observing modes. This memo attempts to address
the problems involved with the new observing modes. The status of handling
SMA data in new format with the new Miriad package (Miriad SMA-WB2.0.0, the latest version to date) is
summarized in this memo and will be updated in the new web page at the SMA Miriad 
site MIRIAD SITE FOR SMA SWARM DATA HANDLING. The SMA data taken before November 15,
2014 in the old format can be reduced with the latest version (1.5.0) of the  
SMA Miriad beta release. This end-to-end data-reduction path in Miriad has 
been supported at the SMA.

Given a raw SMA data set, two ASCII files, projectInfo and modeInfo, are provided
under the data directory. The first one contains the PI's name and the later
contains two integers to code the observing mode concerning  number of receivers 
(1 for single and 2 for dual) and the correlator mode (4 for 4 GHz or doubleband 
with 48 spectral chunks, and 2 for 2 GHz usually with 24 spectral chunks) that
are used in observations. The convention for the observing mode at the SMA
has been followed in the SMA Miriad programming before switching to the new
data format.

Table 1 lists the data sets observed in the new data format in the period
between November 15 and December 2, 2014 since the SMA operation switched to
the new data format. So far, there are three observing modes in general, namely, 
[1,4], [2,2] and [2,1] to be used in the first two weeks operation since
switching to the new data format. Each of the three gerenal modes can be
generated with numerous spectral modes.  In the new format system involved with 
the data from the SWARM correlator, the previous convention is no longer
true. The correlator mode 4 seems to be a combination of the previous 4 GHz mode adding the 
two large-number spectral chunks produced from the SWARM correlator; the order of packing the non-SWARM
chunks in a data string has been changed in the new data system. A patch has been 
implemented to convert the SMA data in new format to Miriad.    

The mode [2,2] seems to be similar to that used before swicthing format.
However, the order of spectral chunks needs to be verified with a testing observations of
a known spectral line source.

The mode [2,1] seems to contain polarization data and sometimes mixed with polarization
and unpolarization. The internal data structure for encoding the headers and 
data strings seems to be also different from the other modes. We are working
with the online programmers to resolve the problems.

Table 1: Observing mode
File name        modeInfo      projectInfo         
141202_03:41:45  2 1           Naomi Hirano
141201_04:44:04  2 1           Vivien Chen
141130_04:04:23  2 2           SMA
141129_03:04:09  2 2           SMA
141128_15:46:26  2 2           Michael Dunham
141128_15:45:27  2 2           Michael Dunham
141128_03:49:43  2 2           SMA
141127_02:21:26  2 2           SMA
141126_04:32:56  2 1           Vivien Chen
141126_04:01:26  2 1           Vivien Chen
141125_04:39:14  2 2           SMA
141124_18:56:43  2 2           Nimesh Patel
141124_17:29:27  2 2           Nimesh Patel
141124_14:00:59  2 2           Vivien Chen
141124_04:11:48  2 1           Vivien Chen
141123_07:49:31  2 2           Michael Dunham
141123_04:09:39  2 2           Michael Dunham
141122_03:05:36  2 2           SMA
141121_19:26:46  1 4           Glen Petitpas
141121_15:00:07  1 4           Glen Petitpas
141121_14:07:23  1 4           SMA
141121_09:51:54  1 4           Yuji Urata
141121_04:08:07  1 4           B.Zauderer
141120_03:58:22  2 2           SMA
141119_16:46:01  1 4           SMA
141119_07:02:47  1 4           David Wilner
141118_02:15:14  2 2           M.Dunham
141112_14:49:29  1 4           Scott Chapman

Since early 2012, Miriad has been preparing to implement for matching the
requirement of a large volume data generated from the SWARM correlator. Progress
reports in the development of the new Miriad can be found in the site of
MIRIAD SITE FOR SMA SWARM DATA HANDLING.

For the observing mode [1,4], or the traditional 4 GHz
correlator along with the SWARM correlator, Miriad has been able to reduce the new format
data from editing, calibration to imaging since the earlier version
SMA-WB1.*.* in November 2013. With the real data from the observation of
SgrB2(N) taken in the spring of 2014, Miriad has provided end-to-end scripts with an example data set for
SMA users, which can be found at the website of SMA MIRIAD for SWARM data handling. The H30alpha line images
have been produced with the SWARM-correlator data of SgrB2(N). The image appears
to be reasonably good.
 
With the updated version SMA-WB2.*.*, SMA users can handle the data
taken in the new format from the observations with mode [2,2]. The testing code has been exported
to the hilodr2 server in Hilo; the system can be cloned to other servers in Hilo 
and Cambridge. This version is ready to take testing data
for further development and debugging.