EOVSA Wiki - User contributions [en]

EOVSA flare pipeline

2022-01-19T19:42:49Z

Smondal:

The frequency of observing calibrator sources during EOVSA solar observations is much less than that one typically would like to observe to properly take into account the instrumental gain variations. Hence self-calibration is often needed to calibrate the data to a level of satisfaction. A self-calibration pipeline suitable for generating calibrated dataset and quicklook images have been developed. Here we explain the various inputs of that pipeline and discuss various factors that is needed to be considered before supplying the input values. We also provide the steps for running the code on the pipeline machine.

'''Format of the pipeline'''

The pipeline for now consists of an input file and two codes. The input file is named as ''inputs.py'' . The other two codes are ''gen_IDB_MS.py'' and ''IDB_selfcal_pipeline_version.py''. The code ''gen_IDB_MS.py'' is used to generate the measurement set (MS) from the raw files and calibrate the data using the gaintables derived from the calibrator observations. The second script is where the self-calibration happens. The main reason for having two separate codes is that "gen_IDB_MS.py" uses SUNCASA which for now runs on CASA versions<=5.4 . However, ''IDB_selfcal_pipeline_version.py'' requires CASA >=5.6. Hence for now the user needs to run the codes using the appropriate CASA versions.

'''Description of the inputs'''

An example inputs file in given below.

<pre>
## Task handlers ###
cal_disk = 0 ## apply calibration tables from full disc imaging
identify_data_gap=1 ### identify data gaps
doslfcal = 1 # main cycle of doing selfcalibration
doapply = 0 # apply the results

# ============ declaring the working directories ============
### remember / is necessary in all the folder names

workpath = '/data1/testing/20211101/'
slfcaldir = workpath+ 'slfcal_v3/' # place to put all selfcalibration products
imagedir = slfcaldir + 'images/' # place to put all selfcalibration images
caltbdir = slfcaldir+'caltables/' # place to put calibration tables
slfdisktbdir = slfcaldir + 'slfdisktb/'

# ============= time to image =================
starttime='2017-08-20 19:20:00' ### has strict formating rules
endtime='2017-08-20 19:48:00'

# ============ selfcal parameters ===============
refantenna = '0'
calc_cell=True ### If set to False use the value in beam given below
cell=[10] ### size needs to be same as the number of spw listed in selfcal_spw
calc_imsize=True ### is False uses the value given below
imsize=42 ### in solar radius, the full image size at the first frequency. Other frequencies, the value will be scaled.
### The default value of 42 solar radius is for ~1 GHz

max_frac_freq_avg=0.5 ### I will average at most this much fractional bandwidth

maxiter=10 ### maximum selfcal iterations
uvlim=25
avg_spw_max=5
flag_antennas = '' ###anything except 13~15. Those antennas are always flagged.
phasecenter=''

# ========== end of input parameters =================
</pre>

The ''task handlers'' listed in the ''inputs.py'' controls what functions will be performed by the ''IDB_selfcal_pipeline_version.py''. A value of ''0'' means that functionality will be run. Please give ''1'' as input if the said task is desired. The next group of inputs are the ''working directories''. After that, the time duration of interest should be provided. Please note that the format used when providing the ''starttime'' and ''endtime'' should be followed exactly as given in the above example. The next group of inputs are those which control different imaging and calibration parameters. ''refantenna'' is the index of the reference antenna which is used during the calibration. The user has the choice to either provide the cell size and manually, or the code can calculate it based on the maximum uv value. Please set the parameter ''calc_cell'' to ''True'' if automatic setting of parameter value is desired. If set to ''False'', the user must provide the cell size for all the spws. Please note that the unit of the cell size is in arcseconds. Current the parameters ''calc_imsize'' and ''imsize'' are not used. The ''imsize'' is always set to 4096, which means that the total area imaged is equal to ''4096''x''cell size''. ''maxiter'' is the maximum number of selfcal iterations which can happen. During the self-calibration step, we use uv values above a cutoff. The cutoff is controlled by the parameter ''uvlim''. The value of this parameter is in units of <math>\lambda</math> and corresponds to the value at spw 0. For other spws, the value is scaled with the corresponding frequency. During the self-calibration process, often spws are averaged to make an image. The two parameters named ''max_frac_freq_avg'' and ''avg_spw_max'' controls the maximum bandwidth over which this averaging can happen. ''max_frac_freq_avg'' is equal to the fractional bandwidth and is given by <math>(f_u-f_l)*2/(f_u+f_l)</math>, where <math>f_u,f_l</math> are the lower and upper edges of the band to be averaged. ''avg_spw_max'' is the maximum number of spws which can be averaged. During averaging both these parameters are calculated and the averaging stops when one of them is satisfied. If the user wants an antenna to be flagged other than antennas 13~15, that list should be supplied in ''flag_antennas'' . The image phasecenter is often shifted close to the location of the flare, so as to make a smaller image. Hence a custom phasecenter is used. The user has the option to provide the desired phasecenter in the input ''phasecenter'' or if left blank, the code will try to calculate it automatically.

'''Important steps in pipeline'''

* ''Find time of self-calibration '' : The flare times are first detected, because the self-calibration is performed only once by the pipeline for a dataset. If the user intends to perform self-calibration at multiple times, the dataset should be split around the times of interest. For each spw, the auto-correlations are extracted and the median and median absolute deviation of the timeseries are calculated. The times at which the auto-correlation value exceeds the threshold are noted down. The longest time interval for which the value is higher than the threshold is identified with the flare duration. A time interval of length duration/3 around the peak is chosen for self-calibration. The minimum time interval is chosen to be 10s and the maximum is chosen to be 1 minute. If no value is found above the threshold, we choose 1 minute around the peak for self-calibration. These times are identified as ''quiet times'' and other times are identified as ''flaring times''.

EOVSA flare pipeline

2022-01-19T19:40:15Z

Smondal:

The frequency of observing calibrator sources during EOVSA solar observations is much less than that one typically would like to observe to properly take into account the instrumental gain variations. Hence self-calibration is often needed to calibrate the data to a level of satisfaction. A self-calibration pipeline suitable for generating calibrated dataset and quicklook images have been developed. Here we explain the various inputs of that pipeline and discuss various factors that is needed to be considered before supplying the input values. We also provide the steps for running the code on the pipeline machine.

'''Format of the pipeline'''

The pipeline for now consists of an input file and two codes. The input file is named as ''inputs.py'' . The other two codes are ''gen_IDB_MS.py'' and ''IDB_selfcal_pipeline_version.py''. The code ''gen_IDB_MS.py'' is used to generate the measurement set (MS) from the raw files and calibrate the data using the gaintables derived from the calibrator observations. The second script is where the self-calibration happens. The main reason for having two separate codes is that "gen_IDB_MS.py" uses SUNCASA which for now runs on CASA versions<=5.4 . However, ''IDB_selfcal_pipeline_version.py'' requires CASA >=5.6. Hence for now the user needs to run the codes using the appropriate CASA versions.

'''Description of the inputs'''

An example inputs file in given below.

<pre>
## Task handlers ###
cal_disk = 0 ## apply calibration tables from full disc imaging
identify_data_gap=1 ### identify data gaps
doslfcal = 1 # main cycle of doing selfcalibration
doapply = 0 # apply the results

# ============ declaring the working directories ============
### remember / is necessary in all the folder names

workpath = '/data1/testing/20211101/'
slfcaldir = workpath+ 'slfcal_v3/' # place to put all selfcalibration products
imagedir = slfcaldir + 'images/' # place to put all selfcalibration images
caltbdir = slfcaldir+'caltables/' # place to put calibration tables
slfdisktbdir = slfcaldir + 'slfdisktb/'

# ============= time to image =================
starttime='2017-08-20 19:20:00' ### has strict formating rules
endtime='2017-08-20 19:48:00'

# ============ selfcal parameters ===============
refantenna = '0'
calc_cell=True ### If set to False use the value in beam given below
cell=[10] ### size needs to be same as the number of spw listed in selfcal_spw
calc_imsize=True ### is False uses the value given below
imsize=42 ### in solar radius, the full image size at the first frequency. Other frequencies, the value will be scaled.
### The default value of 42 solar radius is for ~1 GHz

max_frac_freq_avg=0.5 ### I will average at most this much fractional bandwidth

maxiter=10 ### maximum selfcal iterations
uvlim=25
avg_spw_max=5
flag_antennas = '' ###anything except 13~15. Those antennas are always flagged.
phasecenter=''

# ========== end of input parameters =================
</pre>

The ''task handlers'' listed in the ''inputs.py'' controls what functions will be performed by the ''IDB_selfcal_pipeline_version.py''. A value of ''0'' means that functionality will be run. Please give ''1'' as input if the said task is desired. The next group of inputs are the ''working directories''. After that, the time duration of interest should be provided. Please note that the format used when providing the ''starttime'' and ''endtime'' should be followed exactly as given in the above example. The next group of inputs are those which control different imaging and calibration parameters. ''refantenna'' is the index of the reference antenna which is used during the calibration. The user has the choice to either provide the cell size and manually, or the code can calculate it based on the maximum uv value. Please set the parameter ''calc_cell'' to ''True'' if automatic setting of parameter value is desired. If set to ''False'', the user must provide the cell size for all the spws. Please note that the unit of the cell size is in arcseconds. Current the parameters ''calc_imsize'' and ''imsize'' are not used. The ''imsize'' is always set to 4096, which means that the total area imaged is equal to ''4096''x''cell size''. ''maxiter'' is the maximum number of selfcal iterations which can happen. During the self-calibration step, we use uv values above a cutoff. The cutoff is controlled by the parameter ''uvlim''. The value of this parameter is in units of <math>\lambda</math> and corresponds to the value at spw 0. For other spws, the value is scaled with the corresponding frequency. During the self-calibration process, often spws are averaged to make an image. The two parameters named ''max_frac_freq_avg'' and ''avg_spw_max'' controls the maximum bandwidth over which this averaging can happen. ''max_frac_freq_avg'' is equal to the fractional bandwidth and is given by <math>(f_u-f_l)*2/(f_u+f_l)</math>, where <math>f_u,f_l</math> are the lower and upper edges of the band to be averaged. ''avg_spw_max'' is the maximum number of spws which can be averaged. During averaging both these parameters are calculated and the averaging stops when one of them is satisfied. If the user wants an antenna to be flagged other than antennas 13~15, that list should be supplied in ''flag_antennas'' . The image phasecenter is often shifted close to the location of the flare, so as to make a smaller image. Hence a custom phasecenter is used. The user has the option to provide the desired phasecenter in the input ''phasecenter'' or if left blank, the code will try to calculate it automatically.

'''Important steps in pipeline'''

The flare times are first detected, because the self-calibration is performed only once by the pipeline for a dataset. If the user intends to perform self-calibration at multiple times, the dataset should be split around the times of interest. For each spw, the auto-correlations are extracted and the median and median absolute deviation of the timeseries are calculated. The times at which the auto-correlation value exceeds the threshold are noted down. The longest time interval for which the value is higher than the threshold is identified with the flare duration. A time interval of length duration/3 around the peak is chosen for self-calibration. The minimum time interval is chosen to be 10s and the maximum is chosen to be 1 minute. If no value is found above the threshold, we choose 1 minute around the peak for self-calibration. These times are identified as ''quiet times'' and other times are identified as ''flaring times''.

EOVSA flare pipeline

2022-01-19T19:38:58Z

Smondal:

The frequency of observing calibrator sources during EOVSA solar observations is much less than that one typically would like to observe to properly take into account the instrumental gain variations. Hence self-calibration is often needed to calibrate the data to a level of satisfaction. A self-calibration pipeline suitable for generating calibrated dataset and quicklook images have been developed. Here we explain the various inputs of that pipeline and discuss various factors that is needed to be considered before supplying the input values. We also provide the steps for running the code on the pipeline machine.

'''Format of the pipeline'''

The pipeline for now consists of an input file and two codes. The input file is named as ''inputs.py'' . The other two codes are ''gen_IDB_MS.py'' and ''IDB_selfcal_pipeline_version.py''. The code ''gen_IDB_MS.py'' is used to generate the measurement set (MS) from the raw files and calibrate the data using the gaintables derived from the calibrator observations. The second script is where the self-calibration happens. The main reason for having two separate codes is that "gen_IDB_MS.py" uses SUNCASA which for now runs on CASA versions<=5.4 . However, ''IDB_selfcal_pipeline_version.py'' requires CASA >=5.6. Hence for now the user needs to run the codes using the appropriate CASA versions.

'''Description of the inputs'''

An example inputs file in given below.

<pre>
## Task handlers ###
cal_disk = 0 ## apply calibration tables from full disc imaging
identify_data_gap=1 ### identify data gaps
doslfcal = 1 # main cycle of doing selfcalibration
doapply = 0 # apply the results

# ============ declaring the working directories ============
### remember / is necessary in all the folder names

workpath = '/data1/testing/20211101/'
slfcaldir = workpath+ 'slfcal_v3/' # place to put all selfcalibration products
imagedir = slfcaldir + 'images/' # place to put all selfcalibration images
caltbdir = slfcaldir+'caltables/' # place to put calibration tables
slfdisktbdir = slfcaldir + 'slfdisktb/'

# ============= time to image =================
starttime='2017-08-20 19:20:00' ### has strict formating rules
endtime='2017-08-20 19:48:00'

# ============ selfcal parameters ===============
refantenna = '0'
calc_cell=True ### If set to False use the value in beam given below
cell=[10] ### size needs to be same as the number of spw listed in selfcal_spw
calc_imsize=True ### is False uses the value given below
imsize=42 ### in solar radius, the full image size at the first frequency. Other frequencies, the value will be scaled.
### The default value of 42 solar radius is for ~1 GHz

max_frac_freq_avg=0.5 ### I will average at most this much fractional bandwidth

maxiter=10 ### maximum selfcal iterations
uvlim=25
avg_spw_max=5
flag_antennas = '' ###anything except 13~15. Those antennas are always flagged.
phasecenter=''

# ========== end of input parameters =================
</pre>

The ''task handlers'' listed in the ''inputs.py'' controls what functions will be performed by the ''IDB_selfcal_pipeline_version.py''. A value of ''0'' means that functionality will be run. Please give ''1'' as input if the said task is desired. The next group of inputs are the ''working directories''. After that, the time duration of interest should be provided. Please note that the format used when providing the ''starttime'' and ''endtime'' should be followed exactly as given in the above example. The next group of inputs are those which control different imaging and calibration parameters. ''refantenna'' is the index of the reference antenna which is used during the calibration. The user has the choice to either provide the cell size and manually, or the code can calculate it based on the maximum uv value. Please set the parameter ''calc_cell'' to ''True'' if automatic setting of parameter value is desired. If set to ''False'', the user must provide the cell size for all the spws. Please note that the unit of the cell size is in arcseconds. Current the parameters ''calc_imsize'' and ''imsize'' are not used. The ''imsize'' is always set to 4096, which means that the total area imaged is equal to ''4096''x''cell size''. ''maxiter'' is the maximum number of selfcal iterations which can happen. During the self-calibration step, we use uv values above a cutoff. The cutoff is controlled by the parameter ''uvlim''. The value of this parameter is in units of <math>\lambda</math> and corresponds to the value at spw 0. For other spws, the value is scaled with the corresponding frequency. During the self-calibration process, often spws are averaged to make an image. The two parameters named ''max_frac_freq_avg'' and ''avg_spw_max'' controls the maximum bandwidth over which this averaging can happen. ''max_frac_freq_avg'' is equal to the fractional bandwidth and is given by <math>(f_u-f_l)*2/(f_u+f_l)</math>, where <math>f_u,f_l</math> are the lower and upper edges of the band to be averaged. ''avg_spw_max'' is the maximum number of spws which can be averaged. During averaging both these parameters are calculated and the averaging stops when one of them is satisfied. If the user wants an antenna to be flagged other than antennas 13~15, that list should be supplied in ''flag_antennas'' . The image phasecenter is often shifted close to the location of the flare, so as to make a smaller image. Hence a custom phasecenter is used. The user has the option to provide the desired phasecenter in the input ''phasecenter'' or if left blank, the code will try to calculate it automatically.

'''Important steps in pipeline'''

The flare times are first detected, because the self-calibration is performed only once by the pipeline for a dataset. If the user intends to perform self-calibration at multiple times, the dataset should be split around the times of interest. For each spw, the auto-correlations are extracted and the median and median absolute deviation of the timeseries are calculated. The times at which the auto-correlation value exceeds the threshold are noted down. The longest time interval for which the value is higher than the threshold is identified with the flare duration. A time interval of length duration/3 around the peak is chosen for self-calibration. The minimum time interval is chosen to be 10s and the maximum is chosen to be 1 minute.

EOVSA flare pipeline

2022-01-18T22:29:07Z

Smondal:

EOVSA flare pipeline

2022-01-18T22:27:17Z

Smondal:

EOVSA flare pipeline

2022-01-18T22:25:15Z

Smondal:

EOVSA flare pipeline

2022-01-18T22:21:22Z

Smondal:

EOVSA flare pipeline

2022-01-18T22:16:21Z

Smondal:

EOVSA flare pipeline

2022-01-18T22:15:29Z

Smondal:

EOVSA flare pipeline

2022-01-18T22:11:31Z

Smondal:

EOVSA flare pipeline

2022-01-18T22:10:29Z

Smondal:

EOVSA flare pipeline

2022-01-18T22:10:11Z

Smondal:

EOVSA flare pipeline

2022-01-18T22:07:48Z

Smondal:

EOVSA flare pipeline

2022-01-18T22:04:00Z

Smondal:

EOVSA flare pipeline

2022-01-18T21:07:04Z

Smondal:

EOVSA flare pipeline

2022-01-18T21:05:38Z

Smondal:

EOVSA flare pipeline

2022-01-18T21:04:46Z

Smondal:

EOVSA flare pipeline

2022-01-18T20:56:31Z

Smondal:

EOVSA flare pipeline

2022-01-18T20:55:04Z

Smondal:

EOVSA flare pipeline

2022-01-13T15:45:43Z

Smondal:

EOVSA flare pipeline

2022-01-13T15:43:14Z

Smondal:

EOVSA flare pipeline

2022-01-13T15:41:35Z

Smondal:

EOVSA flare pipeline

2022-01-13T15:33:37Z

Smondal:

EOVSA flare pipeline

2022-01-13T15:29:58Z

Smondal:

EOVSA flare pipeline

2022-01-13T15:27:55Z

Smondal:

EOVSA flare pipeline

2022-01-13T15:23:07Z

Smondal: Created page with "The frequency of observing calibrator sources during EOVSA solar observations is much less than that one typically would like to observe to properly take into account the inst..."

Owens Valley Solar Arrays

2022-01-13T15:15:18Z

Smondal: /* Using EOVSA Data */

[[File:Eovsa1.png|border|text-top|800px]]

<big>[http://ovsa.njit.edu/ EOVSA] (Expanded Owens Valley Solar Array) is a new solar-dedicated radio interferometer operated by the New Jersey Institute of Technology. This wiki serves as the site for EOVSA documentation. </big>

== EOVSA Documentation ==

* <big>General</big>
** [[Downconversion and Frequency Tuning]]
** [[Dealing with Radio Frequency Interference]]
** [[Switching between 200 MHz and 300 MHz Correlator]]

* <big>Computer-Network</big>
** [[Computing Systems]]
** [[Network]]

* <big>Control System</big>
** [[27-m Antenna Commands]]
** [[Schedule Commands]]
** [[Control Commands]]
** [[Attenuation and Level Control]]

* <big>Hardware</big>
** [[Hardware Overview]]
** [[2.1-m Antennas]]
** [[27-m Antennas]]

* <big>System Software</big>
** [[Calibration Database]]
** [[Stateframe Database]]
** [[Create CASA measurement sets]]

* <big>Calibration</big>
**[[Calibration Overview]]
**[[Pointing Calibration]]
**[[Total Power Calibration]]
**[[System Gain Calibration]]
**[[Antenna Position]] (Baseline Calibration)
**[[Reference Gain Calibration]]
**[[Daily Gain Calibration]]
**[[Delay Calibration]]
**[[Bandpass Calibration]]
**[[Polarization Calibration]]
**[[Calibrator Survey]]
**[[Practical Calibration Tutorial]]

* <big>[[Starburst]]</big>

== Using EOVSA Data ==
* <big>[[EOVSA Data products]]</big>
* <big>Analysis Software</big>
** [https://github.com/suncasa/suncasa SunCASA] A wrapper around [https://casa.nrao.edu/ CASA (the Common Astronomy Software Applications package)] for synthesis imaging and visualizing solar spectral imaging data. CASA is one of the leading software tool for "supporting the data post-processing needs of the next generation of radio astronomical telescopes such as ALMA and VLA", an international effort led by the [https://public.nrao.edu/ National Radio Astronomy Observatory]. The current version of CASA uses Python (2.7) interface. More information about CASA can be found on [https://casa.nrao.edu/ NRAO's CASA website ]. Note, CASA is available ONLY on UNIX-BASED PLATFORMS (and therefore, so is SunCASA).
** [https://github.com/Gelu-Nita/GSFIT GSFIT] A IDL-widget(GUI)-based spectral fitting package called gsfit, which provides a user-friendly display of EOVSA image cubes and an interface to fast fitting codes (via platform-dependent shared-object libraries).
** [[Spectrogram Software]]
** [[Mapping Software]]
* <big>Data Analysis Guides</big>
** <big>[https://colab.research.google.com/drive/1lSLLxgOG6b8kgu9Sk6kSKvrViyubnXG6?usp=sharing#scrollTo=xbXyyLmCFCGL EOVSA Data Analysis Tutorial at RHESSI 19 Workshop]</big>
** <big>[[EOVSA Data Analysis Tutorial]]</big> at [http://rhessi18.umn.edu/ RHESSI XVIII Workshop]
** [[Self-Calibrating Flare Data]] Example script and guides for self-calibrating EOVSA flare data (to be completed)


**[[IDB flare pipeline]] Tutorial to run the flare pipeline for quicklook images



* <big>EOVSA Modeling Guide</big>
**[[GX Simulator]]

* Other helpful links
** [https://casaguides.nrao.edu CASA Guides]
** [http://www.lmsal.com/solarsoft/ SolarSoft IDL]
** [http://www.atnf.csiro.au/computing/software/miriad/userguide/userhtml.html Miriad Guides]
** [https://sites.google.com/site/fgscodes/ Fast Gyrosynchrotron Codes (Alexey Kuznetsov's website)]
** [[Basic GitHub Tutorial]]


* <big>[[Full Disk Simulations]]</big>
* <big>[[All-Day Synthesis Issues]]</big>
* <big>[[Analyzing Pre-2017 Data]]</big>
* <big>[[Fixing Pipeline Problems pre-2021-Feb-07]]</big>

== System Software ==

* LabVIEW software
* Python code [https://github.com/dgary50/eovsa Github repository]

== Observing Log ==
[[2016 November]]; [[2016 December| December]]

[[2017 January]]; [[2017 February | February]]; [[2017 March | March]]; [[2017 April | April]]; [[2017 May | May]]; [[2017 June | June]];
[[2017 July | July]]; [[2017 August | August]]; [[2017 September | September]]; [[2017 October | October]]; [[2017 November | November]]; [[2017 December | December]]

[[2018 January]]; [[2018 February | February]]; [[2018 March | March]]; [[2018 April | April]]; [[2018 May | May]]; [[2018 June | June]];
[[2018 July | July]]; [[2018 August | August]]; [[2018 September | September]]; [[2018 October | October]]; [[2018 November | November]]; [[2018 December | December]]

[[2019 January]]; [[2019 February | February]]; [[2019 March | March]]; [[2019 April | April]]; [[2019 May | May]]; [[2019 June | June]];
[[2019 July | July]]; [[2019 August | August]]; [[2019 September | September]]; [[2019 October | October]]; [[2019 November | November]]; [[2019 December | December]]

[[2020 January]]; [[2020 February | February]]; [[2020 March | March]]; [[2020 April | April]]; [[2020 May | May]]; [[2020 June | June]];
[[2020 July | July]]; [[2020 August | August]]; [[2020 September | September]]; [[2020 October | October]]; [[2020 November | November]]; [[2020 December | December]]

[[2021 January]]; [[2021 February | February]]; [[2021 March | March]]; [[2021 April | April]]; [[2021 May | May]]; [[2021 June | June]];
[[2021 July | July]]; [[2021 August | August]]; [[2021 September | September]]; [[2021 October | October]]; [[2021 November | November]]; [[2021 December | December]]

== Tohbans ==

[[Trouble Shooting Guide]]

[[Tohban Records]]

[[Owen's Notes]]

[[Tohban EOVSA Imaging Tutorial A-Z]]

== EOVSA Flare List ==

See [https://docs.google.com/spreadsheets/d/1P8jHuDRF93dMflU6RMQcsJqVepD9vFkPkofV8Imj4xA/edit?usp=sharing this link] for a list of EOVSA flares as a Google Spreadsheet.

[[Recent Flare List (2021)]]

[http://ovsa.njit.edu/jay/rd_db.php An older link] is available at the EOVSA website.

== EOVSA Publications ==
Here is a (partial) list of publications that utilize EOVSA data. See also the collection of EOVSA publications at [https://ui.adsabs.harvard.edu/public-libraries/eQ7HfPkySqydu-B8BCt6QQ this NASA/ADS Library].
; 2021
: [https://ui.adsabs.harvard.edu/abs/2021arXiv211015751L/abstract Lopez et al. (2021), arXiv 2110.15751] ''A solar flare driven by thermal conduction observed in mid-infrared''
: [https://ui.adsabs.harvard.edu/abs/2021ApJ...923..213W/abstract Wei et al. (2021), ApJ, 923, 213] ''Coronal Magnetic Field Measurements along a Partially Erupting Filament in a Solar Flare''
: [https://ui.adsabs.harvard.edu/abs/2021ApJ...919...44S/abstract Shaik & Gary (2021), ApJ, 919, 44] ''Implications of Flat Optically Thick Microwave Spectra in Solar Flares for Source Size and Morphology''
: [https://ui.adsabs.harvard.edu/abs/2021ApJ...915...12K/abstract Kocharov et al. (2021), ApJ, 915, 12] ''Multiple Sources of Solar High-energy Protons''
: [https://ui.adsabs.harvard.edu/abs/2021ApJ...908L..55C/abstract Chen et al. (2021), ApJL, 908, L55] ''Energetic Electron Distribution of the Coronal Acceleration Region: First results from Joint Microwave and Hard X-ray Imaging Spectroscopy''
: [https://ui.adsabs.harvard.edu/abs/2021ApJ...906..132C/abstract Chhabra et al. (2021), ApJ, 906, 132] ''Imaging Spectroscopy of CME-Associated Solar Radio Bursts''
; 2020
: [https://ui.adsabs.harvard.edu/abs/2020ApJ...905..165R/abstract Reeves et al. (2020), ApJ, 905, 165] ''Hot Plasma Flows and Oscillations in the Loop-top Region During the September 10 2017 X8.2 Solar Flare''
: [https://ui.adsabs.harvard.edu/abs/2020ApJ...900...17Y/abstract Yu et al. (2020), ApJ, 900, 17] ''Magnetic Reconnection During the Post Impulsive Phase of the X8.2 Solar Flare: Bi-Directional Outflows as a Cause of Microwave and X-ray Bursts''
: [https://ui.adsabs.harvard.edu/abs/2020NatAs...4.1140C/abstract Chen et al. (2020b), Nature Astronomy, 4, 1140] ''Measurement of magnetic field and relativistic electrons along a solar flare current sheet''
: [https://ui.adsabs.harvard.edu/abs/2020ApJ...895L..50C/abstract Chen et al. (2020a), ApJL, 895, 50] ''Microwave Spectral Imaging of an Erupting Magnetic Flux Rope: Implications for the Standard Solar Flare Model in Three Dimensions''
: [https://ui.adsabs.harvard.edu/abs/2020FrASS...7...22K/abstract Kuroda et al. (2020), Frontiers, 7, 22] ''Evolution of Flare-accelerated Electrons Quantified by Spatially Resolved Analysis''
: [https://ui.adsabs.harvard.edu/abs/2020ApJ...891L..34G/abstract Glesener et al. (2020), ApJL, 891, 34] ''Accelerated Electrons Observed Down to <7 keV in a NuSTAR Solar Microflare''
: [https://ui.adsabs.harvard.edu/abs/2020ApJ...889...72K/abstract Karlicky at al. (2020), ApJ, 889, 72] ''Drifting Pulsation Structure at the Very Beginning of the 2017 September 10 Limb Flare''
: [https://ui.adsabs.harvard.edu/abs/2020Sci...367..278F/abstract Fleishman et al. (2020), Science, 367, 278] ''Decay of the coronal magnetic field can release sufficient energy to power a solar flare''
: [https://ui.adsabs.harvard.edu/abs/2020AAS...23538501G/abstract Gary et al. (2020), BAAS 52, 385.01] [https://aas235-aas.ipostersessions.com/default.aspx?s=97-69-9E-4B-34-19-68-53-1B-C6-21-0C-16-1C-5C-82&guestview=true Direct link to AAS iPoster] ''A new view of the solar atmosphere: daily full-disk multifrequency radio images from EOVSA''
; 2018
: [https://ui.adsabs.harvard.edu/#abs/2018ApJ...864...63P/abstract Polito et al. (2018), ApJ, 864, 63] ''Broad Non-Gaussian Fe XXIV Line Profiles in the Impulsive Phase of the 2017 September 10 X8.3-class Flare Observed by Hinode/EIS''
: [https://ui.adsabs.harvard.edu/#abs/2018ApJ...863...83G/abstract Gary et al. (2018), ApJ, 863, 83] ''Microwave and Hard X-Ray Observations of the 2017 September 10 Solar Limb Flare''
: [https://ui.adsabs.harvard.edu/#abs/2018ApJ...852...32K/abstract Kuroda et al. (2018), ApJ, 852, 32] ''Three-dimensional Forward-fit Modeling of the Hard X-ray and the Microwave Emissions of the 2015 June 22 M6.5 flare''
; 2017
: [https://ui.adsabs.harvard.edu/abs/2017NatAs...1E..85W/abstract Wang et al. (2017), Nature Astronomy, 1, 85] ''High-resolution observations of flare precursors in the low solar atmosphere''
; 2016
: [https://ui.adsabs.harvard.edu/abs/2016JAI.....541009N/abstract Nita et al. (2016), J. Astron. Instr., 5, 1641009-7366] ''EOVSA Implementation of a Spectral Kurtosis Correlator for Transient Detection and Classification''

== VLA Flare List and Publications ==
See [http://www.ovsa.njit.edu/wiki/index.php/VLA_Data_Survey#List_of_Jansky_VLA_Solar_Observations this link] for a list of flare observations made by the [https://science.nrao.edu/facilities/vla/ Karl G. Jansky Very Large Array] (VLA). Below is a partial list of publications that utilize VLA solar data (see also [https://ui.adsabs.harvard.edu/public-libraries/ZwbjpLo9RS-viufWEoQ95Q this NASA/ADS Library]).
* [https://ui.adsabs.harvard.edu/abs/2021ApJ...911....4L/abstract Luo et al. (2021), ApJ, 911, 4] ''Radio Spectral Imaging of an M8.4 Eruptive Solar Flare: Possible Evidence of a Termination Shock''
* [https://ui.adsabs.harvard.edu/abs/2021ApJ...910...40Z/abstract Zhang et al. (2021), ApJ, 910, 40] ''Multiwavelength Observations of the Formation and Eruption of a Complex Filament''
* [https://ui.adsabs.harvard.edu/abs/2020ApJ...904...94S/abstract Sharma et al. (2020), ApJ, 904, 94] ''Radio and X-Ray Observations of Short-lived Episodes of Electron Acceleration in a Solar Microflare''
* [https://ui.adsabs.harvard.edu/abs/2019ApJ...884...63C/abstract Chen et al. (2019), ApJ, 884, 63] ''Radio Spectroscopic Imaging of a Solar Flare Termination Shock: Split-band Feature as Evidence for Shock Compression''
* [https://ui.adsabs.harvard.edu/abs/2019ApJ...872...71Y/abstract Yu & Chen (2019), ApJ, 872, 71] ''Possible Detection of Subsecond-period Propagating Magnetohydrodynamics Waves in Post-reconnection Magnetic Loops during a Two-ribbon Solar Flare''
* [https://ui.adsabs.harvard.edu/abs/2018ApJ...866...62C/abstract Chen et al. (2018), ApJ, 866, 62] ''Magnetic Reconnection Null Points as the Origin of Semirelativistic Electron Beams in a Solar Jet
''
* [https://ui.adsabs.harvard.edu/abs/2017ApJ...848...77W/abstract Wang et al. (2016), ApJ, 848, 77] ''Dynamic Spectral Imaging of Decimetric Fiber Bursts in an Eruptive Solar Flare''
* [https://ui.adsabs.harvard.edu/abs/2015Sci...350.1238C/abstract Chen et al. (2015), Science, 350, 1238] ''Particle acceleration by a solar flare termination shock''
* [https://ui.adsabs.harvard.edu/abs/2014ApJ...794..149C/abstract Chen et al. (2014), ApJ, 794, 149] ''Direct Evidence of an Eruptive, Filament-hosting Magnetic Flux Rope Leading to a Fast Solar Coronal Mass Ejection''
* [https://ui.adsabs.harvard.edu/abs/2013ApJ...763L..21C/abstract Chen et al. (2013), ApJL, 763, 21] ''Tracing Electron Beams in the Sun's Corona with Radio Dynamic Imaging Spectroscopy''

Owens Valley Solar Arrays

2022-01-13T15:14:40Z

Smondal: /* Using EOVSA Data */

[[File:Eovsa1.png|border|text-top|800px]]

<big>[http://ovsa.njit.edu/ EOVSA] (Expanded Owens Valley Solar Array) is a new solar-dedicated radio interferometer operated by the New Jersey Institute of Technology. This wiki serves as the site for EOVSA documentation. </big>

== EOVSA Documentation ==

* <big>General</big>
** [[Downconversion and Frequency Tuning]]
** [[Dealing with Radio Frequency Interference]]
** [[Switching between 200 MHz and 300 MHz Correlator]]

* <big>Computer-Network</big>
** [[Computing Systems]]
** [[Network]]

* <big>Control System</big>
** [[27-m Antenna Commands]]
** [[Schedule Commands]]
** [[Control Commands]]
** [[Attenuation and Level Control]]

* <big>Hardware</big>
** [[Hardware Overview]]
** [[2.1-m Antennas]]
** [[27-m Antennas]]

* <big>System Software</big>
** [[Calibration Database]]
** [[Stateframe Database]]
** [[Create CASA measurement sets]]

* <big>Calibration</big>
**[[Calibration Overview]]
**[[Pointing Calibration]]
**[[Total Power Calibration]]
**[[System Gain Calibration]]
**[[Antenna Position]] (Baseline Calibration)
**[[Reference Gain Calibration]]
**[[Daily Gain Calibration]]
**[[Delay Calibration]]
**[[Bandpass Calibration]]
**[[Polarization Calibration]]
**[[Calibrator Survey]]
**[[Practical Calibration Tutorial]]

* <big>[[Starburst]]</big>

== Using EOVSA Data ==
* <big>[[EOVSA Data products]]</big>
* <big>Analysis Software</big>
** [https://github.com/suncasa/suncasa SunCASA] A wrapper around [https://casa.nrao.edu/ CASA (the Common Astronomy Software Applications package)] for synthesis imaging and visualizing solar spectral imaging data. CASA is one of the leading software tool for "supporting the data post-processing needs of the next generation of radio astronomical telescopes such as ALMA and VLA", an international effort led by the [https://public.nrao.edu/ National Radio Astronomy Observatory]. The current version of CASA uses Python (2.7) interface. More information about CASA can be found on [https://casa.nrao.edu/ NRAO's CASA website ]. Note, CASA is available ONLY on UNIX-BASED PLATFORMS (and therefore, so is SunCASA).
** [https://github.com/Gelu-Nita/GSFIT GSFIT] A IDL-widget(GUI)-based spectral fitting package called gsfit, which provides a user-friendly display of EOVSA image cubes and an interface to fast fitting codes (via platform-dependent shared-object libraries).
** [[Spectrogram Software]]
** [[Mapping Software]]
* <big>Data Analysis Guides</big>
** <big>[https://colab.research.google.com/drive/1lSLLxgOG6b8kgu9Sk6kSKvrViyubnXG6?usp=sharing#scrollTo=xbXyyLmCFCGL EOVSA Data Analysis Tutorial at RHESSI 19 Workshop]</big>
** <big>[[EOVSA Data Analysis Tutorial]]</big> at [http://rhessi18.umn.edu/ RHESSI XVIII Workshop]
** [[Self-Calibrating Flare Data]] Example script and guides for self-calibrating EOVSA flare data (to be completed)


[[IDB flare pipeline]] Tutorial to run the flare pipeline for quicklook images



* <big>EOVSA Modeling Guide</big>
**[[GX Simulator]]

* Other helpful links
** [https://casaguides.nrao.edu CASA Guides]
** [http://www.lmsal.com/solarsoft/ SolarSoft IDL]
** [http://www.atnf.csiro.au/computing/software/miriad/userguide/userhtml.html Miriad Guides]
** [https://sites.google.com/site/fgscodes/ Fast Gyrosynchrotron Codes (Alexey Kuznetsov's website)]
** [[Basic GitHub Tutorial]]


* <big>[[Full Disk Simulations]]</big>
* <big>[[All-Day Synthesis Issues]]</big>
* <big>[[Analyzing Pre-2017 Data]]</big>
* <big>[[Fixing Pipeline Problems pre-2021-Feb-07]]</big>

== System Software ==

* LabVIEW software
* Python code [https://github.com/dgary50/eovsa Github repository]

== Observing Log ==
[[2016 November]]; [[2016 December| December]]

[[2017 January]]; [[2017 February | February]]; [[2017 March | March]]; [[2017 April | April]]; [[2017 May | May]]; [[2017 June | June]];
[[2017 July | July]]; [[2017 August | August]]; [[2017 September | September]]; [[2017 October | October]]; [[2017 November | November]]; [[2017 December | December]]

[[2018 January]]; [[2018 February | February]]; [[2018 March | March]]; [[2018 April | April]]; [[2018 May | May]]; [[2018 June | June]];
[[2018 July | July]]; [[2018 August | August]]; [[2018 September | September]]; [[2018 October | October]]; [[2018 November | November]]; [[2018 December | December]]

[[2019 January]]; [[2019 February | February]]; [[2019 March | March]]; [[2019 April | April]]; [[2019 May | May]]; [[2019 June | June]];
[[2019 July | July]]; [[2019 August | August]]; [[2019 September | September]]; [[2019 October | October]]; [[2019 November | November]]; [[2019 December | December]]

[[2020 January]]; [[2020 February | February]]; [[2020 March | March]]; [[2020 April | April]]; [[2020 May | May]]; [[2020 June | June]];
[[2020 July | July]]; [[2020 August | August]]; [[2020 September | September]]; [[2020 October | October]]; [[2020 November | November]]; [[2020 December | December]]

[[2021 January]]; [[2021 February | February]]; [[2021 March | March]]; [[2021 April | April]]; [[2021 May | May]]; [[2021 June | June]];
[[2021 July | July]]; [[2021 August | August]]; [[2021 September | September]]; [[2021 October | October]]; [[2021 November | November]]; [[2021 December | December]]

== Tohbans ==

[[Trouble Shooting Guide]]

[[Tohban Records]]

[[Owen's Notes]]

[[Tohban EOVSA Imaging Tutorial A-Z]]

== EOVSA Flare List ==

See [https://docs.google.com/spreadsheets/d/1P8jHuDRF93dMflU6RMQcsJqVepD9vFkPkofV8Imj4xA/edit?usp=sharing this link] for a list of EOVSA flares as a Google Spreadsheet.

[[Recent Flare List (2021)]]

[http://ovsa.njit.edu/jay/rd_db.php An older link] is available at the EOVSA website.

== EOVSA Publications ==
Here is a (partial) list of publications that utilize EOVSA data. See also the collection of EOVSA publications at [https://ui.adsabs.harvard.edu/public-libraries/eQ7HfPkySqydu-B8BCt6QQ this NASA/ADS Library].
; 2021
: [https://ui.adsabs.harvard.edu/abs/2021arXiv211015751L/abstract Lopez et al. (2021), arXiv 2110.15751] ''A solar flare driven by thermal conduction observed in mid-infrared''
: [https://ui.adsabs.harvard.edu/abs/2021ApJ...923..213W/abstract Wei et al. (2021), ApJ, 923, 213] ''Coronal Magnetic Field Measurements along a Partially Erupting Filament in a Solar Flare''
: [https://ui.adsabs.harvard.edu/abs/2021ApJ...919...44S/abstract Shaik & Gary (2021), ApJ, 919, 44] ''Implications of Flat Optically Thick Microwave Spectra in Solar Flares for Source Size and Morphology''
: [https://ui.adsabs.harvard.edu/abs/2021ApJ...915...12K/abstract Kocharov et al. (2021), ApJ, 915, 12] ''Multiple Sources of Solar High-energy Protons''
: [https://ui.adsabs.harvard.edu/abs/2021ApJ...908L..55C/abstract Chen et al. (2021), ApJL, 908, L55] ''Energetic Electron Distribution of the Coronal Acceleration Region: First results from Joint Microwave and Hard X-ray Imaging Spectroscopy''
: [https://ui.adsabs.harvard.edu/abs/2021ApJ...906..132C/abstract Chhabra et al. (2021), ApJ, 906, 132] ''Imaging Spectroscopy of CME-Associated Solar Radio Bursts''
; 2020
: [https://ui.adsabs.harvard.edu/abs/2020ApJ...905..165R/abstract Reeves et al. (2020), ApJ, 905, 165] ''Hot Plasma Flows and Oscillations in the Loop-top Region During the September 10 2017 X8.2 Solar Flare''
: [https://ui.adsabs.harvard.edu/abs/2020ApJ...900...17Y/abstract Yu et al. (2020), ApJ, 900, 17] ''Magnetic Reconnection During the Post Impulsive Phase of the X8.2 Solar Flare: Bi-Directional Outflows as a Cause of Microwave and X-ray Bursts''
: [https://ui.adsabs.harvard.edu/abs/2020NatAs...4.1140C/abstract Chen et al. (2020b), Nature Astronomy, 4, 1140] ''Measurement of magnetic field and relativistic electrons along a solar flare current sheet''
: [https://ui.adsabs.harvard.edu/abs/2020ApJ...895L..50C/abstract Chen et al. (2020a), ApJL, 895, 50] ''Microwave Spectral Imaging of an Erupting Magnetic Flux Rope: Implications for the Standard Solar Flare Model in Three Dimensions''
: [https://ui.adsabs.harvard.edu/abs/2020FrASS...7...22K/abstract Kuroda et al. (2020), Frontiers, 7, 22] ''Evolution of Flare-accelerated Electrons Quantified by Spatially Resolved Analysis''
: [https://ui.adsabs.harvard.edu/abs/2020ApJ...891L..34G/abstract Glesener et al. (2020), ApJL, 891, 34] ''Accelerated Electrons Observed Down to <7 keV in a NuSTAR Solar Microflare''
: [https://ui.adsabs.harvard.edu/abs/2020ApJ...889...72K/abstract Karlicky at al. (2020), ApJ, 889, 72] ''Drifting Pulsation Structure at the Very Beginning of the 2017 September 10 Limb Flare''
: [https://ui.adsabs.harvard.edu/abs/2020Sci...367..278F/abstract Fleishman et al. (2020), Science, 367, 278] ''Decay of the coronal magnetic field can release sufficient energy to power a solar flare''
: [https://ui.adsabs.harvard.edu/abs/2020AAS...23538501G/abstract Gary et al. (2020), BAAS 52, 385.01] [https://aas235-aas.ipostersessions.com/default.aspx?s=97-69-9E-4B-34-19-68-53-1B-C6-21-0C-16-1C-5C-82&guestview=true Direct link to AAS iPoster] ''A new view of the solar atmosphere: daily full-disk multifrequency radio images from EOVSA''
; 2018
: [https://ui.adsabs.harvard.edu/#abs/2018ApJ...864...63P/abstract Polito et al. (2018), ApJ, 864, 63] ''Broad Non-Gaussian Fe XXIV Line Profiles in the Impulsive Phase of the 2017 September 10 X8.3-class Flare Observed by Hinode/EIS''
: [https://ui.adsabs.harvard.edu/#abs/2018ApJ...863...83G/abstract Gary et al. (2018), ApJ, 863, 83] ''Microwave and Hard X-Ray Observations of the 2017 September 10 Solar Limb Flare''
: [https://ui.adsabs.harvard.edu/#abs/2018ApJ...852...32K/abstract Kuroda et al. (2018), ApJ, 852, 32] ''Three-dimensional Forward-fit Modeling of the Hard X-ray and the Microwave Emissions of the 2015 June 22 M6.5 flare''
; 2017
: [https://ui.adsabs.harvard.edu/abs/2017NatAs...1E..85W/abstract Wang et al. (2017), Nature Astronomy, 1, 85] ''High-resolution observations of flare precursors in the low solar atmosphere''
; 2016
: [https://ui.adsabs.harvard.edu/abs/2016JAI.....541009N/abstract Nita et al. (2016), J. Astron. Instr., 5, 1641009-7366] ''EOVSA Implementation of a Spectral Kurtosis Correlator for Transient Detection and Classification''

== VLA Flare List and Publications ==
See [http://www.ovsa.njit.edu/wiki/index.php/VLA_Data_Survey#List_of_Jansky_VLA_Solar_Observations this link] for a list of flare observations made by the [https://science.nrao.edu/facilities/vla/ Karl G. Jansky Very Large Array] (VLA). Below is a partial list of publications that utilize VLA solar data (see also [https://ui.adsabs.harvard.edu/public-libraries/ZwbjpLo9RS-viufWEoQ95Q this NASA/ADS Library]).
* [https://ui.adsabs.harvard.edu/abs/2021ApJ...911....4L/abstract Luo et al. (2021), ApJ, 911, 4] ''Radio Spectral Imaging of an M8.4 Eruptive Solar Flare: Possible Evidence of a Termination Shock''
* [https://ui.adsabs.harvard.edu/abs/2021ApJ...910...40Z/abstract Zhang et al. (2021), ApJ, 910, 40] ''Multiwavelength Observations of the Formation and Eruption of a Complex Filament''
* [https://ui.adsabs.harvard.edu/abs/2020ApJ...904...94S/abstract Sharma et al. (2020), ApJ, 904, 94] ''Radio and X-Ray Observations of Short-lived Episodes of Electron Acceleration in a Solar Microflare''
* [https://ui.adsabs.harvard.edu/abs/2019ApJ...884...63C/abstract Chen et al. (2019), ApJ, 884, 63] ''Radio Spectroscopic Imaging of a Solar Flare Termination Shock: Split-band Feature as Evidence for Shock Compression''
* [https://ui.adsabs.harvard.edu/abs/2019ApJ...872...71Y/abstract Yu & Chen (2019), ApJ, 872, 71] ''Possible Detection of Subsecond-period Propagating Magnetohydrodynamics Waves in Post-reconnection Magnetic Loops during a Two-ribbon Solar Flare''
* [https://ui.adsabs.harvard.edu/abs/2018ApJ...866...62C/abstract Chen et al. (2018), ApJ, 866, 62] ''Magnetic Reconnection Null Points as the Origin of Semirelativistic Electron Beams in a Solar Jet
''
* [https://ui.adsabs.harvard.edu/abs/2017ApJ...848...77W/abstract Wang et al. (2016), ApJ, 848, 77] ''Dynamic Spectral Imaging of Decimetric Fiber Bursts in an Eruptive Solar Flare''
* [https://ui.adsabs.harvard.edu/abs/2015Sci...350.1238C/abstract Chen et al. (2015), Science, 350, 1238] ''Particle acceleration by a solar flare termination shock''
* [https://ui.adsabs.harvard.edu/abs/2014ApJ...794..149C/abstract Chen et al. (2014), ApJ, 794, 149] ''Direct Evidence of an Eruptive, Filament-hosting Magnetic Flux Rope Leading to a Fast Solar Coronal Mass Ejection''
* [https://ui.adsabs.harvard.edu/abs/2013ApJ...763L..21C/abstract Chen et al. (2013), ApJL, 763, 21] ''Tracing Electron Beams in the Sun's Corona with Radio Dynamic Imaging Spectroscopy''