Tohban EOVSA Imaging Tutorial A-Z - Revision history

Dgary: /* Calibration on your own computer */

2024-05-17T16:04:10Z

Calibration on your own computer

← Older revision		Revision as of 16:04, 17 May 2024
Line 28:		Line 28:
	* '''2024 Jan - present: http://ovsa.njit.edu/fits/IDB/'''		* '''2024 Jan - present: http://ovsa.njit.edu/fits/IDB/'''

	Once you have the file(s) identified, copy them to your local computer. One way to do that is with the wget command:		Once you have the file(s) identified for the date and time of interest, copy them to your local computer. One way to do that is with the wget command:
	<pre> wget -r --no-parent -nH --cut-dirs=3 -e robots="off" -R "index.html*" <URL> </pre>		<pre> wget -r --no-parent -nH --cut-dirs=3 -e robots="off" -R "index.html*" <URL> </pre>
	where <URL> is the path to the file(s). For example, to get the data for the flare at 2022 Nov 18 22:04 UT [http://www.ovsa.njit.edu/wiki/images/8/8c/EOVSA_20221118_C1flare.png] the URL would be http://ovsa.njit.edu/IDB2/20221118/IDB20221118215521/. Warning, these IDB "files" are actually directories, so include the trailing / in the URL or else you will transfer the entire day's data (many GB of data!). An easy way to get the URL is simply to right-click on the web link for the file and "copy link address."		where <URL> is the path to the file(s). For example, to get the data for the flare at 2022 Nov 18 22:04 UT [http://www.ovsa.njit.edu/wiki/images/8/8c/EOVSA_20221118_C1flare.png] the URL would be http://ovsa.njit.edu/IDB2/20221118/IDB20221118215521/. Warning, these IDB "files" are actually directories, so include the trailing / in the URL or else you will transfer the entire day's data (many GB of data!). An easy way to get the URL is simply to right-click on the web link for the file and "copy link address."

Dgary: /* Calibration on your own computer */

2024-05-17T16:03:34Z

Calibration on your own computer

← Older revision		Revision as of 16:03, 17 May 2024
Line 25:		Line 25:
	It is now possible to do the entire calibration procedure from anywhere by copying to your local computer one or more raw interim database (IDB) files in Miriad format and calibrating them from a cloud database. Here are the steps. First, find the IDB file(s) of interest. The IDB files are all available online at the following links:		It is now possible to do the entire calibration procedure from anywhere by copying to your local computer one or more raw interim database (IDB) files in Miriad format and calibrating them from a cloud database. Here are the steps. First, find the IDB file(s) of interest. The IDB files are all available online at the following links:

	* '''2017 Apr - ~~2023 Jul~~: https://research.ssl.berkeley.edu/data/eovsa/'''		* '''2017 Apr - present - 7 days: https://research.ssl.berkeley.edu/data/eovsa/'''
	* '''~~2023 Aug~~ - present: http://ovsa.njit.edu/fits/IDB/'''		* '''2024 Jan - present: http://ovsa.njit.edu/fits/IDB/'''

	Once you have the file(s) identified, copy them to your local computer. One way to do that is with the wget command:		Once you have the file(s) identified, copy them to your local computer. One way to do that is with the wget command:

Dgary: /* Calibration on your own computer */

2023-09-02T15:58:24Z

Calibration on your own computer

← Older revision		Revision as of 15:58, 2 September 2023
Line 25:		Line 25:
	It is now possible to do the entire calibration procedure from anywhere by copying to your local computer one or more raw interim database (IDB) files in Miriad format and calibrating them from a cloud database. Here are the steps. First, find the IDB file(s) of interest. The IDB files are all available online at the following links:		It is now possible to do the entire calibration procedure from anywhere by copying to your local computer one or more raw interim database (IDB) files in Miriad format and calibrating them from a cloud database. Here are the steps. First, find the IDB file(s) of interest. The IDB files are all available online at the following links:

	* '''2017 Apr - ~~2021 May~~: https://research.ssl.berkeley.edu/data/eovsa/'''		* '''2017 Apr - 2023 Jul: https://research.ssl.berkeley.edu/data/eovsa/'''
	* '''2021 Mar - 2022 Dec: http://ovsa.njit.edu/IDB2/''' (use --cut-dirs=2 in the wget command below to transfer from this one)		* '''2023 Aug - present: http://ovsa.njit.edu/fits/IDB/'''
	* '''2023 ~~Jan~~ - present: http://ovsa.njit.edu/fits/IDB/'''

	Once you have the file(s) identified, copy them to your local computer. One way to do that is with the wget command:		Once you have the file(s) identified, copy them to your local computer. One way to do that is with the wget command:

Dgary: /* Calibration on your own computer */

2023-06-21T12:27:46Z

Calibration on your own computer

← Older revision		Revision as of 12:27, 21 June 2023
Line 9:		Line 9:
	from suncasa.suncasatasks import calibeovsa		from suncasa.suncasatasks import calibeovsa
	from suncasa.suncasatasks import importeovsa		from suncasa.suncasatasks import importeovsa
	from casatasks import split		try:
			# Required in modular casa, but fails in stand-alone casa
			from casatasks import split
			except:
			pass
	idbfile = <IDB filename> # The path and filename of the IDB file		idbfile = <IDB filename> # The path and filename of the IDB file
	msfiles = importeovsa(idbfiles=idbfile)		msfiles = importeovsa(idbfiles=idbfile)
	vis = calibeovsa(msfiles, caltype=['refpha','phacal'])		vis, = calibeovsa(msfiles, caltype=['refpha','phacal'])
	outvis = vis.replace('.ms','_cal.ms')		outvis = vis.replace('.ms','_cal.ms')
	split(vis=vis, outputvis=outvis, correlation='XX')		split(vis=vis, outputvis=outvis, correlation='XX')

Dgary: /* Additional Requirements */

2023-06-09T16:44:07Z

Additional Requirements

← Older revision		Revision as of 16:44, 9 June 2023
Line 33:		Line 33:

	You will also need to install		You will also need to install
	#the '''suncasa''' python package (see the readme file at https://github.com/suncasa/suncasa-src for complete installation instructions),		#the '''suncasa''' python package (see the readme file at '''https://github.com/suncasa/suncasa-src''' for complete installation instructions),
	#the '''eovsapy''' python package (see https://github.com/suncasa/eovsapy for installation instructions).		#the '''eovsapy''' python package (see '''https://github.com/suncasa/eovsapy''' for installation instructions).

	== Calibration on the Pipeline computer at OVRO ==		== Calibration on the Pipeline computer at OVRO ==

Dgary: /* Calibration on your own computer */

2023-06-09T16:38:12Z

Calibration on your own computer

← Older revision		Revision as of 16:38, 9 June 2023
Line 13:		Line 13:
	msfiles = importeovsa(idbfiles=idbfile)		msfiles = importeovsa(idbfiles=idbfile)
	vis = calibeovsa(msfiles, caltype=['refpha','phacal'])		vis = calibeovsa(msfiles, caltype=['refpha','phacal'])
	outvis = ~~vis_str~~.replace('.ms','_cal.ms')		outvis = vis.replace('.ms','_cal.ms')
	split(vis=vi, outputvis=outvis, correlation='XX')		split(vis=vis, outputvis=outvis, correlation='XX')
	</pre>		</pre>

Dgary: /* Additional Requirements */

2023-06-09T16:05:19Z

Additional Requirements

← Older revision		Revision as of 16:05, 9 June 2023
Line 33:		Line 33:

	You will also need to install		You will also need to install
	#the suncasa python package (see the readme file at https://github.com/suncasa/suncasa-src for complete installation instructions),		#the '''suncasa''' python package (see the readme file at https://github.com/suncasa/suncasa-src for complete installation instructions),
	#the eovsapy python package (see https://github.com/suncasa/eovsapy for installation instructions).		#the '''eovsapy''' python package (see https://github.com/suncasa/eovsapy for installation instructions).

	== Calibration on the Pipeline computer at OVRO ==		== Calibration on the Pipeline computer at OVRO ==

Dgary: /* Additional Requirements */

2023-06-09T16:04:46Z

Additional Requirements

← Older revision		Revision as of 16:04, 9 June 2023
Line 32:		Line 32:
	Once you have the IDB file downloaded, you will need to add a .netrc in your home directory with the username and password to access the EOVSA cloud database. Please email someone in the NJIT radio group (http://ovsa.njit.edu/people.html) to request that information.		Once you have the IDB file downloaded, you will need to add a .netrc in your home directory with the username and password to access the EOVSA cloud database. Please email someone in the NJIT radio group (http://ovsa.njit.edu/people.html) to request that information.

	You will also need to install the suncasa python package (see the readme file at https://github.com/suncasa/suncasa-src for complete installation instructions), ~~and~~ the eovsapy python package (see https://github.com/suncasa/eovsapy for installation instructions).		You will also need to install
			#the suncasa python package (see the readme file at https://github.com/suncasa/suncasa-src for complete installation instructions),
			#the eovsapy python package (see https://github.com/suncasa/eovsapy for installation instructions).

	== Calibration on the Pipeline computer at OVRO ==		== Calibration on the Pipeline computer at OVRO ==

Dgary: /* Calibration on your own computer */

2023-06-09T16:03:43Z

Calibration on your own computer

← Older revision		Revision as of 16:03, 9 June 2023
Line 5:		Line 5:
	== Calibration on your own computer ==		== Calibration on your own computer ==
	[[File: Quick_Start.png\|thumb\|600px\|Once you have downloaded an IDB file and installed both suncasa and eovsapy on your own computer, you can create a calibrated CASA measurement set with these minimal commands at the ipython command line:		[[File: Quick_Start.png\|thumb\|600px\|Once you have downloaded an IDB file and installed both suncasa and eovsapy on your own computer, you can create a calibrated CASA measurement set with these minimal commands at the ipython command line:
	<pre> from suncasa.suncasatasks import calibeovsa
	from suncasa.suncasatasks import importeovsa		<pre>
	from casatasks import split		from suncasa.suncasatasks import calibeovsa
	idbfile = <IDB filename> # The path and filename of the IDB file		from suncasa.suncasatasks import importeovsa
	msfiles = importeovsa(idbfiles=idbfile)		from casatasks import split
	vis = calibeovsa(msfiles, caltype=['refpha','phacal'])		idbfile = <IDB filename> # The path and filename of the IDB file
	outvis = vis_str.replace('.ms','_cal.ms')		msfiles = importeovsa(idbfiles=idbfile)
	split(vis=vi, outputvis=outvis, correlation='XX')		vis = calibeovsa(msfiles, caltype=['refpha','phacal'])
	</pre>		outvis = vis_str.replace('.ms','_cal.ms')
			split(vis=vi, outputvis=outvis, correlation='XX')
			</pre>

	If all goes well, this will result in a fully-calibrated visibility dataset with the string "_cal.ms" appended to the IDB filename, located in the same place as the original IDB file. You can then start with Step 4 below, for self-calibration.		If all goes well, this will result in a fully-calibrated visibility dataset with the string "_cal.ms" appended to the IDB filename, located in the same place as the original IDB file. You can then start with Step 4 below, for self-calibration.
	]]		]]

Dgary: /* Calibration on your own computer */

2023-06-09T16:01:32Z

Calibration on your own computer

← Older revision		Revision as of 16:01, 9 June 2023
Line 10:		Line 10:
	idbfile = <IDB filename> # The path and filename of the IDB file		idbfile = <IDB filename> # The path and filename of the IDB file
	msfiles = importeovsa(idbfiles=idbfile)		msfiles = importeovsa(idbfiles=idbfile)
	vis = calibeovsa(msfiles, caltype=['refpha','phacal']~~, doimage=False~~)		vis = calibeovsa(msfiles, caltype=['refpha','phacal'])
	outvis = vis_str.replace('.ms','_cal.ms')		outvis = vis_str.replace('.ms','_cal.ms')
	split(vis=vi),outputvis=outvis~~,datacolumn='corrected',timerange=''~~,correlation='XX') </pre>		split(vis=vi, outputvis=outvis, correlation='XX')
			</pre>
	If all goes well, this will result in a fully-calibrated visibility dataset with the string "_cal.ms" appended to the IDB filename, located in the same place as the original IDB file. You can then start with Step 4 below, for self-calibration.		If all goes well, this will result in a fully-calibrated visibility dataset with the string "_cal.ms" appended to the IDB filename, located in the same place as the original IDB file. You can then start with Step 4 below, for self-calibration.
	]]		]]