Both sides previous revisionPrevious revisionNext revision | Previous revision |
huibintemaspam [2017/06/09 22:34] – [Download and install] huibintema | huibintemaspam [2021/02/03 14:25] (current) – [Older materials] huibintema |
---|
~~NOTOC~~ | ~~NOTOC~~ |
| |
===== SPAM: Source Peeling and Atmospheric Modeling ===== | {{ :spam.jpg?nolink&150|}} |
| ===== Source Peeling and Atmospheric Modeling ===== |
| |
SPAM is a Python-based extension to [[http://www.aips.nrao.edu/|AIPS]] ([[http://adsabs.harvard.edu/abs/2003ASSL..285..109G|Greisen 2003]]), aimed at reducing high-resolution, low-frequency radio interferometric observations in a very efficient, systematic and reproducible way. Special features in SPAM, like direction-dependent ionospheric calibration and image-plane ripple suppression, will help to make high-quality sub-GHz images. SPAM is a Python module, including some C-code optimalizations, that uses the Python-to-AIPS interface [[http://www.jive.nl/jivewiki/doku.php?id=parseltongue:parseltongue|ParselTongue]] ([[http://adsabs.harvard.edu/abs/2006ASPC..351..497K|Kettenis et al. 2006]]), which itself is based on [[http://www.cv.nrao.edu/~bcotton/Obit.html|ObitTalk]] ([[http://adsabs.harvard.edu/abs/2008PASP..120..439C|Cotton 2008]]). ParselTongue provides access to AIPS tasks, data files (images & visibilities) and tables. SPAM also uses several standard Python libraries like scipy, pylab, matplotlib, and numpy. Data reductions are captured in well-tested Python scripts that executes AIPS tasks directly (mostly during initial data reduction steps), calls high-level functions that make multiple AIPS or ParselTongue calls, and require few manual operations. SPAM now also includes a fully automated pipeline for reducing legacy GMRT observations at 150, 235, 325 and 610 MHz. Some users have also successfully applied it to legacy GMRT 1.4 GHz observations. | SPAM is a Python-based extension to [[http://www.aips.nrao.edu/|AIPS]] ([[http://adsabs.harvard.edu/abs/2003ASSL..285..109G|Greisen 2003]]), aimed at reducing high-resolution, low-frequency radio interferometric observations in a very efficient, systematic and reproducible way. Special features in SPAM, like direction-dependent ionospheric calibration and image-plane ripple suppression, will help to make high-quality sub-GHz images. SPAM is a Python module, including some C-code optimalizations, that uses the Python-to-AIPS interface [[http://www.jive.nl/jivewiki/doku.php?id=parseltongue:parseltongue|ParselTongue]] ([[http://adsabs.harvard.edu/abs/2006ASPC..351..497K|Kettenis et al. 2006]]), which itself is based on [[http://www.cv.nrao.edu/~bcotton/Obit.html|ObitTalk]] ([[http://adsabs.harvard.edu/abs/2008PASP..120..439C|Cotton 2008]]). ParselTongue provides access to AIPS tasks, data files (images & visibilities) and tables. SPAM also uses several standard Python libraries like scipy, pylab, matplotlib, and numpy. Data reductions are captured in well-tested Python scripts that executes AIPS tasks directly (mostly during initial data reduction steps), calls high-level functions that make multiple AIPS or ParselTongue calls, and require few manual operations. SPAM now also includes a fully automated pipeline for reducing legacy GMRT observations at 150, 235, 325 and 610 MHz. Some users have also successfully applied it to legacy GMRT 1.4 GHz observations. |
[[huibintemaspaminstall|Download and install SPAM on your Linux 64-bit system]] | [[huibintemaspaminstall|Download and install SPAM on your Linux 64-bit system]] |
| |
[[huibintemaspampipeline|How to run the SPAM pipeline (UNDER CONSTRUCTION)]] | [[huibintemaspamstartup|Starting up SPAM]] |
| |
| [[huibintemaspampipeline|Running the SPAM pipeline]] |
| |
| [[huibintemaspamfaq|Frequently asked questions on SPAM]] |
| |
----- | ----- |
==== News ==== | ==== News ==== |
| |
| * 13-Mar-2019: Check the [[https://ftp.strw.leidenuniv.nl/intema/spam/|spam ftp area]] for regular updates. |
| * 16-Jan-2018: Updated version of SPAM available [[https://ftp.strw.leidenuniv.nl/intema/spam/spam_20180116.tgz|here]]. |
| * 22-Sep-2017: Made some small modifications to the install procedure. |
| * 13-Sep-2017: Updates for almost all components of the SPAM installation, with several fixes and new functionality. |
* 21-May-2017: Moved homepage including SPAM webpage to new domain. | * 21-May-2017: Moved homepage including SPAM webpage to new domain. |
* 06-Jan-2016: Update of webpage. Release of SPAM pipeline for GMRT. Full AIPS 31DEC13 binary install (LNX64 only), additional catalogs and more now available as single tarball. | * 06-Jan-2016: Update of webpage. Release of SPAM pipeline for GMRT. Full AIPS 31DEC13 binary install (LNX64 only), additional catalogs and more now available as single tarball. |
----- | ----- |
| |
| |
==== Starting up SPAM ==== | |
| |
Setting up SPAM in Linux bash is done through: | |
<code bash> | |
. <spam installation path>/setup.sh | |
</code> | |
| |
Setting up SPAM in Linux (t)csh is done through: | |
<code bash> | |
source <spam installation path>/setup.csh | |
</code> | |
| |
SPAM uses AIPS in such a way that it allows creation of an isolated, self-consistent work environment per project. To run SPAM, first create a project directory: | |
<code bash> | |
mkdir -p <new project directory> | |
cd <new project directory> | |
</code> | |
| |
Then start ParselTongue: | |
<code bash> | |
start_parseltongue.sh . <AIPS userid> | |
</code> | |
The AIPS userid can be any number from 11 to 9999. I usually stick with 11 | |
| |
In the project directory, the start_parseltongue.sh script has set up a local AIPS work environment with 35 AIPS disks (work01-35) and a few other directories (fits, datfil, prtfil, runfil, da00, etc.). Most of this is quite specific to AIPS. | |
| |
If all went well, the final output will have been | |
<code python> | |
Welcome to ParselTongue 2.3 | |
>>> | |
</code> | |
| |
Next, we import SPAM as a python module | |
<code python> | |
from spam import * | |
</code> | |
| |
If this returns without errors it is likely that the installation has gone well. | |
| |
----- | |
| |
==== Running the SPAM pipeline ==== | |
| |
| |
----- | |
| |
==== Older materials ==== | ==== Older materials ==== |
| |
[[https://safe.nrao.edu/wiki/bin/view/Main/HuibIntemaSpamTutorial|SPAM tutorial]] for the 3gc3 workshop "The Elephants In The Room", Port Alfred, South Africa, on Feb. 19, 2013. \\ | [[https://safe.nrao.edu/wiki/bin/view/Main/HuibIntemaSpamTutorial|SPAM tutorial]] for the 3gc3 workshop "The Elephants In The Room", Port Alfred, South Africa, on Feb. 19, 2013. \\ |
[[ftp://ftp.strw.leidenuniv.nl/pub/intema/spam/examples/spam_gmrt330_v01.py|SPAM example script]] for reducing GMRT 330 MHz data. | [[https://ftp.strw.leidenuniv.nl/intema/spam/examples/spam_gmrt330_v01.py|SPAM example script]] for reducing GMRT 330 MHz data. |
| |
<html> | <html> |
<!-- End of StatCounter Code for Default Guide --> | <!-- End of StatCounter Code for Default Guide --> |
</html> | </html> |
| |
| ----- |
| |
| Feedback: [[intema@strw.leidenuniv.nl|Click here]] |
| |