| Issue |
EPJ Web Conf.
Volume 245, 2020
24th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2019)
|
|
|---|---|---|
| Article Number | 01038 | |
| Number of page(s) | 6 | |
| Section | 1 - Online and Real-time Computing | |
| DOI | https://doi.org/10.1051/epjconf/202024501038 | |
| Published online | 16 November 2020 | |
https://doi.org/10.1051/epjconf/202024501038
Ingest pipeline for ASKAP
CSIRO Astronomy & Space Science, PO Box 76, Epping NSW 1710, Australia
* e-mail: Maxim.Voronkov@csiro.au
Published online: 16 November 2020
The Australian Square Kilometre Array Pathfinder (ASKAP) is a new generation 36-antenna 36-beam interferometer capable of producing about 2.2 Gb/s of raw data. The data are streamed from the observatory directly to the dedicated small cluster at the Pawsey Supercomputing centre. The ingest pipeline is a distributed real time software which runs on this cluster and prepares the data for further (offline) processing by imaging and calibration pipelines. In addition to its main functionality, it turned out to be a valuable tool for various commissioning experiments and allowed us to run an interim system to achieve the first scientific results much earlier than otherwise possible. I will review the architecture of the ingest pipeline, its role in the overall ASKAP design as well as the lessons learned by developing a real-time application in the HPC environment.
© The Authors, published by EDP Sciences, 2020
This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.