Anomaly detection using Deep Autoencoders for the assessment of the quality of the data acquired by the CMS experiment

¹ CERN, Meyrin, Switzerland
² California Institute of Technology, Pasadena, California, U.S.
³ Masaryk University, Brno, Czech Republic
⁴ Massachusetts Inst. of Technology, Cambridge, Massachusetts, U.S.
⁵ Université Paris-Saclay, Orsay, France
⁶ Texas Tech University, Lubbock, Texas, U.S.

Published online: 17 September 2019

Abstract

The certification of the CMS experiment data as usable for physics analysis is a crucial task to ensure the quality of all physics results published by the collaboration. Currently, the certification conducted by human experts is labor intensive and based on the scrutiny of distributions integrated on several hours of data taking. This contribution focuses on the design and prototype of an automated certification system assessing data quality on a per-luminosity section (i.e. 23 seconds of data taking) basis. Anomalies caused by detector malfunctioning or sub-optimal reconstruction are difficult to enumerate a priori and occur rarely, making it difficult to use classical supervised classification methods such as feedforward neural networks. We base our prototype on a semi-supervised approach which employs deep autoencoders. This approach has been qualified successfully on CMS data collected during the 2016 LHC run: we demonstrate its ability to detect anomalies with high accuracy and low false positive rate, when compared against the outcome of the manual certification by experts. A key advantage of this approach over other machine learning technologies is the great interpretability of the results, which can be further used to ascribe the origin of the problems in the data to a specific sub-detector or physics objects.