Fast Inference for Machine Learning in ROOT/TMVA

¹ CERN
² Lulea University of Technology
³ Carnegie Mellon University
⁴ Karlsruhe Institute of Technology
⁵ École polytechnique fédérale de Lausanne

Published online: 16 November 2020

Abstract

ROOT provides, through TMVA, machine learning tools for data analysis at HEP experiments and beyond. However, with the rapidly evolving ecosystem for machine learning, the focus of TMVA is shifting. We present the new developments and strategy of TMVA, which will allow the analyst to integrate seamlessly, and effectively, different workflows in the diversified machine-learning landscape. Focus is put on a fast machine learning inference system, which will enable analysts to deploy their machine learning models rapidly on large scale datasets. We present the technical details of a fast inference system for decision tree algorithms, included in the next ROOT release (6.20). We further present development status and proposal for a fast inference interface and code generator for ONNX-based Deep Learning models.