Evaluation of Portable Acceleration Solutions for LArTPC Simulation Using Wire-Cell Toolkit

¹ Department of Physics, Brookhaven National Laboratory, Upton, NY 11973, USA
² Computational Science Initiative, Brookhaven National Laboratory, Upton, NY 11973, USA
³ Scientific Computing Division, Fermi National Accelerator Laboratory, Batavia, IL 60510, USA

^* Corresponding Author. e-mail: hyu@bnl.gov

Published online: 23 August 2021

Abstract

The Liquid Argon Time Projection Chamber (LArTPC) technology plays an essential role in many current and future neutrino experiments. Accurate and fast simulation is critical to developing efficient analysis algorithms and precise physics model projections. The speed of simulation becomes more important as Deep Learning algorithms are getting more widely used in LArTPC analysis and their training requires a large simulated dataset. Heterogeneous computing is an efficient way to delegate computationally intensive tasks to specialized hardware. However, as the landscape of compute accelerators quickly evolves, it becomes increasingly difficult to manually adapt the code to the latest hardware or software environments. A solution which is portable to multiple hardware architectures without substantially compromising performance would thus be very beneficial, especially for long-term projects such as the LArTPC simulations. In search of a portable, scalable and maintainable software solution for LArTPC simulations, we have started to explore high-level portable programming frameworks that support several hardware backends. In this paper, we present our experience porting the LArTPC simulation code in the Wire-Cell Toolkit to NVIDIA GPUs, first with the CUDA programming model and then with a portable library called Kokkos. Preliminary performance results on NVIDIA V100 GPUs and multi-core CPUs are presented, followed by a discussion of the factors affiecting the performance and plans for future improvements.