Evolution of the CMS Global Submission Infrastructure for the HL-LHC Era

¹ Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas (CIEMAT), Madrid, Spain
² Port d’Informació Cientifica (PIC), Barcelona, Spain
³ Fermi National Accelerator Laboratory, Batavia, IL, USA
⁴ University of California San Diego, La Jolla, CA, USA
⁵ National Centre for Physics, Islamabad, Pakistan
⁶ University of Notre Dame, Notre Dame, IN, USA
⁷ Vilnius University, Vilnius, Lithuania

^* e-mail: aperez@pic.es

Published online: 16 November 2020

Abstract

Efforts in distributed computing of the CMS experiment at the LHC at CERN are now focusing on the functionality required to fulfill the projected needs for the HL-LHC era. Cloud and HPC resources are expected to be dominant relative to resources provided by traditional Grid sites, being also much more diverse and heterogeneous. Handling their special capabilities or limitations and maintaining global flexibility and efficiency, while also operating at scales much higher than the current capacity, are the major challenges being addressed by the CMS Submission Infrastructure team. These proceedings discuss the risks to the stability and scalability of the CMS HTCondor infrastructure extrapolated to such a scenario, thought to be derived mostly from its growing complexity, with multiple Negotiators and schedulers flocking work to multiple federated pools. New mechanisms for enhanced customization and control over resource allocation and usage, mandatory in this future scenario, are also described.