Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support

¹ University of California San Diego, La Jolla, CA, USA
² European Organization for Nuclear Research, Meyrin, Switzerland
³ Novosibirsk State University, Novosibirsk, Russia
⁴ Budker Institute of Nuclear Physics, Novosibirsk, Russia
⁵ Fermi National Accelerator Laboratory, Batavia, IL, USA
⁶ National Centre for Physics Rd, Islamabad, Pakistan
⁷ Vilnius University, Vilnius, Lithuania
⁸ Centro de Investigaciones Energéticas Medioambientales y Tecnológicas, Madrid, Spain
⁹ Port d’Informació Científica, Barcelona, Spain
¹⁰ University of Nebraska-Lincoln, Lincoln, NE, USA

^* e-mail: jdost@ucsd.edu
^** e-mail: marco.mascheroni@cern.ch

Published online: 16 November 2020

Abstract

GlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resource sites’ CEs. More than 400 CEs are currently serving more than ten virtual organizations through GlideinWMS, with CMS being the biggest user with 230 CEs. The complex configurations of the parameters defining resource requests, as submitted to those CEs, have been historically managed by manually editing a set of different XML files. New possibilities arise with CMS adopting the CRIC, an information system that collects, aggregates, stores, and exposes, among other things, computing resource data coming from various data providers. The paper will describe the challenges faced when CMS started to use CRIC to automatically generate the GlideinWMS factory configurations. The architecture of the prototype, and the ancillary tools developed to ease this transition, will be discussed. Finally, future plans and milestones will be outlined.