Published 2019 | Version v1
Journal article

Producing Madgraph5aMC@NLO gridpacks and using TensorFlow GPU resources in the CMS HTCondor Global Pool

  • 1. University of Nebraska-Lincoln,Lincoln, NE (United States)
  • 2. University of California San Diego,La Jolla, CA (United States)
  • 3. Autonomous University of Puebla, Puebla (Mexico)
  • 4. University of Notre Dame,Notre Dame, IN (United States)
  • 5. Fermi National Accelerator Laboratory,Batavia, IL (United States)

Description

The CMS experiment has an HTCondor Global Pool, composed of more than 200K CPU cores available for Monte Carlo production and the analysis of da.The submission of user jobs to this pool is handled by either CRAB, the standard workflow management tool used by CMS users to submit analysis jobs requiring event processing of large amounts of data, or by CMS Connect, a service focused on final stage condor-like analysis jobs and applications that already have a workflow job manager in place. The latest scenario canbring cases in which workflows need further adjustments in order to efficiently work in a globally distributed pool of resources. For instance, the generation of matrix elements for high energy physics processes via Madgraph5aMC@NLO and the usage of tools not (yet) fully supported by the CMS software, such as Ten-sorFlow with GPUsupport, are tasks with particular requirements. A special adaption, either at the pool factory level (advertising GPU resources) or at the execute level (e.g: to handle special parameters that describe certain needs for the remote execute nodes during submission) is needed in order to adequately work in the CMS global pool. This contribution describes the challenges and efforts performed towards adaptingsuch workflows so they can properly profit from the Global Pool via CMS Connect.

Availability note (English)

Available from https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_03004.pdf; https://doaj.org/article/70bac3de63284d6f9a4f571398c65437

Additional details

Publishing Information

Journal Title
EPJ. Web of Conferences
Journal Volume
214
Journal Page Range
vp.
ISSN
2100-014X

Conference

Title
23. International Conference on Computing in High Energy and Nuclear Physics
Acronym
CHEP 2018
Dates
9-13 Jul 2018
Place
Sofia (Bulgaria)

INIS

Country of Publication
France
Country of Input or Organization
France
INIS RN
53095356
Subject category
S97: MATHEMATICAL METHODS AND COMPUTING; S46: INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY;
Resource subtype / Literary indicator
Conference
Descriptors DEI
CMS DETECTOR; COMPUTER CODES; DATA BASE MANAGEMENT; HIGH ENERGY PHYSICS; MATRIX ELEMENTS; MONTE CARLO METHOD
Descriptors DEC
CALCULATION METHODS; MANAGEMENT; MEASURING INSTRUMENTS; PHYSICS; RADIATION DETECTORS