Provision and use of GPU resources for distributed workloads via the Grid
Creators
- 1. Queen Mary University of London, Mile End Road, E1 4NS (United Kingdom)
Description
The Queen Mary University of London WLCG Tier-2 Grid site has been providing GPU resources on the Grid since 2016. GPUs are an important modern tool to assist in data analysis. They have historically been used to accelerate computationally expensive but parallelisable workloads using frameworks such as OpenCL and CUDA. However, more recently their power in accelerating machine learning, using libraries such as TensorFlow and Coffee, has come to the fore and the demand for GPU resources has increased. Significant effort is being spent in high energy physics to investigate and use machine learning to enhance the analysis of data. GPUs may also provide part of the solution to the compute challenge of the High Luminosity LHC. The motivation for providing GPU resources via the Grid is presented. The installation and configuration of the SLURM batch system together with Compute Elements (CREAM and ARC) for use with GPUs is shown. Real world use cases are presented and the success and issues discovered are discussed.
Availability note (English)
Available from https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_03002.pdf; https://doaj.org/article/b104a6dc9a93473992ce52c7052c4064Additional details
Identifiers
Publishing Information
- Journal Title
- EPJ. Web of Conferences
- Journal Volume
- 245
- Journal Page Range
- vp.
- ISSN
- 2100-014X
Conference
- Title
- 24. International Conference on Computing in High Energy and Nuclear Physics
- Acronym
- CHEP 2019
- Dates
- 4-8 Nov 2019
- Place
- Adelaide (Australia)
INIS
- Country of Publication
- France
- Country of Input or Organization
- France
- INIS RN
- 53090363
- Subject category
- S97: MATHEMATICAL METHODS AND COMPUTING;
- Resource subtype / Literary indicator
- Conference
- Descriptors DEI
- CERN LHC; COMPUTERIZED SIMULATION; CONFIGURATION; DATA ANALYSIS; HIGH ENERGY PHYSICS; LUMINOSITY; MACHINE LEARNING
- Descriptors DEC
- ACCELERATORS; ALGORITHMS; ARTIFICIAL INTELLIGENCE; CYCLIC ACCELERATORS; DATA PROCESSING; LEARNING; MATHEMATICAL LOGIC; OPTICAL PROPERTIES; PHYSICAL PROPERTIES; PHYSICS; PROCESSING; SIMULATION; STORAGE RINGS; SYNCHROTRONS