Published 2020 | Version v1
Journal article

Provision and use of GPU resources for distributed workloads via the Grid

  • 1. Queen Mary University of London, Mile End Road, E1 4NS (United Kingdom)

Description

The Queen Mary University of London WLCG Tier-2 Grid site has been providing GPU resources on the Grid since 2016. GPUs are an important modern tool to assist in data analysis. They have historically been used to accelerate computationally expensive but parallelisable workloads using frameworks such as OpenCL and CUDA. However, more recently their power in accelerating machine learning, using libraries such as TensorFlow and Coffee, has come to the fore and the demand for GPU resources has increased. Significant effort is being spent in high energy physics to investigate and use machine learning to enhance the analysis of data. GPUs may also provide part of the solution to the compute challenge of the High Luminosity LHC. The motivation for providing GPU resources via the Grid is presented. The installation and configuration of the SLURM batch system together with Compute Elements (CREAM and ARC) for use with GPUs is shown. Real world use cases are presented and the success and issues discovered are discussed.

Availability note (English)

Available from https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_03002.pdf; https://doaj.org/article/b104a6dc9a93473992ce52c7052c4064

Additional details

Publishing Information

Journal Title
EPJ. Web of Conferences
Journal Volume
245
Journal Page Range
vp.
ISSN
2100-014X

Conference

Title
24. International Conference on Computing in High Energy and Nuclear Physics
Acronym
CHEP 2019
Dates
4-8 Nov 2019
Place
Adelaide (Australia)