Published 2017 | Version v1
Journal article

Integration of end-user Cloud storage for CMS analysis

  • 1. European Organization for Nuclear Research, Geneva (Switzerland)
  • 2. California Institute of Technology (CalTech), Pasadena, CA (United States)
  • 3. University and INFN Perugia, Perugia (Italy)

Description

End-user Cloud storage is increasing rapidly in popularity in research communities thanks to the collaboration capabilities it offers, namely synchronisation and sharing. CERN IT has implemented a model of such storage named, CERNBox, integrated with the CERN AuthN and AuthZ services. To exploit the use of the end-user Cloud storage for the distributed data analysis activity, the CMS experiment has started the integration of CERNBox as a Grid resource. This will allow CMS users to make use of their own storage in the Cloud for their analysis activities as well as to benefit from synchronisation and sharing capabilities to achieve results faster and more effectively. It will provide an integration model of Cloud storages in the Grid, which is implemented and commissioned over the world's largest computing Grid infrastructure, Worldwide LHC Computing Grid (WLCG). In this paper, we present the integration strategy and infrastructure changes needed in order to transparently integrate end-user Cloud storage with the CMS distributed computing model. We describe the new challenges faced in data management between Grid and Cloud and how they were addressed, along with details of the support for Cloud storage recently introduced into the WLCG data movement middleware, FTS3. Finally, the commissioning experience of CERNBox for the distributed data analysis activity is also presented.

Availability note (English)

Available from https://www.osti.gov/pages/servlets/purl/1420408; https://www.osti.gov/pages/biblio/1420408; DOE Accepted Manuscript full text, or the publishers Best Available Version will be available free of charge after the embargo period

Additional details

Identifiers

Publishing Information

Journal Title
Future Generations Computer Systems
Journal Volume
78
Journal Issue
P3
Journal Page Range
p. 1079-1082
ISSN
0167-739X

INIS

Country of Publication
Netherlands
Country of Input or Organization
United States
INIS RN
49067872
Subject category
S97: MATHEMATICAL METHODS AND COMPUTING;
Descriptors DEI
CERN LHC; CMS DETECTOR; COMPUTER NETWORKS; DATA ACQUISITION; DATA ANALYSIS
Descriptors DEC
ACCELERATORS; CYCLIC ACCELERATORS; DATA PROCESSING; MEASURING INSTRUMENTS; PROCESSING; RADIATION DETECTORS; STORAGE RINGS; SYNCHROTRONS

Optional Information