Integration of end-user Cloud storage for CMS analysis
Creators
- 1. European Organization for Nuclear Research, Geneva (Switzerland)
- 2. California Institute of Technology (CalTech), Pasadena, CA (United States)
- 3. University and INFN Perugia, Perugia (Italy)
Description
End-user Cloud storage is increasing rapidly in popularity in research communities thanks to the collaboration capabilities it offers, namely synchronisation and sharing. CERN IT has implemented a model of such storage named, CERNBox, integrated with the CERN AuthN and AuthZ services. To exploit the use of the end-user Cloud storage for the distributed data analysis activity, the CMS experiment has started the integration of CERNBox as a Grid resource. This will allow CMS users to make use of their own storage in the Cloud for their analysis activities as well as to benefit from synchronisation and sharing capabilities to achieve results faster and more effectively. It will provide an integration model of Cloud storages in the Grid, which is implemented and commissioned over the world's largest computing Grid infrastructure, Worldwide LHC Computing Grid (WLCG). In this paper, we present the integration strategy and infrastructure changes needed in order to transparently integrate end-user Cloud storage with the CMS distributed computing model. We describe the new challenges faced in data management between Grid and Cloud and how they were addressed, along with details of the support for Cloud storage recently introduced into the WLCG data movement middleware, FTS3. Finally, the commissioning experience of CERNBox for the distributed data analysis activity is also presented.
Availability note (English)
Available from https://www.osti.gov/pages/servlets/purl/1420408; https://www.osti.gov/pages/biblio/1420408; DOE Accepted Manuscript full text, or the publishers Best Available Version will be available free of charge after the embargo periodAdditional details
Identifiers
Publishing Information
- Journal Title
- Future Generations Computer Systems
- Journal Volume
- 78
- Journal Issue
- P3
- Journal Page Range
- p. 1079-1082
- ISSN
- 0167-739X
INIS
- Country of Publication
- Netherlands
- Country of Input or Organization
- United States
- INIS RN
- 49067872
- Subject category
- S97: MATHEMATICAL METHODS AND COMPUTING;
- Descriptors DEI
- CERN LHC; CMS DETECTOR; COMPUTER NETWORKS; DATA ACQUISITION; DATA ANALYSIS
- Descriptors DEC
- ACCELERATORS; CYCLIC ACCELERATORS; DATA PROCESSING; MEASURING INSTRUMENTS; PROCESSING; RADIATION DETECTORS; STORAGE RINGS; SYNCHROTRONS
Optional Information
- Contract/Grant/Project number
- AC02-07CH11359
- Funding organization
- USDOE Office of Science - SC, High Energy Physics (HEP) (SC-25) (United States)
- Secondary number(s)
- FERMILAB-PUB--17-650; OSTIID--1420408