Performance studies and improvements of CMS distributed data transfers
- 1. University of Bologna, INFN (Italy)
- 2. Port d'Informació Científica (PIC) (Spain)
- 3. CERN (Switzerland)
- 4. University of California San Diego, La Jolla, CA (United States)
- 5. LLR/E. Polytechnique, Paris (France)
Description
CMS computing needs reliable, stable and fast connections among multi-tiered distributed infrastructures. CMS experiment relies on File Transfer Services (FTS) for data distribution, a low level data movement service responsible for moving sets of files from one site to another, while allowing participating sites to control the network resource usage. FTS servers are provided by Tier-0 and Tier-1 centers and used by all the computing sites in CMS, subject to established CMS and sites setup policies, including all the virtual organizations making use of the Grid resources at the site, and properly dimensioned to satisfy all the requirements for them. Managing the service efficiently needs good knowledge of the CMS needs for all kind of transfer routes, and the sharing and interference with other VOs using the same FTS transfer managers. This contribution deals with a complete revision of all FTS servers used by CMS, customizing the topologies and improving their setup in order to keep CMS transferring data to the desired levels, as well as performance studies for all kind of transfer routes, including overheads measurements introduced by SRM servers and storage systems, FTS server misconfigurations and identification of congested channels, historical transfer throughputs per stream, file-latency studies,… This information is retrieved directly from the FTS servers through the FTS Monitor webpages and conveniently archived for further analysis. The project provides an interface for all these values, to ease the analysis of the data.
Availability note (English)
Available from http://dx.doi.org/10.1088/1742-6596/396/3/032040Additional details
Identifiers
Publishing Information
- Journal Title
- Journal of Physics. Conference Series (Online)
- Journal Volume
- 396
- Journal Issue
- 3
- Journal Page Range
- [12 p.]
- ISSN
- 1742-6596
Conference
- Title
- International conference on computing in high energy and nuclear physics 2012
- Acronym
- CHEP2012
- Dates
- 21-25 May 2012
- Place
- New York, NY (United States)
INIS
- Country of Publication
- United Kingdom
- Country of Input or Organization
- International Atomic Energy Agency (IAEA)
- INIS RN
- 44038046
- Subject category
- S46: INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY; S97: MATHEMATICAL METHODS AND COMPUTING;
- Resource subtype / Literary indicator
- Conference
- Descriptors DEI
- CERN LHC; COLLIDING BEAMS; COMPUTER CALCULATIONS; COMPUTER CODES; COMPUTER NETWORKS; DATA ANALYSIS; DATA TRANSMISSION; DATA TRANSMISSION SYSTEMS; DISTRIBUTED DATA PROCESSING; MEMORY DEVICES; MULTIPARTICLE SPECTROMETERS; MULTIPLE PRODUCTION; PARTICLE IDENTIFICATION; PERFORMANCE
- Descriptors DEC
- ACCELERATORS; BEAMS; COMMUNICATIONS; CYCLIC ACCELERATORS; DATA PROCESSING; MEASURING INSTRUMENTS; PARTICLE PRODUCTION; PROCESSING; SPECTROMETERS; STORAGE RINGS; SYNCHROTRONS