Published December 13, 2012 | Version v1
Journal article

Performance studies and improvements of CMS distributed data transfers

  • 1. University of Bologna, INFN (Italy)
  • 2. Port d'Informació Científica (PIC) (Spain)
  • 3. CERN (Switzerland)
  • 4. University of California San Diego, La Jolla, CA (United States)
  • 5. LLR/E. Polytechnique, Paris (France)

Description

CMS computing needs reliable, stable and fast connections among multi-tiered distributed infrastructures. CMS experiment relies on File Transfer Services (FTS) for data distribution, a low level data movement service responsible for moving sets of files from one site to another, while allowing participating sites to control the network resource usage. FTS servers are provided by Tier-0 and Tier-1 centers and used by all the computing sites in CMS, subject to established CMS and sites setup policies, including all the virtual organizations making use of the Grid resources at the site, and properly dimensioned to satisfy all the requirements for them. Managing the service efficiently needs good knowledge of the CMS needs for all kind of transfer routes, and the sharing and interference with other VOs using the same FTS transfer managers. This contribution deals with a complete revision of all FTS servers used by CMS, customizing the topologies and improving their setup in order to keep CMS transferring data to the desired levels, as well as performance studies for all kind of transfer routes, including overheads measurements introduced by SRM servers and storage systems, FTS server misconfigurations and identification of congested channels, historical transfer throughputs per stream, file-latency studies,… This information is retrieved directly from the FTS servers through the FTS Monitor webpages and conveniently archived for further analysis. The project provides an interface for all these values, to ease the analysis of the data.

Availability note (English)

Available from http://dx.doi.org/10.1088/1742-6596/396/3/032040

Additional details

Publishing Information

Journal Title
Journal of Physics. Conference Series (Online)
Journal Volume
396
Journal Issue
3
Journal Page Range
[12 p.]
ISSN
1742-6596

Conference

Title
International conference on computing in high energy and nuclear physics 2012
Acronym
CHEP2012
Dates
21-25 May 2012
Place
New York, NY (United States)