Published November 10, 2011 | Version v1
Report

Data Access Performance Through Parallelization and Vectored Access: Some Results

  • 1. INFN, Padua (Italy)
  • 2. Stanford Linear Accelerator Center, Menlo Park, CA (United States)

Description

High Energy Physics data processing and analysis applications typically deal with the problem of accessing and processing data at high speed. Recent studies, development and test work have shown that the latencies due to data access can often be hidden by parallelizing them with the data processing, thus giving the ability to have applications which process remote data with a high level of efficiency. Techniques and algorithms able to reach this result have been implemented in the client side of the Scalla/xrootd system, and in this contribution we describe the results of some tests done in order to compare their performance and characteristics. These techniques, if used together with multiple streams data access, can also be effective in allowing to efficiently and transparently deal with data repositories accessible via a Wide Area Network.

Availability note (English)

Available from http://www.slac.stanford.edu/cgi-wrap/getdoc/slac-pub-14708.pdf; http://www.slac.stanford.edu/cgi-wrap/pubpage?slac-pub-14708.html; PURL: https://www.osti.gov/servlets/purl/1029160/

Additional details

Publishing Information

Imprint Pagination
9 p.
Report number
SLAC-PUB--14708

Conference

Title
International Conference on Computing in High Energy and Nuclear Physics
Acronym
CHEP 07
Dates
2-7 Sep 2007
Place
Victoria, BC (Canada)

INIS

Country of Publication
United States
Country of Input or Organization
United States
INIS RN
43003041
Subject category
S71: CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; S73: NUCLEAR PHYSICS AND RADIATION PHYSICS;
Resource subtype / Literary indicator
Conference, Non-conventional Literature
Descriptors DEI
ALGORITHMS; DATA PROCESSING; EFFICIENCY; HIGH ENERGY PHYSICS; NUCLEAR PHYSICS; PERFORMANCE; PROCESSING; VELOCITY
Descriptors DEC
MATHEMATICAL LOGIC; PHYSICS; PROCESSING

Optional Information

Contract/Grant/Project number
AC02-76SF00515
Notes
J.Phys.Conf.Ser.119:072016,2008
Funding organization
US Department of Energy (United States)