Data Access Performance Through Parallelization and Vectored Access: Some Results
Creators
- 1. INFN, Padua (Italy)
- 2. Stanford Linear Accelerator Center, Menlo Park, CA (United States)
Description
High Energy Physics data processing and analysis applications typically deal with the problem of accessing and processing data at high speed. Recent studies, development and test work have shown that the latencies due to data access can often be hidden by parallelizing them with the data processing, thus giving the ability to have applications which process remote data with a high level of efficiency. Techniques and algorithms able to reach this result have been implemented in the client side of the Scalla/xrootd system, and in this contribution we describe the results of some tests done in order to compare their performance and characteristics. These techniques, if used together with multiple streams data access, can also be effective in allowing to efficiently and transparently deal with data repositories accessible via a Wide Area Network.
Availability note (English)
Available from http://www.slac.stanford.edu/cgi-wrap/getdoc/slac-pub-14708.pdf; http://www.slac.stanford.edu/cgi-wrap/pubpage?slac-pub-14708.html; PURL: https://www.osti.gov/servlets/purl/1029160/Additional details
Identifiers
Publishing Information
- Imprint Pagination
- 9 p.
- Report number
- SLAC-PUB--14708
Conference
- Title
- International Conference on Computing in High Energy and Nuclear Physics
- Acronym
- CHEP 07
- Dates
- 2-7 Sep 2007
- Place
- Victoria, BC (Canada)
INIS
- Country of Publication
- United States
- Country of Input or Organization
- United States
- INIS RN
- 43003041
- Subject category
- S71: CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; S73: NUCLEAR PHYSICS AND RADIATION PHYSICS;
- Resource subtype / Literary indicator
- Conference, Non-conventional Literature
- Descriptors DEI
- ALGORITHMS; DATA PROCESSING; EFFICIENCY; HIGH ENERGY PHYSICS; NUCLEAR PHYSICS; PERFORMANCE; PROCESSING; VELOCITY
- Descriptors DEC
- MATHEMATICAL LOGIC; PHYSICS; PROCESSING
Optional Information
- Contract/Grant/Project number
- AC02-76SF00515
- Notes
- J.Phys.Conf.Ser.119:072016,2008
- Funding organization
- US Department of Energy (United States)