Scaling up ATLAS Database Release Technology for the LHC Long Run
- 1. Moscow Engineering Physics Institute, Kashirskoe sh. 31, Moscow 115409 (Russian Federation)
- 2. Brookhaven National Laboratory, Upton, NY 11973 (United States)
- 3. Argonne National Laboratory, 9700 S Cass Ave, Argonne, IL 60439 (United States)
Description
To overcome scalability limitations in database access on the Grid, ATLAS introduced the Database Release technology replicating databases in files. For years Database Release technology assured scalable database access for Monte Carlo production on the Grid. Since previous CHEP, Database Release technology was used successfully in ATLAS data reprocessing on the Grid. Frozen Conditions DB snapshot guarantees reproducibility and transactional consistency isolating Grid data processing tasks from continuous conditions updates at the 'live' Oracle server. Database Release technology fully satisfies the requirements of ATLAS data reprocessing and Monte Carlo production. We parallelized the Database Release build workflow to avoid linear dependency of the build time on the length of LHC data-taking period. In recent data reprocessing campaigns the build time was reduced by an order of magnitude thanks to a proven master-worker architecture used in the Google MapReduce. We describe further Database Release optimizations scaling up the technology for the LHC long run.
Availability note (English)
Available from http://dx.doi.org/10.1088/1742-6596/331/4/042004Additional details
Identifiers
Publishing Information
- Journal Title
- Journal of Physics. Conference Series (Online)
- Journal Volume
- 331
- Journal Issue
- 4
- Journal Page Range
- [6 p.]
- ISSN
- 1742-6596
Conference
- Title
- International conference on computing in high energy and nuclear physics
- Acronym
- CHEP 2010
- Dates
- 18-22 Oct 2010
- Place
- Taipei, Taiwan (China)
INIS
- Country of Publication
- United Kingdom
- Country of Input or Organization
- International Atomic Energy Agency (IAEA)
- INIS RN
- 43101684
- Subject category
- S46: INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY; S97: MATHEMATICAL METHODS AND COMPUTING;
- Resource subtype / Literary indicator
- Conference
- Descriptors DEI
- CERN LHC; COLLIDING BEAMS; COMPUTER ARCHITECTURE; COMPUTER CALCULATIONS; COMPUTER CODES; COMPUTER NETWORKS; DATA ANALYSIS; DATA TRANSMISSION; DISTRIBUTED DATA PROCESSING; MONTE CARLO METHOD; MULTIPARTICLE SPECTROMETERS; MULTIPLE PRODUCTION; OPTIMIZATION; PARTICLE IDENTIFICATION
- Descriptors DEC
- ACCELERATORS; BEAMS; CALCULATION METHODS; COMMUNICATIONS; CYCLIC ACCELERATORS; DATA PROCESSING; MEASURING INSTRUMENTS; PARTICLE PRODUCTION; PROCESSING; SPECTROMETERS; STORAGE RINGS; SYNCHROTRONS
Optional Information
- Collaborations
- ATLAS Collaboration