Published December 23, 2011 | Version v1
Journal article

Scaling up ATLAS Database Release Technology for the LHC Long Run

  • 1. Moscow Engineering Physics Institute, Kashirskoe sh. 31, Moscow 115409 (Russian Federation)
  • 2. Brookhaven National Laboratory, Upton, NY 11973 (United States)
  • 3. Argonne National Laboratory, 9700 S Cass Ave, Argonne, IL 60439 (United States)

Description

To overcome scalability limitations in database access on the Grid, ATLAS introduced the Database Release technology replicating databases in files. For years Database Release technology assured scalable database access for Monte Carlo production on the Grid. Since previous CHEP, Database Release technology was used successfully in ATLAS data reprocessing on the Grid. Frozen Conditions DB snapshot guarantees reproducibility and transactional consistency isolating Grid data processing tasks from continuous conditions updates at the 'live' Oracle server. Database Release technology fully satisfies the requirements of ATLAS data reprocessing and Monte Carlo production. We parallelized the Database Release build workflow to avoid linear dependency of the build time on the length of LHC data-taking period. In recent data reprocessing campaigns the build time was reduced by an order of magnitude thanks to a proven master-worker architecture used in the Google MapReduce. We describe further Database Release optimizations scaling up the technology for the LHC long run.

Availability note (English)

Available from http://dx.doi.org/10.1088/1742-6596/331/4/042004

Additional details

Publishing Information

Journal Title
Journal of Physics. Conference Series (Online)
Journal Volume
331
Journal Issue
4
Journal Page Range
[6 p.]
ISSN
1742-6596

Conference

Title
International conference on computing in high energy and nuclear physics
Acronym
CHEP 2010
Dates
18-22 Oct 2010
Place
Taipei, Taiwan (China)

Optional Information

Collaborations
ATLAS Collaboration