Reinforcing user data analysis with Ganga in the LHC era: scalability, monitoring and user-support
Creators
- 1. Ludwig-Maximilians-Universität München (Germany)
- 2. University of Cambridge (United Kingdom)
- 3. CERN (Switzerland)
- 4. Imperial College London (United Kingdom)
- 5. INFN Bologna (Italy)
- 6. NIKHEF (Netherlands)
- 7. University of Wuppertal (Germany)
- 8. University of Oslo (Norway)
- 9. University of Birmingham (United Kingdom)
Description
Ganga is a grid job submission and management system widely used in the ATLAS and LHCb experiments and several other communities in the context of the EGEE project. The particle physics communities have entered the LHC operation era which brings new challenges for user data analysis: a strong growth in the number of users and jobs is already noticeable. Current work in the Ganga project is focusing on dealing with these challenges. In recent Ganga releases the support for the pilot job based grid systems Panda and Dirac of the ATLAS and LHCb experiment respectively have been strengthened. A more scalable job repository architecture, which allows efficient storage of many thousands of jobs in XML or several database formats, was recently introduced. A better integration with monitoring systems, including the Dashboard and job execution monitor systems is underway. These will provide comprehensive and easy job monitoring. A simple to use error reporting tool integrated at the Ganga command-line will help to improve user support and debugging user problems. Ganga is a mature, stable and widely-used tool with long-term support from the HEP community. We report on how it is being constantly improved following the user needs for faster and easier distributed data analysis on the grid.
Availability note (English)
Available from http://dx.doi.org/10.1088/1742-6596/331/7/072011Additional details
Identifiers
Publishing Information
- Journal Title
- Journal of Physics. Conference Series (Online)
- Journal Volume
- 331
- Journal Issue
- 7
- Journal Page Range
- [6 p.]
- ISSN
- 1742-6596
Conference
- Title
- International conference on computing in high energy and nuclear physics
- Acronym
- CHEP 2010
- Dates
- 18-22 Oct 2010
- Place
- Taipei, Taiwan (China)
INIS
- Country of Publication
- United Kingdom
- Country of Input or Organization
- International Atomic Energy Agency (IAEA)
- INIS RN
- 43101819
- Subject category
- S97: MATHEMATICAL METHODS AND COMPUTING;
- Resource subtype / Literary indicator
- Conference
- Descriptors DEI
- CERN LHC; COMPUTER ARCHITECTURE; COMPUTER CALCULATIONS; COMPUTER CODES; COMPUTER NETWORKS; DATA ANALYSIS; DATA TRANSMISSION; DISTRIBUTED DATA PROCESSING; MEMORY DEVICES; MULTIPARTICLE SPECTROMETERS; ON-LINE SYSTEMS; PARTICLE IDENTIFICATION; REAL TIME SYSTEMS; RESOURCE MANAGEMENT
- Descriptors DEC
- ACCELERATORS; COMMUNICATIONS; CYCLIC ACCELERATORS; DATA PROCESSING; MANAGEMENT; MEASURING INSTRUMENTS; PROCESSING; SPECTROMETERS; STORAGE RINGS; SYNCHROTRONS