Published June 11, 2014
| Version v1
Journal article
Experience of a low-maintenance distributed data management system
Creators
- 1. High Energy Accelerator Research Organization (KEK) (Japan)
- 2. University of Liverpool (United Kingdom)
- 3. Queen Mary, University of London (United Kingdom)
Description
In this paper we report on the setup, deployment and operation of a low-maintenance, policy-driven distributed data management system for scientific data based on the integrated Rule Oriented Data System (iRODS). The system is located at KEK, Tsukuba, Japan with a satellite system at QMUL, London, UK. The system has been running stably in production for more than two years with minimal management overhead. The management tool that was developed to support the production system is also described. In addition we describe a simple XOR-based approach to file backup that reduces the amount of storage space consumed. In situations of large data volumes this approach can be of great benefit.
Availability note (English)
Available from http://dx.doi.org/10.1088/1742-6596/513/3/032095Additional details
Identifiers
Publishing Information
- Journal Title
- Journal of Physics. Conference Series (Online)
- Journal Volume
- 513
- Journal Issue
- 3
- Journal Page Range
- [7 p.]
- ISSN
- 1742-6596
Conference
- Title
- 20. international conference on computing in high energy and nuclear physics
- Acronym
- CHEP2013
- Dates
- 14-18 Oct 2013
- Place
- Amsterdam (Netherlands)
INIS
- Country of Publication
- United Kingdom
- Country of Input or Organization
- International Atomic Energy Agency (IAEA)
- INIS RN
- 46083236
- Subject category
- S97: MATHEMATICAL METHODS AND COMPUTING;
- Resource subtype / Literary indicator
- Conference
- Descriptors DEI
- DATA BASE MANAGEMENT; DATA PROCESSING; DISTRIBUTION; INFORMATION DISSEMINATION; STORAGE
- Descriptors DEC
- MANAGEMENT; PROCESSING