Published June 11, 2014 | Version v1
Journal article

Experience of a low-maintenance distributed data management system

  • 1. High Energy Accelerator Research Organization (KEK) (Japan)
  • 2. University of Liverpool (United Kingdom)
  • 3. Queen Mary, University of London (United Kingdom)

Description

In this paper we report on the setup, deployment and operation of a low-maintenance, policy-driven distributed data management system for scientific data based on the integrated Rule Oriented Data System (iRODS). The system is located at KEK, Tsukuba, Japan with a satellite system at QMUL, London, UK. The system has been running stably in production for more than two years with minimal management overhead. The management tool that was developed to support the production system is also described. In addition we describe a simple XOR-based approach to file backup that reduces the amount of storage space consumed. In situations of large data volumes this approach can be of great benefit.

Availability note (English)

Available from http://dx.doi.org/10.1088/1742-6596/513/3/032095

Additional details

Publishing Information

Journal Title
Journal of Physics. Conference Series (Online)
Journal Volume
513
Journal Issue
3
Journal Page Range
[7 p.]
ISSN
1742-6596

Conference

Title
20. international conference on computing in high energy and nuclear physics
Acronym
CHEP2013
Dates
14-18 Oct 2013
Place
Amsterdam (Netherlands)

INIS

Country of Publication
United Kingdom
Country of Input or Organization
International Atomic Energy Agency (IAEA)
INIS RN
46083236
Subject category
S97: MATHEMATICAL METHODS AND COMPUTING;
Resource subtype / Literary indicator
Conference
Descriptors DEI
DATA BASE MANAGEMENT; DATA PROCESSING; DISTRIBUTION; INFORMATION DISSEMINATION; STORAGE
Descriptors DEC
MANAGEMENT; PROCESSING