Fast and Efficient Entropy Compression of ALICE Data using ANS Coding
Description
In LHC Run 3, the upgraded ALICE detector will record 50 kHz Pb-Pb collisions using continuous readout. The resulting stream of raw data to be inspected increases to ~ 1 TB/s a hundredfold increase over Run 2 must be processed with a set of lossy and lossless compression and data reduction techniques to decrease the data rate to storage to 90 GB/s without affecting the physics. This contribution focuses on lossless entropy coding for ALICE Run 3 data which is the final component in the compression stage. We analyze data from the ALICE TPC and point out the challenges imposed by the non-standard data with a patchy distribution and symbol sizes of up to 25 Bit. We then explain why rANS, a variant of Asymmetric Numeral System coders is suitable for compressing this data effectively. Finally we present first compression performance numbers and bandwidth measurements obtained from a prototype implementation and give an outlook for future developments.
Availability note (English)
Available from https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_01001.pdf; https://doaj.org/article/6dae5c02c5a341799ee9b3d091e1c7e6Additional details
Identifiers
Publishing Information
- Journal Title
- EPJ. Web of Conferences
- Journal Volume
- 245
- Journal Page Range
- vp.
- ISSN
- 2100-014X
Conference
- Title
- 24. International Conference on Computing in High Energy and Nuclear Physics
- Acronym
- CHEP 2019
- Dates
- 4-8 Nov 2019
- Place
- Adelaide (Australia)
INIS
- Country of Publication
- France
- Country of Input or Organization
- France
- INIS RN
- 53090448
- Subject category
- S46: INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY; S97: MATHEMATICAL METHODS AND COMPUTING;
- Resource subtype / Literary indicator
- Conference
- Descriptors DEI
- ALICE DETECTOR; ASYMMETRY; CERN LHC; ENTROPY; IMPLEMENTATION; KHZ RANGE; PERFORMANCE; READOUT SYSTEMS
- Descriptors DEC
- ACCELERATORS; CYCLIC ACCELERATORS; FREQUENCY RANGE; MEASURING INSTRUMENTS; PHYSICAL PROPERTIES; RADIATION DETECTORS; STORAGE RINGS; SYNCHROTRONS; THERMODYNAMIC PROPERTIES