Published 2020 | Version v1
Journal article

Fast and Efficient Entropy Compression of ALICE Data using ANS Coding

  • 1. CERN, Technische Universität München (Switzerland)

Description

In LHC Run 3, the upgraded ALICE detector will record 50 kHz Pb-Pb collisions using continuous readout. The resulting stream of raw data to be inspected increases to ~ 1 TB/s a hundredfold increase over Run 2 must be processed with a set of lossy and lossless compression and data reduction techniques to decrease the data rate to storage to 90 GB/s without affecting the physics. This contribution focuses on lossless entropy coding for ALICE Run 3 data which is the final component in the compression stage. We analyze data from the ALICE TPC and point out the challenges imposed by the non-standard data with a patchy distribution and symbol sizes of up to 25 Bit. We then explain why rANS, a variant of Asymmetric Numeral System coders is suitable for compressing this data effectively. Finally we present first compression performance numbers and bandwidth measurements obtained from a prototype implementation and give an outlook for future developments.

Availability note (English)

Available from https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_01001.pdf; https://doaj.org/article/6dae5c02c5a341799ee9b3d091e1c7e6

Additional details

Publishing Information

Journal Title
EPJ. Web of Conferences
Journal Volume
245
Journal Page Range
vp.
ISSN
2100-014X

Conference

Title
24. International Conference on Computing in High Energy and Nuclear Physics
Acronym
CHEP 2019
Dates
4-8 Nov 2019
Place
Adelaide (Australia)