• German
German

Main Navigation

Lindemann/etal/2018a: Efficient Stream Processing of Scientific Data

Bibtype Inproceedings
Bibkey Lindemann/etal/2018a
Author Thomas Lindemann and Jonas Kauke and Jens Teubner
Title Efficient Stream Processing of Scientific Data
Booktitle Proc. of the Joint HardBD & Active '18 Workshop
Address Paris, France
Abstract Modern particle physics produces volumes of experimental data that challenge any data processing system. To illustrate, the trigger system of the LHCb experiment at CERN must sustain a data rate of 4 TB/s, yet maintain real-time characteristics.
In this work, we report on ELPACO, a distributed event processing platform for scientific data. Its key characteristics are excellent scalability and high resource efficiency. ELPACO inherits its favorable scalability from Apache Storm, which we used as a basis for our platform. For resource efficiency, we tailored ELPACO to Eriador, a parallel, ARM-based hardware substrate with excellent energy/performance characteristics.
With experiments on realistic data, we confirm a linear scalability (throughput vs. core count) and a 2.5× improvement in energy efficiency compared to existing solutions.
Month april
Year 2018
Projekt SFB876-C5
Bibtex Here you can get this literature entry as BibTeX format.