We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.PF

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Performance

Title: ESPBench: The Enterprise Stream Processing Benchmark

Abstract: Growing data volumes and velocities in fields such as Industry 4.0 or the Internet of Things have led to the increased popularity of data stream processing systems. Enterprises can leverage these developments by enriching their core business data and analyses with up-to-date streaming data. Comparing streaming architectures for these complex use cases is challenging, as existing benchmarks do not cover them. ESPBench is a new enterprise stream processing benchmark that fills this gap. We present its architecture, the benchmarking process, and the query workload. We employ ESPBench on three state-of-the-art stream processing systems, Apache Spark, Apache Flink, and Hazelcast Jet, using provided query implementations developed with Apache Beam. Our results highlight the need for the provided ESPBench toolkit that supports benchmark execution, as it enables query result validation and objective latency measures.
Comments: Accepted as full research paper at ACM/SPEC International Conference on Performance Engineering 2021 (ICPE 21)
Subjects: Performance (cs.PF)
DOI: 10.1145/3427921.3450242
Cite as: arXiv:2103.06775 [cs.PF]
  (or arXiv:2103.06775v1 [cs.PF] for this version)

Submission history

From: Guenter Hesse [view email]
[v1] Thu, 11 Mar 2021 16:35:39 GMT (4632kb,D)

Link back to: arXiv, form interface, contact.