References & Citations
Computer Science > Databases
Title: CORE: a Complex Event Recognition Engine
(Submitted on 8 Nov 2021 (v1), last revised 26 May 2022 (this version, v3))
Abstract: Complex Event Recognition (CER) systems are a prominent technology for finding user-defined query patterns over large data streams in real time. CER query evaluation is known to be computationally challenging, since it requires maintaining a set of partial matches, and this set quickly grows super-linearly in the number of processed events. We present CORE, a novel COmplex event Recognition Engine that focuses on the efficient evaluation of a large class of complex event queries, including time windows as well as the partition-by event correlation operator. This engine uses a novel automaton-based evaluation algorithm that circumvents the super-linear partial match problem: under data complexity, it takes constant time per input event to maintain a data structure that compactly represents the set of partial matches and, once a match is found, the query results may be enumerated from the data structure with output-linear delay. We experimentally compare CORE against state-of-the-art CER systems on real-world data. We show that (1) CORE's performance is stable with respect to both query and time window size, and (2) CORE outperforms the other systems by up to five orders of magnitude on different workloads.
Submission history
From: Alejandro Grez [view email][v1] Mon, 8 Nov 2021 17:03:15 GMT (210kb,D)
[v2] Tue, 17 May 2022 01:50:44 GMT (271kb,D)
[v3] Thu, 26 May 2022 23:41:30 GMT (271kb,D)
Link back to: arXiv, form interface, contact.