References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: An Asynchronous Kalman Filter for Hybrid Event Cameras
(Submitted on 10 Dec 2020 (v1), last revised 11 May 2022 (this version, v4))
Abstract: Event cameras are ideally suited to capture HDR visual information without blur but perform poorly on static or slowly changing scenes. Conversely, conventional image sensors measure absolute intensity of slowly changing scenes effectively but do poorly on high dynamic range or quickly changing scenes. In this paper, we present an event-based video reconstruction pipeline for High Dynamic Range (HDR) scenarios. The proposed algorithm includes a frame augmentation pre-processing step that deblurs and temporally interpolates frame data using events. The augmented frame and event data are then fused using a novel asynchronous Kalman filter under a unifying uncertainty model for both sensors. Our experimental results are evaluated on both publicly available datasets with challenging lighting conditions and fast motions and our new dataset with HDR reference. The proposed algorithm outperforms state-of-the-art methods in both absolute intensity error (48% reduction) and image similarity indexes (average 11% improvement).
Submission history
From: Ziwei Wang [view email][v1] Thu, 10 Dec 2020 11:24:07 GMT (35456kb,D)
[v2] Mon, 12 Apr 2021 08:32:43 GMT (5215kb,D)
[v3] Mon, 18 Oct 2021 09:32:44 GMT (5323kb,D)
[v4] Wed, 11 May 2022 06:43:08 GMT (5323kb,D)
Link back to: arXiv, form interface, contact.