References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Bringing Generalization to Deep Multi-View Pedestrian Detection
(Submitted on 24 Sep 2021 (v1), last revised 13 Mar 2022 (this version, v4))
Abstract: Multi-view Detection (MVD) is highly effective for occlusion reasoning in a crowded environment. While recent works using deep learning have made significant advances in the field, they have overlooked the generalization aspect, which makes them impractical for real-world deployment. The key novelty of our work is to formalize three critical forms of generalization and propose experiments to evaluate them: generalization with i) a varying number of cameras, ii) varying camera positions, and finally, iii) to new scenes. We find that existing state-of-the-art models show poor generalization by overfitting to a single scene and camera configuration. To address the concerns: (a) we propose a novel Generalized MVD (GMVD) dataset, assimilating diverse scenes with changing daytime, camera configurations, varying number of cameras, and (b) we discuss the properties essential to bring generalization to MVD and propose a barebones model to incorporate them. We perform a comprehensive set of experiments on the WildTrack, MultiViewX, and the GMVD datasets to motivate the necessity to evaluate the generalization abilities of MVD methods and to demonstrate the efficacy of the proposed approach. The code and the proposed dataset can be found at this https URL
Submission history
From: Shyamgopal Karthik [view email][v1] Fri, 24 Sep 2021 23:02:27 GMT (16666kb,D)
[v2] Mon, 29 Nov 2021 16:06:18 GMT (43672kb,D)
[v3] Wed, 1 Dec 2021 11:27:16 GMT (43672kb,D)
[v4] Sun, 13 Mar 2022 18:22:27 GMT (40505kb,D)
Link back to: arXiv, form interface, contact.