References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Learning Road Scene-level Representations via Semantic Region Prediction
(Submitted on 2 Jan 2023 (v1), last revised 27 Feb 2023 (this version, v2))
Abstract: In this work, we tackle two vital tasks in automated driving systems, i.e., driver intent prediction and risk object identification from egocentric images. Mainly, we investigate the question: what would be good road scene-level representations for these two tasks? We contend that a scene-level representation must capture higher-level semantic and geometric representations of traffic scenes around ego-vehicle while performing actions to their destinations. To this end, we introduce the representation of semantic regions, which are areas where ego-vehicles visit while taking an afforded action (e.g., left-turn at 4-way intersections). We propose to learn scene-level representations via a novel semantic region prediction task and an automatic semantic region labeling algorithm. Extensive evaluations are conducted on the HDD and nuScenes datasets, and the learned representations lead to state-of-the-art performance for driver intention prediction and risk object identification.
Submission history
From: Zihao Xiao [view email][v1] Mon, 2 Jan 2023 15:13:30 GMT (18549kb,D)
[v2] Mon, 27 Feb 2023 22:19:55 GMT (18549kb,D)
Link back to: arXiv, form interface, contact.