References & Citations
Computer Science > Robotics
Title: Spatio-Temporal Transformer-Based Reinforcement Learning for Robot Crowd Navigation
(Submitted on 26 May 2023 (v1), last revised 11 Oct 2023 (this version, v2))
Abstract: The social robot navigation is an open and challenging problem. In existing work, separate modules are used to capture spatial and temporal features, respectively. However, such methods lead to extra difficulties in improving the utilization of spatio-temporal features and reducing the conservative nature of navigation policy. In light of this, we present a spatio-temporal transformer-based policy optimization algorithm to enhance the utilization of spatio-temporal features, thereby facilitating the capture of human-robot interactions. Specifically, this paper introduces a gated embedding mechanism that effectively aligns the spatial and temporal representations by integrating both modalities at the feature level. Then Transformer is leveraged to encode the spatio-temporal semantic information, with hope of finding the optimal navigation policy. Finally, a combination of spatio-temporal Transformer and self-adjusting policy entropy significantly reduces the conservatism of navigation policies. Experimental results demonstrate the effectiveness of the proposed framework, where our method shows superior performance.
Submission history
From: Haodong He [view email][v1] Fri, 26 May 2023 04:13:28 GMT (1479kb,D)
[v2] Wed, 11 Oct 2023 04:56:34 GMT (0kb,I)
Link back to: arXiv, form interface, contact.