Current browse context:
cs.AI
Change to browse by:
References & Citations
Computer Science > Artificial Intelligence
Title: DynLight: Realize dynamic phase duration with multi-level traffic signal control
(Submitted on 7 Apr 2022 (this version), latest version 13 Mar 2023 (v4))
Abstract: Adopting reinforcement learning (RL) for traffic signal control is increasingly popular. Most RL methods use fixed action interval (denoted as tduration) and actuate or maintain a phase every tduration, which makes the phase duration less dynamic and flexible. In addition, the actuated phase can be arbitrary, affecting the real-world deployment, which requires a fixed cyclical phase structure. To address these challenges, we propose a multi-level traffic signal control framework, DynLight, which uses an optimization method Max-QueueLength (M-QL) to determine the phase and uses a deep Q-network to determine the corresponding duration. Based on DynLight, we further propose DynLight-C that adopts a well trained deep Q-network of DynLight and replace M-QL by a fixed cyclical control policy that actuate a set of phases in fixed order to realize cyclical phase structure. Comprehensive experiments on multiple real-world datasets demonstrate that DynLight achives a new state-of-the-art. Furthermore, the deep Q-network of DynLight can learn well on determining the phase duration and DynLight-C demonstrates high performance for deployment.
Submission history
From: Liang Zhang [view email][v1] Thu, 7 Apr 2022 14:39:38 GMT (1407kb,D)
[v2] Wed, 20 Apr 2022 13:08:17 GMT (2916kb,D)
[v3] Thu, 3 Nov 2022 03:56:57 GMT (0kb,I)
[v4] Mon, 13 Mar 2023 14:05:43 GMT (2916kb,D)
Link back to: arXiv, form interface, contact.