We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.AI

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Artificial Intelligence

Title: Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal control

Abstract: Many studies confirmed that a proper traffic state representation is more important than complex algorithms for the classical traffic signal control (TSC) problem. In this paper, we (1) present a novel, flexible and efficient method, namely advanced max pressure (Advanced-MP), taking both running and queuing vehicles into consideration to decide whether to change current signal phase; (2) inventively design the traffic movement representation with the efficient pressure and effective running vehicles from Advanced-MP, namely advanced traffic state (ATS); and (3) develop a reinforcement learning (RL) based algorithm template, called Advanced-XLight, by combining ATS with the latest RL approaches, and generate two RL algorithms, namely "Advanced-MPLight" and "Advanced-CoLight" from Advanced-XLight. Comprehensive experiments on multiple real-world datasets show that: (1) the Advanced-MP outperforms baseline methods, and it is also efficient and reliable for deployment; and (2) Advanced-MPLight and Advanced-CoLight can achieve the state-of-the-art.
Comments: 10 pages, 5 figures
Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Signal Processing (eess.SP)
ACM classes: J.4; J.6
Cite as: arXiv:2112.10107 [cs.AI]
  (or arXiv:2112.10107v3 [cs.AI] for this version)

Submission history

From: Liang Zhang [view email]
[v1] Sun, 19 Dec 2021 10:28:39 GMT (1299kb,D)
[v2] Mon, 8 Aug 2022 01:51:02 GMT (2315kb,D)
[v3] Tue, 9 Aug 2022 14:28:12 GMT (2309kb,D)

Link back to: arXiv, form interface, contact.