Title: D-ACC: Dynamic Adaptive Cruise Control for Highways with Ramps Based on Deep Q-Learning

Abstract: An Adaptive Cruise Control (ACC) system allows vehicles to maintain a desired headway distance to a preceding vehicle automatically. ACC is increasingly adopted by commercial vehicles. Recent research demonstrates that effective use of ACC can improve the traffic flow by adjusting the headway distance in response to dynamically changing traffic conditions. In this paper, we demonstrate that a state-of-the-art real-time ACC system performs poorly on highways with ramps because the simple model-based approach does not take into account appropriately the dynamics of traffic on ramps in determining the optimal headway distance. We then propose a dynamic adaptive cruise control system (D-ACC) based on deep reinforcement learning that adapts the headway distance effectively according to dynamically changing traffic conditions of both the main road and ramp to optimize the traffic flow. Extensive simulations are performed with a combination of a traffic simulator (SUMO) and vehicle-to-everything communication (V2X) network simulator (Veins) under numerous traffic scenarios. We demonstrate that D-ACC improves the traffic flow by up to 70% compared with a state-of-the-art real-time ACC system in a highway segment with a ramp.