scholarly journals An Overview of Reinforcement Learning Methods for Variable Speed Limit Control

2020 ◽  
Vol 10 (14) ◽  
pp. 4917
Author(s):  
Krešimir Kušić ◽  
Edouard Ivanjko ◽  
Martin Gregurić ◽  
Mladen Miletić

Variable Speed Limit (VSL) control systems are widely studied as solutions for improving safety and throughput on urban motorways. Machine learning techniques, specifically Reinforcement Learning (RL) methods, are a promising alternative for setting up VSL since they can learn and react to different traffic situations without knowing the explicit model of the motorway dynamics. However, the efficiency of combined RL-VSL is highly related to the class of the used RL algorithm, and description of the managed motorway section in which the RL-VSL agent sets the appropriate speed limits. Currently, there is no existing overview of RL algorithm applications in the domain of VSL. Therefore, a comprehensive survey on the state of the art of RL-VSL is presented. Best practices are summarized, and new viewpoints and future research directions, including an overview of current open research questions are presented.

2015 ◽  
Vol 42 (7) ◽  
pp. 477-489 ◽  
Author(s):  
Ying Luo ◽  
M. Hadiuzzaman ◽  
Jie Fang ◽  
Tony Z. Qiu

Over the past few decades, several active traffic control methods have been proposed to improve freeway efficiency at bottleneck locations. Variable speed limit (VSL) is one of these effective controls. Previous studies have evaluated VSL control, but primarily during recurrent congestion only. This study focuses on evaluating the performance of VSL control for both recurrent and non-recurrent congestion. To assess the effectiveness of a previously proposed VSL control in a real-world situation, this study has three evaluation objectives: (1) examine the control performance when recurrent and (or) non-recurrent congestion occurs; (2) assess the effectiveness of the control when a queue encounters the VSL sign; and (3) consider the impact of system detection delay in VSL control. Comparative experiments for Whitemud Drive in Edmonton, Alberta, Canada, are simulated in the VISSIM platform, and traffic performance is compared among scenarios with and without control. The simulation results show that VSL improves mobility for both recurrent and non-recurrent congestion. The VSL control reduces total travel time, and improves total travel distance and total flow. Furthermore, it slows down the shockwave propagation speed, improves the average speed on most of the freeway segments, and reduces the duration of traffic recovery.


Sign in / Sign up

Export Citation Format

Share Document