scholarly journals Tuning Approximate Dynamic Programming Policies for Ambulance Redeployment via Direct Search

2013 ◽  
Vol 3 (2) ◽  
pp. 322-361 ◽  
Author(s):  
Matthew S. Maxwell ◽  
Shane G. Henderson ◽  
Huseyin Topaloglu
Keyword(s):  
Dynamic Programming ◽  
Approximate Dynamic Programming ◽  
Direct Search

scholarly journals Performance comparison of approximate dynamic programming techniques for dynamic stochastic scheduling

2021 ◽  
Vol 11 (2) ◽  
pp. 178-185
Author(s):  
Yasin Göçgün
Keyword(s):  
Dynamic Programming ◽  
Approximate Dynamic Programming ◽  
Relevant Literature ◽  
Stochastic Scheduling ◽  
Performance Comparison ◽  
Direct Search ◽  
Basis Functions ◽  
Scheduling Problems ◽  
Programming Techniques ◽  
Dynamic Stochastic

This paper focuses on the performance comparison of several approximate dynamic programming (ADP) techniques. In particular, we evaluate three ADP techniques through a class of dynamic stochastic scheduling problems: Lagrangian-based ADP, linear programming-based ADP, and direct search-based ADP. We uniquely implement the direct search-based ADP through basis functions that differ from those used in the relevant literature. The class of scheduling problems has the property that jobs arriving dynamically and stochastically must be scheduled to days in advance. Numerical results reveal that the direct search-based ADP outperforms others in the majority of problem sets generated.

scholarly journals Robust-adaptive dynamic programming-based time-delay control of autonomous ships under stochastic disturbances using an actor-critic learning algorithm

2021 ◽  
Author(s):  
Hossein Nejatbakhsh Esfahani ◽  
Rafal Szlapczynski
Keyword(s):  
Dynamic Programming ◽  
Time Delay ◽  
Control Algorithm ◽  
Approximate Dynamic Programming ◽  
Robust Adaptive Control ◽  
Stochastic Disturbances ◽  
Time Delay Control ◽  
Model Free ◽  
Delay Control ◽  
Robust Adaptive

AbstractThis paper proposes a hybrid robust-adaptive learning-based control scheme based on Approximate Dynamic Programming (ADP) for the tracking control of autonomous ship maneuvering. We adopt a Time-Delay Control (TDC) approach, which is known as a simple, practical, model free and roughly robust strategy, combined with an Actor-Critic Approximate Dynamic Programming (ACADP) algorithm as an adaptive part in the proposed hybrid control algorithm. Based on this integration, Actor-Critic Time-Delay Control (AC-TDC) is proposed. It offers a high-performance robust-adaptive control approach for path following of autonomous ships under deterministic and stochastic disturbances induced by the winds, waves, and ocean currents. Computer simulations have been conducted under two different conditions in terms of the deterministic and stochastic disturbances and all simulation results indicate an acceptable performance in tracking of paths for the proposed control algorithm in comparison with the conventional TDC approach.

Sign in / Sign up

Export Citation Format

Share Document