Approximate Dynamic Programming with State Aggregation applied to Perimeter Patrol*

2010 ◽  
Author(s):  
Krishnamoorthy Kalyanam ◽  
Meir Pachter ◽  
Phil Chandler
Keyword(s):  
Dynamic Programming ◽  
Approximate Dynamic Programming ◽  
State Aggregation

Approximate dynamic programming with state aggregation applied to UAV perimeter patrol

2011 ◽  
Vol 21 (12) ◽  
pp. 1396-1409 ◽  
Author(s):  
K. Krishnamoorthy ◽  
M. Pachter ◽  
S. Darbha ◽  
P. Chandler
Keyword(s):  
Dynamic Programming ◽  
Approximate Dynamic Programming ◽  
State Aggregation

scholarly journals Robust-adaptive dynamic programming-based time-delay control of autonomous ships under stochastic disturbances using an actor-critic learning algorithm

2021 ◽  
Author(s):  
Hossein Nejatbakhsh Esfahani ◽  
Rafal Szlapczynski
Keyword(s):  
Dynamic Programming ◽  
Time Delay ◽  
Control Algorithm ◽  
Approximate Dynamic Programming ◽  
Robust Adaptive Control ◽  
Stochastic Disturbances ◽  
Time Delay Control ◽  
Model Free ◽  
Delay Control ◽  
Robust Adaptive

AbstractThis paper proposes a hybrid robust-adaptive learning-based control scheme based on Approximate Dynamic Programming (ADP) for the tracking control of autonomous ship maneuvering. We adopt a Time-Delay Control (TDC) approach, which is known as a simple, practical, model free and roughly robust strategy, combined with an Actor-Critic Approximate Dynamic Programming (ACADP) algorithm as an adaptive part in the proposed hybrid control algorithm. Based on this integration, Actor-Critic Time-Delay Control (AC-TDC) is proposed. It offers a high-performance robust-adaptive control approach for path following of autonomous ships under deterministic and stochastic disturbances induced by the winds, waves, and ocean currents. Computer simulations have been conducted under two different conditions in terms of the deterministic and stochastic disturbances and all simulation results indicate an acceptable performance in tracking of paths for the proposed control algorithm in comparison with the conventional TDC approach.

Sign in / Sign up

Export Citation Format

Share Document