General Second-Order Consensus of Discrete-Time Multiagent Systems via Q-Learning Method

2020 ◽  
pp. 1-9
Author(s):  
Yifan Liu ◽  
Housheng Su
Keyword(s):  
Multiagent Systems ◽  
Discrete Time ◽  
Second Order ◽  
Learning Method ◽  
Q Learning

scholarly journals Improved Q-Learning Method for Linear Discrete-Time Systems

Processes ◽  
2020 ◽  
Vol 8 (3) ◽  
pp. 368
Author(s):  
Jian Chen ◽  
Jinhua Wang ◽  
Jie Huang
Keyword(s):  
Optimal Control ◽  
Linear Systems ◽  
Discrete Time ◽  
Control Method ◽  
Learning Method ◽  
Control Laws ◽  
Q Learning ◽  
Model Free ◽  
Quadratic Optimal Control ◽  
Time Linear

In this paper, the Q-learning method for quadratic optimal control problem of discrete-time linear systems is reconsidered. The theoretical results prove that the quadratic optimal controller cannot be solved directly due to the linear correlation of the data sets. The following corollaries have been made: (1) The correlation of data is the key factor in the success for the calculation of quadratic optimal control laws by Q-learning method; (2) The control laws for linear systems cannot be derived directly by the existing Q-learning method; (3) For nonlinear systems, there are some doubts about the data independence of current method. Therefore, it is necessary to discuss the probability of the controllers established by the existing Q-learning method. To solve this problem, based on the ridge regression, an improved model-free Q-learning quadratic optimal control method for discrete-time linear systems is proposed in this paper. Therefore, the computation process can be implemented correctly, and the effective controller can be solved. The simulation results show that the proposed method can not only overcome the problem caused by the data correlation, but also derive proper control laws for discrete-time linear systems.

scholarly journals Consensus of Discrete Time Second-Order Multiagent Systems with Time Delay

2012 ◽  
Vol 2012 ◽  
pp. 1-9 ◽  
Author(s):  
Wei Zhu
Keyword(s):  
Time Delay ◽  
Convergence Rate ◽  
Theoretical Result ◽  
Multiagent Systems ◽  
Discrete Time ◽  
Second Order ◽  
Sufficient Condition ◽  
Consensus Problem ◽  
Necessary And Sufficient Condition ◽  
Necessary And Sufficient

The consensus problem for discrete time second-order multiagent systems with time delay is studied. Some effective methods are presented to deal with consensus problems in discrete time multiagent systems. A necessary and sufficient condition is established to ensure consensus. The convergence rate for reaching consensus is also estimated. It is shown that arbitrary bounded time delay can safely be tolerated. An example is presented to illustrate the theoretical result.

Sign in / Sign up

Export Citation Format

Share Document