scholarly journals A minimum relative entropy principle for AGI

2010 ◽  
Author(s):  
Antoine van de Ven ◽  
Ben A.M. Schouten
Keyword(s):  
Relative Entropy ◽  
Entropy Principle ◽  
Minimum Relative Entropy

scholarly journals A Minimum Relative Entropy Principle for Learning and Acting

2010 ◽  
Vol 38 ◽  
pp. 475-511 ◽  
Author(s):  
P. A. Ortega ◽  
D. A. Braun
Keyword(s):  
Relative Entropy ◽  
Optimal Solution ◽  
Control Law ◽  
Control Rule ◽  
Adaptive Agent ◽  
Normal Probability ◽  
Entropy Principle ◽  
Minimum Relative Entropy ◽  
Bayesian Control ◽  
Stochastic Controller

This paper proposes a method to construct an adaptive agent that is universal with respect to a given class of experts, where each expert is designed specifically for a particular environment. This adaptive control problem is formalized as the problem of minimizing the relative entropy of the adaptive agent from the expert that is most suitable for the unknown environment. If the agent is a passive observer, then the optimal solution is the well-known Bayesian predictor. However, if the agent is active, then its past actions need to be treated as causal interventions on the I/O stream rather than normal probability conditions. Here it is shown that the solution to this new variational problem is given by a stochastic controller called the Bayesian control rule, which implements adaptive behavior as a mixture of experts. Furthermore, it is shown that under mild assumptions, the Bayesian control rule converges to the control law of the most suitable expert.

Minimum Relative Entropy Criterion for Damage Detection and Location

2007 ◽  
pp. 421-426
Author(s):  
Andreas Kyprianou ◽  
Cristinel Mares ◽  
Charalambos D. Charalambous ◽  
John E. Mottershead
Keyword(s):  
Damage Detection ◽  
Relative Entropy ◽  
Minimum Relative Entropy ◽  
Entropy Criterion

Minimum relative entropy enhancement of FFT spectra

1990 ◽  
Vol 26 (14) ◽  
pp. 979 ◽  
Author(s):  
J.P. Noonan ◽  
M.A. Tzannes ◽  
B. Achour
Keyword(s):  
Relative Entropy ◽  
Minimum Relative Entropy
Sign in / Sign up

Export Citation Format

Share Document