A Fokker–Planck control framework for stochastic systems

2018 ◽  
Vol 5 (1) ◽  
pp. 65-98 ◽  
Author(s):  
Mario Annunziato ◽  
Alfio Borzi
Author(s):  
Yan Wang

The Fokker-Planck equation is widely used to describe the time evolution of stochastic systems in drift-diffusion processes. Yet, it does not differentiate two types of uncertainties: aleatory uncertainty that is inherent randomness and epistemic uncertainty due to lack of perfect knowledge. In this paper, a generalized Fokker-Planck equation based on a new generalized interval probability theory is proposed to describe drift-diffusion processes under both uncertainties, where epistemic uncertainty is modeled by the generalized interval while the aleatory one is by the probability measure. A path integral approach is developed to numerically solve the generalized Fokker-Planck equation. The resulted interval-valued probability density functions rigorously bound the real-valued ones computed from the classical path integral method. The new approach is demonstrated by numerical examples.


2021 ◽  
Vol 51 ◽  
pp. 74-95
Author(s):  
Aleksandr Vladimirovich Kolesnichenko

A logical scheme for constructing thermodynamics of anomalous stochastic systems based on the nonextensive two-parameter (κ, ς) -entropy of Sharma–Taneja–Mittal (SHTM) is considered. Thermodynamics within the framework (2 - q) -statistics of Tsallis was constructed, which belongs to the STM family of statistics. The approach of linear nonequilibrium thermodynamics to the construction of a family of nonlinear equations of Fokker−Planck−Kolmogorov (FPK), is used, correlated with the entropy of the STM, in which the stationary solution of the diffusion equation coincides with the corresponding generalized Gibbs distribution obtained from the extremality (κ, ς) - entropy condition of a non-additive stochastic system. Taking into account the convexity property of the Bregman divergence, it was shown that the principle of maximum equilibrium entropy is valid for (κ, ς) - systems, and also was proved the H - theorem determining the direction of the time evolution of the non-equilibrium state of the system. This result is extended also to non-equilibrium systems that evolve to a stationary state in accordance with the nonlinear FPK equation. The method of the ansatz- approach for solving non-stationary FPK equations is considered, which allows us to find the time dependence of the probability density distribution function for non-equilibrium anomalous systems. Received diffusive equations FPК can be used, in particular, at the analysis of diffusion of every possible epidemics and pandemics. The obtained diffusion equations of the FPK can be used, in particular, in the analysis of the spread of various epidemics and pandemics.


Entropy ◽  
2020 ◽  
Vol 22 (8) ◽  
pp. 802
Author(s):  
Dimitra Maoutsa ◽  
Sebastian Reich ◽  
Manfred Opper

Fokker–Planck equations are extensively employed in various scientific fields as they characterise the behaviour of stochastic systems at the level of probability density functions. Although broadly used, they allow for analytical treatment only in limited settings, and often it is inevitable to resort to numerical solutions. Here, we develop a computational approach for simulating the time evolution of Fokker–Planck solutions in terms of a mean field limit of an interacting particle system. The interactions between particles are determined by the gradient of the logarithm of the particle density, approximated here by a novel statistical estimator. The performance of our method shows promising results, with more accurate and less fluctuating statistics compared to direct stochastic simulations of comparable particle number. Taken together, our framework allows for effortless and reliable particle-based simulations of Fokker–Planck equations in low and moderate dimensions. The proposed gradient–log–density estimator is also of independent interest, for example, in the context of optimal control.


2015 ◽  
Vol 37 (2) ◽  
pp. 290-304 ◽  
Author(s):  
M. Annunziato ◽  
A. Borzì ◽  
M. Magdziarz ◽  
A. Weron

Sign in / Sign up

Export Citation Format

Share Document