The Optimal Strategy in the Control Problem Associated with the Hamilton–Jacobi–Bellman Equation

1980 ◽  
Vol 18 (2) ◽  
pp. 191-198 ◽  
Author(s):  
Avner Friedman ◽  
Pierre-Louis Lions
Keyword(s):  
Control Problem ◽  
Optimal Strategy ◽  
Bellman Equation ◽  
Hamilton Jacobi Bellman Equation ◽  
Hamilton Jacobi Bellman

scholarly journals Dynamic programming principle and associated Hamilton-Jacobi-Bellman equation for stochastic recursive control problem with non-Lipschitz aggregator

2018 ◽  
Vol 24 (1) ◽  
pp. 355-376 ◽  
Author(s):  
Jiangyan Pu ◽  
Qi Zhang
Keyword(s):  
Dynamic Programming ◽  
Control Problem ◽  
Bellman Equation ◽  
Backward Stochastic Differential Equation ◽  
Dynamic Programming Principle ◽  
Unknown Variable ◽  
Hamilton Jacobi Bellman Equation ◽  
Hamilton Jacobi Bellman ◽  
The Stability ◽  
The Value Function

In this work we study the stochastic recursive control problem, in which the aggregator (or generator) of the backward stochastic differential equation describing the running cost is continuous but not necessarily Lipschitz with respect to the first unknown variable and the control, and monotonic with respect to the first unknown variable. The dynamic programming principle and the connection between the value function and the viscosity solution of the associated Hamilton-Jacobi-Bellman equation are established in this setting by the generalized comparison theorem for backward stochastic differential equations and the stability of viscosity solutions. Finally we take the control problem of continuous-time Epstein−Zin utility with non-Lipschitz aggregator as an example to demonstrate the application of our study.

scholarly journals Optimal Expected Utility of Dividend Payments with Proportional Reinsurance under VaR Constraints and Stochastic Interest Rate

2020 ◽  
Vol 2020 ◽  
pp. 1-13
Author(s):  
Yuzhen Wen ◽  
Chuancun Yin
Keyword(s):  
Optimal Strategy ◽  
Bellman Equation ◽  
Insurance Company ◽  
Time Value ◽  
Dividend Payments ◽  
Discounted Utility ◽  
Stochastic Interest ◽  
Hamilton Jacobi Bellman Equation ◽  
Hamilton Jacobi Bellman ◽  
The Value Function

In this paper, we consider the problem of maximizing the expected discounted utility of dividend payments for an insurance company taking into account the time value of ruin. We assume the preference of the insurer is of the CRRA form. The discounting factor is modeled as a geometric Brownian motion. We introduce the VaR control levels for the insurer to control its loss in reinsurance strategies. By solving the corresponding Hamilton-Jacobi-Bellman equation, we obtain the value function and the corresponding optimal strategy. Finally, we provide some numerical examples to illustrate the results and analyze the VaR control levels on the optimal strategy.

Interception of automated adversarial drone swarms in partially observed environments

2021 ◽  
pp. 1-14
Author(s):  
Daniel Saranovic ◽  
Martin Pavlovski ◽  
William Power ◽  
Ivan Stojkovic ◽  
Zoran Obradovic
Keyword(s):  
Bellman Equation ◽  
Pid Controllers ◽  
Partially Observed ◽  
Hamilton Jacobi Bellman Equation ◽  
Partial Feedback ◽  
Point Solution ◽  
Physical Limitations ◽  
Defensive Mechanisms ◽  
Hamilton Jacobi Bellman ◽  
New Framework

As the prevalence of drones increases, understanding and preparing for possible adversarial uses of drones and drone swarms is of paramount importance. Correspondingly, developing defensive mechanisms in which swarms can be used to protect against adversarial Unmanned Aerial Vehicles (UAVs) is a problem that requires further attention. Prior work on intercepting UAVs relies mostly on utilizing additional sensors or uses the Hamilton-Jacobi-Bellman equation, for which strong conditions need to be met to guarantee the existence of a saddle-point solution. To that end, this work proposes a novel interception method that utilizes the swarm’s onboard PID controllers for setting the drones’ states during interception. The drone’s states are constrained only by their physical limitations, and only partial feedback of the adversarial drone’s positions is assumed. The new framework is evaluated in a virtual environment under different environmental and model settings, using random simulations of more than 165,000 swarm flights. For certain environmental settings, our results indicate that the interception performance of larger swarms under partial observation is comparable to that of a one-drone swarm under full observation of the adversarial drone.

Sign in / Sign up

Export Citation Format

Share Document