scholarly journals Sensitivity-analysis in discounted Markovian decision problems

OR Spectrum ◽  
1985 ◽  
Vol 7 (3) ◽  
pp. 143-151 ◽  
Author(s):  
A. Hordijk ◽  
R. Dekker ◽  
L. C. M. Kallenberg
Keyword(s):  
Sensitivity Analysis ◽  
Decision Problems ◽  
Markovian Decision Problems

Bounds and good policies in stationary finite–stage Markovian decision problems

1980 ◽  
Vol 12 (1) ◽  
pp. 154-173 ◽  
Author(s):  
Gerhard Hübner
Keyword(s):  
Decision Model ◽  
Transition Probabilities ◽  
Planning Horizon ◽  
Decision Problems ◽  
Optimal Decisions ◽  
Optimal Value ◽  
Action Spaces ◽  
Stationary Problems ◽  
Markovian Decision Problems

A stationary Markovian decision model is considered with general state and action spaces where the transition probabilities are weakened to be bounded transition measures (this is useful for many applications). New and improved bounds are given for the optimal value of stationary problems with a large planning horizon if either only a few steps of iteration are carried out or, in addition, a solution of the infinite-stage problem is known. Similar estimates are obtained for the quality of policies which are composed of nearly optimal decisions from the first few steps or from the infinite-stage solution.

Sign in / Sign up

Export Citation Format

Share Document