The critical discount factor for finite Markovian decision processes with an absorbing set

K. Hinderer; K.-H. Waldmann

doi:10.1007/s001860200252

The critical discount factor for finite Markovian decision processes with an absorbing set

Mathematical Methods of Operations Research ◽

10.1007/s001860200252 ◽

2003 ◽

Vol 57 (1) ◽

pp. 1-19 ◽

Cited By ~ 14

Author(s):

K. Hinderer ◽

K.-H. Waldmann

Keyword(s):

Decision Processes ◽

Discount Factor ◽

Absorbing Set ◽

Markovian Decision Processes ◽

Critical Discount Factor

Download Full-text

Battery-aware power management based on Markovian decision processes

IEEE/ACM International Conference on Computer Aided Design, 2002. ICCAD 2002. ◽

10.1145/774572.774676 ◽

2002 ◽

Cited By ~ 7

Author(s):

Peng Rong ◽

Massoud Pedram

Keyword(s):

Power Management ◽

Decision Processes ◽

Markovian Decision Processes

Download Full-text

Markovian Decision Processes with Probabilistic Observation of States

Management Science ◽

10.1287/mnsc.20.1.1 ◽

1973 ◽

Vol 20 (1) ◽

pp. 1-13 ◽

Cited By ~ 14

Author(s):

J. K. Satia ◽

R. E. Lave

Keyword(s):

Decision Processes ◽

Markovian Decision Processes

Download Full-text

Technical Note—On the Asymptotic Convergence Rate of Cost Differences for Markovian Decision Processes

Operations Research ◽

10.1287/opre.19.1.244 ◽

1971 ◽

Vol 19 (1) ◽

pp. 244-248 ◽

Cited By ~ 29

Author(s):

Thomas E. Morton

Keyword(s):

Convergence Rate ◽

Technical Note ◽

Decision Processes ◽

Asymptotic Convergence ◽

Markovian Decision Processes ◽

Asymptotic Convergence Rate ◽

Cost Differences

Download Full-text

ARBITRARY STATE MARKOVIAN DECISION PROCESSES

10.21236/ad0664459 ◽

1968 ◽

Cited By ~ 2

Author(s):

Sheldon M. Ross

Keyword(s):

Decision Processes ◽

Arbitrary State ◽

Markovian Decision Processes

Download Full-text

An optimality principle for Markovian decision processes

Journal of Mathematical Analysis and Applications ◽

10.1016/0022-247x(76)90243-2 ◽

1976 ◽

Vol 54 (1) ◽

pp. 173-184 ◽

Cited By ~ 6

Author(s):

Paul J Schweitzer ◽

Bezalel Gavish

Keyword(s):

Decision Processes ◽

Optimality Principle ◽

Markovian Decision Processes

Download Full-text

Chapter 13. Markovian Decision Processes

Mathematics in Science and Engineering - The Art and Theory of Dynamic Programming ◽

10.1016/s0076-5392(08)61190-x ◽

1977 ◽

pp. 172-187

Keyword(s):

Decision Processes ◽

Markovian Decision Processes

Download Full-text

Computer Aided Investigation of the Structure of Solutions of Markovian Decision Processes

Hector ◽

10.1007/978-3-642-73576-9_5 ◽

1988 ◽

pp. 62-75

Author(s):

K. Hinderer ◽

D. Kadelka

Keyword(s):

Decision Processes ◽

Structure Of Solutions ◽

Computer Aided ◽

Markovian Decision Processes

Download Full-text

Markovian Decision Processes with Discrete Transition Law

Universitext - Dynamic Optimization ◽

10.1007/978-3-319-48814-1_14 ◽

2016 ◽

pp. 259-275

Author(s):

Karl Hinderer ◽

Ulrich Rieder ◽

Michael Stieglitz

Keyword(s):

Decision Processes ◽

Discrete Transition ◽

Markovian Decision Processes

Download Full-text

Examples of Markovian Decision Processes with Finite Transition Law

Universitext - Dynamic Optimization ◽

10.1007/978-3-319-48814-1_13 ◽

2016 ◽

pp. 221-257

Author(s):

Karl Hinderer ◽

Ulrich Rieder ◽

Michael Stieglitz

Keyword(s):

Decision Processes ◽

Markovian Decision Processes

Download Full-text

Markovian Decision Processes.

Journal of the Royal Statistical Society Series A (General) ◽

10.2307/2343663 ◽

1971 ◽

Vol 134 (4) ◽

pp. 678

Author(s):

J. A. Bather ◽

H. Mine ◽

S. Osaki

Keyword(s):

Decision Processes ◽

Markovian Decision Processes

Download Full-text