A unified approach to Markov decision problems and performance sensitivity analysis with discounted and average criteria: multichain cases

Xi-Ren Cao; Xianping Guo

doi:10.1016/j.automatica.2004.05.003

A unified approach to Markov decision problems and performance sensitivity analysis with discounted and average criteria: multichain cases

Automatica ◽

10.1016/j.automatica.2004.05.003 ◽

2004 ◽

Vol 40 (10) ◽

pp. 1749-1759 ◽

Cited By ~ 17

Author(s):

Xi-Ren Cao ◽

Xianping Guo

Keyword(s):

Sensitivity Analysis ◽

Decision Problems ◽

Unified Approach ◽

Markov Decision Problems ◽

Performance Sensitivity ◽

Markov Decision ◽

And Performance

Download Full-text

A unified approach to Markov decision problems and performance sensitivity analysis

Automatica ◽

10.1016/s0005-1098(99)00207-1 ◽

2000 ◽

Vol 36 (5) ◽

pp. 771-774 ◽

Cited By ~ 30

Author(s):

Xi-Ren Cao

Keyword(s):

Sensitivity Analysis ◽

Decision Problems ◽

Unified Approach ◽

Markov Decision Problems ◽

Performance Sensitivity ◽

Markov Decision ◽

And Performance

Download Full-text

SEMI-MARKOV DECISION PROBLEMS AND PERFORMANCE SENSITIVITY ANALYSIS

IFAC Proceedings Volumes ◽

10.3182/20020721-6-es-1901.00511 ◽

2002 ◽

Vol 35 (1) ◽

pp. 139-143 ◽

Cited By ~ 2

Author(s):

Xi-Ren Cao

Keyword(s):

Sensitivity Analysis ◽

Decision Problems ◽

Markov Decision Problems ◽

Performance Sensitivity ◽

Markov Decision ◽

And Performance

Download Full-text

Semi-markov decision problems and performance sensitivity analysis

IEEE Transactions on Automatic Control ◽

10.1109/tac.2003.811252 ◽

2003 ◽

Vol 48 (5) ◽

pp. 758-769 ◽

Cited By ~ 40

Author(s):

Xi-Ren Cao

Keyword(s):

Sensitivity Analysis ◽

Decision Problems ◽

Markov Decision Problems ◽

Performance Sensitivity ◽

Markov Decision ◽

And Performance

Download Full-text

Partially Observable Markov Decision Processes and Performance Sensitivity Analysis

IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) ◽

10.1109/tsmcb.2008.927711 ◽

2008 ◽

Vol 38 (6) ◽

pp. 1645-1651 ◽

Cited By ~ 9

Author(s):

Yanjie Li ◽

Baoqun Yin ◽

Hongsheng Xi

Keyword(s):

Sensitivity Analysis ◽

Markov Decision Processes ◽

Decision Processes ◽

Performance Sensitivity ◽

Markov Decision ◽

Partially Observable Markov ◽

And Performance ◽

Partially Observable

Download Full-text

Model Acquisition for Markov Decision Problems

10.21236/ada373795 ◽

1998 ◽

Author(s):

Thomas L. Dean

Keyword(s):

Decision Problems ◽

Model Acquisition ◽

Markov Decision Problems ◽

Markov Decision

Download Full-text

Model Acquisition for Markov Decision Problems

10.21236/ada380049 ◽

1998 ◽

Author(s):

Thomas Dean

Keyword(s):

Decision Problems ◽

Model Acquisition ◽

Markov Decision Problems ◽

Markov Decision

Download Full-text

Solving Uncertain Markov Decision Problems: An Interval-Based Method

Lecture Notes in Computer Science - Advances in Natural Computation ◽

10.1007/11881223_120 ◽

2006 ◽

pp. 948-957 ◽

Cited By ~ 2

Author(s):

Shulin Cui ◽

Jigui Sun ◽

Minghao Yin ◽

Shuai Lu

Keyword(s):

Decision Problems ◽

Markov Decision Problems ◽

Markov Decision

Download Full-text

Optimal control and optimal sensor activation for Markov decision problems with costly observations

2015 IEEE Conference on Control Applications (CCA) ◽

10.1109/cca.2015.7320814 ◽

2015 ◽

Cited By ~ 1

Author(s):

Rene K. Boel ◽

Jan H. van Schuppen

Keyword(s):

Optimal Control ◽

Decision Problems ◽

Markov Decision Problems ◽

Markov Decision ◽

Sensor Activation

Download Full-text

A simulation-based learning automata framework for solving semi-Markov decision problems under long-run average reward

IIE Transactions ◽

10.1080/07408170490438672 ◽

2004 ◽

Vol 36 (6) ◽

pp. 557-567 ◽

Cited By ~ 14

Author(s):

ABHIJIT GOSAVI ◽

TAPAS K. DAS ◽

SUDEEP SARKAR

Keyword(s):

Learning Automata ◽

Decision Problems ◽

Average Reward ◽

Markov Decision Problems ◽

Long Run ◽

Simulation Based ◽

Markov Decision ◽

Long Run Average Reward

Download Full-text

A reinforcement learning algorithm with fuzzy approximation for semi Markov decision problems

Journal of Intelligent & Fuzzy Systems ◽

10.3233/ifs-141460 ◽

2015 ◽

Vol 28 (4) ◽

pp. 1733-1744 ◽

Cited By ~ 1

Author(s):

Ufuk Kula ◽

Beyazıt Ocaktan

Keyword(s):

Reinforcement Learning ◽

Learning Algorithm ◽

Decision Problems ◽

Fuzzy Approximation ◽

Markov Decision Problems ◽

Markov Decision ◽

Reinforcement Learning Algorithm

Download Full-text