Markov Processes and Controlled Markov Chains
Latest Publications

TOTAL DOCUMENTS

32

(FIVE YEARS 0)

H-INDEX

4

(FIVE YEARS 0)

Published By Springer US

9781461379683, 9781461302650

Latest Documents Most Cited Documents Contributed Authors Related Sources Related Keywords

The Effect of Stochastic Disturbance on the Solitary Waves

Markov Processes and Controlled Markov Chains ◽

10.1007/978-1-4613-0265-0_29 ◽

2002 ◽

pp. 465-474

Author(s):

Junping Li ◽

Zhenting Hou ◽

Zaiming Liu ◽

Weiguo Zhang

Keyword(s):

Solitary Waves ◽

Stochastic Disturbance

Download Full-text

Monotonic Approximation of the Gittins Index

Markov Processes and Controlled Markov Chains ◽

10.1007/978-1-4613-0265-0_22 ◽

2002 ◽

pp. 363-367 ◽

Cited By ~ 1

Author(s):

Xikui Wang

Keyword(s):

Gittins Index

Download Full-text

Doob’s Inequality and Lower Estimation of The Maximum of Martingales

Markov Processes and Controlled Markov Chains ◽

10.1007/978-1-4613-0265-0_20 ◽

2002 ◽

pp. 341-349

Author(s):

Li Zhichan

Keyword(s):

Lower Estimation ◽

Doob's Inequality ◽

Doob’S Inequality

Download Full-text

Approximations of a Controlled Diffusion Model for Renewable Resource Exploitation

Markov Processes and Controlled Markov Chains ◽

10.1007/978-1-4613-0265-0_16 ◽

2002 ◽

pp. 287-302

Author(s):

Sara Pasquali ◽

Wolfgang J. Runggaldier

Keyword(s):

Diffusion Model ◽

Renewable Resource ◽

Resource Exploitation ◽

Controlled Diffusion

Download Full-text

Optimality Conditions for CTMDP with Average Cost Criterion

Markov Processes and Controlled Markov Chains ◽

10.1007/978-1-4613-0265-0_10 ◽

2002 ◽

pp. 167-188 ◽

Cited By ~ 2

Author(s):

Xianping Guo ◽

Weiping Zhu

Keyword(s):

Optimality Conditions ◽

Average Cost ◽

Average Cost Criterion ◽

Cost Criterion

Download Full-text

Markov Skeleton Processes

Markov Processes and Controlled Markov Chains ◽

10.1007/978-1-4613-0265-0_5 ◽

2002 ◽

pp. 69-92

Author(s):

Zhenting Hou ◽

Zaiming Liu ◽

Jiezhong Zou ◽

Xuerong Chen

Keyword(s):

Markov Skeleton Processes

Download Full-text

Optimal and Nearly Optimal Policies in Markov Decision Chains with Nonnegative Rewards and Risk-Sensitive Expected Total-Reward Criterion

Markov Processes and Controlled Markov Chains ◽

10.1007/978-1-4613-0265-0_11 ◽

2002 ◽

pp. 189-221

Author(s):

Rolando Cavazos-Cadena ◽

Raúl Montes-de-Oca

Keyword(s):

Total Reward ◽

Risk Sensitive ◽

Optimal Policies ◽

Markov Decision ◽

Reward Criterion

Download Full-text

Convergence Property of Standard Transition Functions

Markov Processes and Controlled Markov Chains ◽

10.1007/978-1-4613-0265-0_4 ◽

2002 ◽

pp. 57-67

Author(s):

Hanjun Zhang ◽

Qixiang Mei ◽

Xiang Lin ◽

Zhenting Hou

Keyword(s):

Convergence Property ◽

Transition Functions

Download Full-text

Expected Loss and Availability of Multistate Repairable System

Markov Processes and Controlled Markov Chains ◽

10.1007/978-1-4613-0265-0_32 ◽

2002 ◽

pp. 499-511

Author(s):

Yubo Ge

Keyword(s):

Repairable System ◽

Expected Loss

Download Full-text

Identifying Q-Processes with a Given Finite µ-Invariant Measure

Markov Processes and Controlled Markov Chains ◽

10.1007/978-1-4613-0265-0_3 ◽

2002 ◽

pp. 41-55

Author(s):

P. K. Pollett

Keyword(s):

Invariant Measure

Download Full-text