Finite-state control of continuous-state processes: The discrete time case

1982 ◽  
Author(s):  
David Wimpey ◽  
Timothy Johnson
Keyword(s):  
Discrete Time ◽  
State Control ◽  
Continuous State ◽  
Finite State ◽  
Discrete Time Case ◽  
Finite State Control

scholarly journals On the total reward variance for continuous-time Markov reward chains

2006 ◽  
Vol 43 (04) ◽  
pp. 1044-1052 ◽  
Author(s):  
Nico M. Van Dijk ◽  
Karel Sladký
Keyword(s):  
Growth Rate ◽  
Discrete Time ◽  
Continuous Time ◽  
Asymptotically Linear ◽  
State Spaces ◽  
Total Reward ◽  
Finite State ◽  
Markov Reward ◽  
Discrete Time Case

As an extension of the discrete-time case, this note investigates the variance of the total cumulative reward for continuous-time Markov reward chains with finite state spaces. The results correspond to discrete-time results. In particular, the variance growth rate is shown to be asymptotically linear in time. Expressions are provided to compute this growth rate.

A New Approach to Generating Finite-State Control Programs for Hybrid Systems

1996 ◽  
Vol 29 (1) ◽  
pp. 4884-4889 ◽  
Author(s):  
Wolf Kohn ◽  
Anil Nerode ◽  
John James ◽  
Jeffrey Remmel ◽  
Benjamin Cummings
Keyword(s):  
Hybrid Systems ◽  
State Control ◽  
New Approach ◽  
Control Programs ◽  
Finite State ◽  
Finite State Control
Sign in / Sign up

Export Citation Format

Share Document