Empirical Estimator of Stationary Distribution for Semi-Markov Processes

2005 ◽  
Vol 34 (4) ◽  
pp. 987-995 ◽  
Author(s):  
N. LIMNIOS ◽  
B. OUHBI ◽  
A. SADEK
Keyword(s):  
Stationary Distribution ◽  
Markov Processes ◽  
Empirical Estimator ◽  
Semi Markov Processes

Markov-renewal fluid queues

2004 ◽  
Vol 41 (3) ◽  
pp. 746-757 ◽  
Author(s):  
Guy Latouche ◽  
Tetsuya Takine
Keyword(s):  
Markov Process ◽  
Exponential Distribution ◽  
Stationary Distribution ◽  
Markov Processes ◽  
Input Rate ◽  
Fluid Queue ◽  
Birth And Death Processes ◽  
Fluid Queues ◽  
Semi Markov Process ◽  
Semi Markov Processes

We consider a fluid queue controlled by a semi-Markov process and we apply the Markov-renewal approach developed earlier in the context of quasi-birth-and-death processes and of Markovian fluid queues. We analyze two subfamilies of semi-Markov processes. In the first family, we assume that the intervals during which the input rate is negative have an exponential distribution. In the second family, we take the complementary case and assume that the intervals during which the input rate is positive have an exponential distribution. We thoroughly characterize the structure of the stationary distribution in both cases.

Markov-renewal fluid queues

2004 ◽  
Vol 41 (03) ◽  
pp. 746-757
Author(s):  
Guy Latouche ◽  
Tetsuya Takine
Keyword(s):  
Markov Process ◽  
Exponential Distribution ◽  
Stationary Distribution ◽  
Markov Processes ◽  
Input Rate ◽  
Fluid Queue ◽  
Birth And Death Processes ◽  
Fluid Queues ◽  
Semi Markov Process ◽  
Semi Markov Processes

We consider a fluid queue controlled by a semi-Markov process and we apply the Markov-renewal approach developed earlier in the context of quasi-birth-and-death processes and of Markovian fluid queues. We analyze two subfamilies of semi-Markov processes. In the first family, we assume that the intervals during which the input rate is negative have an exponential distribution. In the second family, we take the complementary case and assume that the intervals during which the input rate is positive have an exponential distribution. We thoroughly characterize the structure of the stationary distribution in both cases.

A Quasi-Reversibility Approach to the Insensitivity of Generalized Semi-Markov Processes

1989 ◽  
Vol 3 (3) ◽  
pp. 405-415 ◽  
Author(s):  
Panagiotis Konstantopoulos ◽  
Jean Walrand
Keyword(s):  
Markov Process ◽  
Stationary Distribution ◽  
Markov Processes ◽  
Simple Proof ◽  
Queueing Network ◽  
Simple Criterion ◽  
Algebraic Criterion ◽  
Semi Markov Process ◽  
Semi Markov Processes ◽  
Necessary And Sufficient

This paper is concerned with a certain property of the stationary distribution of a generalized semi-Markov process (GSMP) known as insensitivity. It is well-known that the so-called Matthes' conditions form a necessary and sufficient algebraic criterion for insensitivity. Most proofs of these conditions are basically algebraic. By interpreting a GSMP as a simple queueing network, we are able to show that Matthes' conditions are equivalent to the quasi-reversibility of the network, thus obtaining another simple proof of the sufficiency of these conditions. Furthermore, we apply our method to find a simple criterion for the insensitivity of GSMP's with generalized routing (in a sense that is introduced in the paper).

scholarly journals Quantum Semi-Markov Processes

2008 ◽  
Vol 101 (14) ◽  
Author(s):  
Heinz-Peter Breuer ◽  
Bassano Vacchini
Keyword(s):  
Markov Processes ◽  
Semi Markov Processes

scholarly journals A continuous-time semi-markov bayesian belief network model for availability measure estimation of fault tolerant systems

2008 ◽  
Vol 28 (2) ◽  
pp. 355-375 ◽  
Author(s):  
Márcio das Chagas Moura ◽  
Enrique López Droguett
Keyword(s):  
Hybrid Model ◽  
Markov Processes ◽  
Continuous Time ◽  
Fault Tolerant ◽  
Numerical Procedure ◽  
Bayesian Belief Networks ◽  
Operational Conditions ◽  
Fault Tolerant Systems ◽  
Semi Markov Processes ◽  
Availability Measure

In this work it is proposed a model for the assessment of availability measure of fault tolerant systems based on the integration of continuous time semi-Markov processes and Bayesian belief networks. This integration results in a hybrid stochastic model that is able to represent the dynamic characteristics of a system as well as to deal with cause-effect relationships among external factors such as environmental and operational conditions. The hybrid model also allows for uncertainty propagation on the system availability. It is also proposed a numerical procedure for the solution of the state probability equations of semi-Markov processes described in terms of transition rates. The numerical procedure is based on the application of Laplace transforms that are inverted by the Gauss quadrature method known as Gauss Legendre. The hybrid model and numerical procedure are illustrated by means of an example of application in the context of fault tolerant systems.

Sign in / Sign up

Export Citation Format

Share Document