markov renewal theory
Recently Published Documents


TOTAL DOCUMENTS

32
(FIVE YEARS 0)

H-INDEX

10
(FIVE YEARS 0)

2018 ◽  
Vol 50 (4) ◽  
pp. 1193-1216
Author(s):  
Sabrina Kombrink

Abstract In this paper we develop renewal theorems for point processes with interarrival times ξ(Xn+1Xn…), where (Xn)n∈ℤ is a stochastic process with finite state space Σ and ξ:ΣA→ℝ is a Hölder continuous function on a subset ΣA⊂Σℕ. The theorems developed here unify and generalise the key renewal theorem for discrete measures and Lalley's renewal theorem for counting measures in symbolic dynamics. Moreover, they capture aspects of Markov renewal theory. The new renewal theorems allow for direct applications to problems in fractal and hyperbolic geometry, for instance to the problem of Minkowski measurability of self-conformal sets.


2014 ◽  
Vol 51 (A) ◽  
pp. 359-376 ◽  
Author(s):  
Gerold Alsmeyer

Let 𝓈 be a finite or countable set. Given a matrix F = (Fij)i,j∈𝓈 of distribution functions on R and a quasistochastic matrix Q = (qij)i,j∈𝓈, i.e. an irreducible nonnegative matrix with maximal eigenvalue 1 and associated unique (modulo scaling) positive left and right eigenvectors u and v, the matrix renewal measure ∑n≥0Qn ⊗ F*n associated with Q ⊗ F := (qijFij)i,j∈𝓈 (see below for precise definitions) and a related Markov renewal equation are studied. This was done earlier by de Saporta (2003) and Sgibnev (2006, 2010) by drawing on potential theory, matrix-analytic methods, and Wiener-Hopf techniques. In this paper we describe a probabilistic approach which is quite different and starts from the observation that Q ⊗ F becomes an ordinary semi-Markov matrix after a harmonic transform. This allows us to relate Q ⊗ F to a Markov random walk {(Mn, Sn)}n≥0 with discrete recurrent driving chain {Mn}n≥0. It is then shown that renewal theorems including a Choquet-Deny-type lemma may be easily established by resorting to standard renewal theory for ordinary random walks. The paper concludes with two typical examples.


2014 ◽  
Vol 51 (A) ◽  
pp. 359-376
Author(s):  
Gerold Alsmeyer

Let 𝓈 be a finite or countable set. Given a matrix F = (F ij ) i,j∈𝓈 of distribution functions on R and a quasistochastic matrix Q = (q ij ) i,j∈𝓈 , i.e. an irreducible nonnegative matrix with maximal eigenvalue 1 and associated unique (modulo scaling) positive left and right eigenvectors u and v, the matrix renewal measure ∑ n≥0 Q n ⊗ F *n associated with Q ⊗ F := (q ij F ij ) i,j∈𝓈 (see below for precise definitions) and a related Markov renewal equation are studied. This was done earlier by de Saporta (2003) and Sgibnev (2006, 2010) by drawing on potential theory, matrix-analytic methods, and Wiener-Hopf techniques. In this paper we describe a probabilistic approach which is quite different and starts from the observation that Q ⊗ F becomes an ordinary semi-Markov matrix after a harmonic transform. This allows us to relate Q ⊗ F to a Markov random walk {(M n , S n )} n≥0 with discrete recurrent driving chain {M n } n≥0. It is then shown that renewal theorems including a Choquet-Deny-type lemma may be easily established by resorting to standard renewal theory for ordinary random walks. The paper concludes with two typical examples.


2012 ◽  
Vol 26 (2) ◽  
pp. 221-244 ◽  
Author(s):  
M. L. Chaudhry ◽  
S. K. Samanta ◽  
A. Pacheco

In this paper, we present (in terms of roots) a simple closed-form analysis for evaluating system-length distribution at prearrival epochs of the GI/C-MSP/1 queue. The proposed analysis is based on roots of the associated characteristic equation of the vector-generating function of system-length distribution. We also provide the steady-state system-length distribution at an arbitrary epoch by using the classical argument based on Markov renewal theory. The sojourn-time distribution has also been investigated. The prearrival epoch probabilities have been obtained using the method of roots which is an alternative approach to the matrix-geometric method and the spectral method. Numerical aspects have been tested for a variety of arrival- and service-time distributions and a sample of numerical outputs is presented. The proposed method not only gives an alternative solution to the existing methods, but it is also analytically simple, easy to implement, and computationally efficient. It is hoped that the results obtained will prove beneficial to both theoreticians and practitioners.


2007 ◽  
Vol 21 (4) ◽  
pp. 551-556 ◽  
Author(s):  
Winfried K. Grassmann ◽  
Javad Tavakoli

The embedded Markov chain approach is widely used in queuing theory, in particular in M/G/1 and GI/M/c queues. In these cases, one has to relate the embedded equilibrium probablities to the corresponding random-time probabilities. The classical method to do this is based on Markov renewal theory, a rather complex approach, especially if the population is finite or if there is balking. In this article we present a much simpler method to derive the random-time probabilities from the embedded Markov chain probabilities. The method is based on conditional probability. Our approach might also be applicable in such situations.


Sign in / Sign up

Export Citation Format

Share Document