First-passage-time moments of Markov processes

1985 ◽  
Vol 22 (4) ◽  
pp. 939-945 ◽  
Author(s):  
David D. Yao
Keyword(s):  
Markov Chains ◽  
Markov Processes ◽  
Continuous Time ◽  
Fundamental Matrix ◽  
Generalized Inverse ◽  
First Passage Time ◽  
Passage Time ◽  
First Passage ◽  
Continuous Time Markov Chains ◽  
Passage Times

We consider the first-passage times of continuous-time Markov chains. Based on the approach of generalized inverse, moments of all orders are derived and expressed in simple, explicit forms in terms of the ‘fundamental matrix'. The formulas are new and are also efficient for computation.

First-passage-time moments of Markov processes

1985 ◽  
Vol 22 (04) ◽  
pp. 939-945
Author(s):  
David D. Yao
Keyword(s):  
Markov Chains ◽  
Markov Processes ◽  
Continuous Time ◽  
Fundamental Matrix ◽  
Generalized Inverse ◽  
First Passage Time ◽  
Passage Time ◽  
First Passage ◽  
Continuous Time Markov Chains ◽  
Passage Times

We consider the first-passage times of continuous-time Markov chains. Based on the approach of generalized inverse, moments of all orders are derived and expressed in simple, explicit forms in terms of the ‘fundamental matrix'. The formulas are new and are also efficient for computation.

On passage and conditional passage times for Markov chains in continuous time

1988 ◽  
Vol 25 (02) ◽  
pp. 279-290 ◽  
Author(s):  
Masaaki Kijima
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Continuous Time ◽  
First Passage Time ◽  
Passage Time ◽  
Death Process ◽  
First Passage ◽  
Reversible Markov Chain ◽  
Irreducible Markov Chain ◽  
Passage Times

Let X(t) be a temporally homogeneous irreducible Markov chain in continuous time defined on . For k < i < j, let H = {k + 1, ···, j − 1} and let kTij ( jTik ) be the upward (downward) conditional first-passage time of X(t) from i to j(k) given no visit to . These conditional passage times are studied through first-passage times of a modified chain HX(t) constructed by making the set of states absorbing. It will be shown that the densities of kTij and jTik for any birth-death process are unimodal and the modes kmij ( jmik ) of the unimodal densities are non-increasing (non-decreasing) with respect to i. Some distribution properties of kTij and jTik for a time-reversible Markov chain are presented. Symmetry among kTij, jTik , and is also discussed, where , and are conditional passage times of the reversed process of X(t).

On passage and conditional passage times for Markov chains in continuous time

1988 ◽  
Vol 25 (2) ◽  
pp. 279-290 ◽  
Author(s):  
Masaaki Kijima
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Continuous Time ◽  
First Passage Time ◽  
Passage Time ◽  
Death Process ◽  
First Passage ◽  
Reversible Markov Chain ◽  
Irreducible Markov Chain ◽  
Passage Times

Let X(t) be a temporally homogeneous irreducible Markov chain in continuous time defined on . For k < i < j, let H = {k + 1, ···, j − 1} and let kTij (jTik) be the upward (downward) conditional first-passage time of X(t) from i to j(k) given no visit to . These conditional passage times are studied through first-passage times of a modified chain HX(t) constructed by making the set of states absorbing. It will be shown that the densities of kTij and jTik for any birth-death process are unimodal and the modes kmij (jmik) of the unimodal densities are non-increasing (non-decreasing) with respect to i. Some distribution properties of kTij and jTik for a time-reversible Markov chain are presented. Symmetry among kTij, jTik, and is also discussed, where , and are conditional passage times of the reversed process of X(t).

Spectral Theory for Skip-Free Markov Chains

1989 ◽  
Vol 3 (1) ◽  
pp. 77-88 ◽  
Author(s):  
Joseph Abate ◽  
Ward Whitt
Keyword(s):  
Markov Chains ◽  
Spectral Theory ◽  
First Passage Time ◽  
Passage Time ◽  
First Passage Times ◽  
Simple Relationship ◽  
First Passage ◽  
Birth And Death Processes ◽  
The Laplace Transform ◽  
Passage Times

The distribution of upward first passage times in skip-free Markov chains can be expressed solely in terms of the eigenvalues in the spectral representation, without performing a separate calculation to determine the eigenvectors. We provide insight into this result and skip-free Markov chains more generally by showing that part of the spectral theory developed for birth-and-death processes extends to skip-free chains. We show that the eigenvalues and eigenvectors of skip-free chains can be characterized in terms of recursively defined polynomials. Moreover, the Laplace transform of the upward first passage time from 0 to n is the reciprocal of the nth polynomial. This simple relationship holds because the Laplace transforms of the first passage times satisfy the same recursion as the polynomials except for a normalization.

Bounds and Approximations for the Transient Behavior of Continuous-Time Markov Chains

1989 ◽  
Vol 3 (2) ◽  
pp. 175-198 ◽  
Author(s):  
Bok Sik Yoon ◽  
J. George Shanthikumar
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
First Passage Time ◽  
Transient Behavior ◽  
Passage Time ◽  
Lower And Upper Bounds ◽  
Simple Method ◽  
Continuous Time Markov Chains ◽  
Recent Addition ◽  
Dependent Probability

Discretization is a simple, yet powerful tool in obtaining time-dependent probability distribution of continuous-time Markov chains. One of the most commonly used approaches is uniformization. A recent addition to such approaches is an external uniformization technique. In this paper, we briefly review these different approaches, propose some new approaches, and discuss their performances based on theoretical bounds and empirical computational results. A simple method to get lower and upper bounds for first passage time distribution is also proposed.

Ageing first-passage times of Markov processes: a matrix approach

1997 ◽  
Vol 34 (1) ◽  
pp. 1-13 ◽  
Author(s):  
Haijun Li ◽  
Moshe Shaked
Keyword(s):  
Markov Process ◽  
Markov Processes ◽  
First Passage Time ◽  
Passage Time ◽  
Critical Value ◽  
First Passage Times ◽  
Matrix Approach ◽  
First Passage ◽  
Passage Times

Using a matrix approach we discuss the first-passage time of a Markov process to exceed a given threshold or for the maximal increment of this process to pass a certain critical value. Conditions under which this first-passage time possesses various ageing properties are studied. Some results previously obtained by Li and Shaked (1995) are extended.

scholarly journals Exponentiality of First Passage Times of Continuous Time Markov Chains

2013 ◽  
Vol 131 (1) ◽  
pp. 197-212 ◽  
Author(s):  
Romain Bourget ◽  
Loïc Chaumont ◽  
Natalia Sapoukhina
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
First Passage Times ◽  
First Passage ◽  
Continuous Time Markov Chains ◽  
Passage Times

Ageing first-passage times of Markov processes: a matrix approach

1997 ◽  
Vol 34 (01) ◽  
pp. 1-13 ◽  
Author(s):  
Haijun Li ◽  
Moshe Shaked
Keyword(s):  
Markov Process ◽  
Markov Processes ◽  
First Passage Time ◽  
Passage Time ◽  
Critical Value ◽  
First Passage Times ◽  
Matrix Approach ◽  
First Passage ◽  
Passage Times

Using a matrix approach we discuss the first-passage time of a Markov process to exceed a given threshold or for the maximal increment of this process to pass a certain critical value. Conditions under which this first-passage time possesses various ageing properties are studied. Some results previously obtained by Li and Shaked (1995) are extended.

First passage time for the state of exact chemical equilibrium

1980 ◽  
Vol 45 (3) ◽  
pp. 777-782 ◽  
Author(s):  
Milan Šolc
Keyword(s):  
Chemical Equilibrium ◽  
First Passage Time ◽  
Passage Time ◽  
The State ◽  
Recurrence Time ◽  
First Passage ◽  
First Order ◽  
The Mean ◽  
Passage Times ◽  
Number Of Particles

The establishment of chemical equilibrium in a system with a reversible first order reaction is characterized in terms of the distribution of first passage times for the state of exact chemical equilibrium. The mean first passage time of this state is a linear function of the logarithm of the total number of particles in the system. The equilibrium fluctuations of composition in the system are characterized by the distribution of the recurrence times for the state of exact chemical equilibrium. The mean recurrence time is inversely proportional to the square root of the total number of particles in the system.

Sign in / Sign up

Export Citation Format

Share Document