On the weak convergence of sequences of circuit processes: a probabilistic approach

1992 ◽  
Vol 29 (2) ◽  
pp. 374-383 ◽  
Author(s):  
Sophia Kalpazidou
Keyword(s):  
Markov Chain ◽  
Weak Convergence ◽  
Asymptotic Behaviour ◽  
Markov Processes ◽  
Probabilistic Approach ◽  
Probabilistic Interpretation ◽  
Sample Paths ◽  
Convergence Of Sequences ◽  
Recurrent Markov Chain ◽  
Positive Recurrent

The asymptotic behaviour of sequences of Markov processes whose finite distributions depend upon the sample paths ω of a positive recurrent Markov chain ξ is studied. The existence of such sequences depends upon the existence of a unique class of directed weighted circuits having a probabilistic interpretation in terms of the directed circuits occurring along the sample paths of ξ. An application to multiple Markov chains is given.

On the weak convergence of sequences of circuit processes: a probabilistic approach

1992 ◽  
Vol 29 (02) ◽  
pp. 374-383 ◽  
Author(s):  
Sophia Kalpazidou
Keyword(s):  
Markov Chain ◽  
Weak Convergence ◽  
Asymptotic Behaviour ◽  
Markov Processes ◽  
Probabilistic Approach ◽  
Probabilistic Interpretation ◽  
Sample Paths ◽  
Convergence Of Sequences ◽  
Recurrent Markov Chain ◽  
Positive Recurrent

The asymptotic behaviour of sequences of Markov processes whose finite distributions depend upon the sample paths ω of a positive recurrent Markov chain ξ is studied. The existence of such sequences depends upon the existence of a unique class of directed weighted circuits having a probabilistic interpretation in terms of the directed circuits occurring along the sample paths of ξ. An application to multiple Markov chains is given.

Asymptotic behaviour of sample weighted circuits representing recurrent Markov chains

1990 ◽  
Vol 27 (03) ◽  
pp. 545-556 ◽  
Author(s):  
S. Kalpazidou
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Asymptotic Behaviour ◽  
Probabilistic Interpretation ◽  
Stationary Markov Chain

The asymptotic behaviour of the sequence (𝒞 n (ω), wc,n (ω)/n), is studied where 𝒞 n (ω) is the class of all cycles c occurring along the trajectory ωof a recurrent strictly stationary Markov chain (ξ n ) until time n and wc,n (ω) is the number of occurrences of the cycle c until time n. The previous sequence of sample weighted classes converges almost surely to a class of directed weighted cycles (𝒞∞, ω c ) which represents uniquely the chain (ξ n ) as a circuit chain, and ω c is given a probabilistic interpretation.

Truncation approximations of invariant measures for Markov chains

1998 ◽  
Vol 35 (03) ◽  
pp. 517-536 ◽  
Author(s):  
R. L. Tweedie
Keyword(s):  
Markov Chain ◽  
Probability Distribution ◽  
Markov Chains ◽  
Transition Matrix ◽  
Invariant Measures ◽  
Invariant Distribution ◽  
Special Cases ◽  
Recurrent Markov Chain ◽  
Positive Recurrent

Let P be the transition matrix of a positive recurrent Markov chain on the integers, with invariant distribution π. If (n) P denotes the n x n ‘northwest truncation’ of P, it is known that approximations to π(j)/π(0) can be constructed from (n) P, but these are known to converge to the probability distribution itself in special cases only. We show that such convergence always occurs for three further general classes of chains, geometrically ergodic chains, stochastically monotone chains, and those dominated by stochastically monotone chains. We show that all ‘finite’ perturbations of stochastically monotone chains can be considered to be dominated by such chains, and thus the results hold for a much wider class than is first apparent. In the cases of uniformly ergodic chains, and chains dominated by irreducible stochastically monotone chains, we find practical bounds on the accuracy of the approximations.

Extreme values, range and weak convergence of integrals of Markov chains

1982 ◽  
Vol 19 (02) ◽  
pp. 272-288 ◽  
Author(s):  
P. J. Brockwell ◽  
S. I. Resnick ◽  
N. Pacheco-Santiago
Keyword(s):  
Markov Chain ◽  
Weak Convergence ◽  
Markov Chains ◽  
Asymptotic Behaviour ◽  
State Space ◽  
Extreme Values ◽  
Finite State ◽  
Integral Process ◽  
Maximum Minimum ◽  
Finite State Space

A study is made of the maximum, minimum and range on [0,t] of the integral processwhereSis a finite state-space Markov chain. Approximate results are derived by establishing weak convergence of a sequence of such processes to a Wiener process. For a particular family of two-state stationary Markov chains we show that the corresponding centered integral processes exhibit the Hurst phenomenon to a remarkable degree in their pre-asymptotic behaviour.

Asymptotic behaviour of population-size-dependent branching processes in Markovian random environments

1999 ◽  
Vol 36 (2) ◽  
pp. 611-619 ◽  
Author(s):  
Han-Xing Wang ◽  
Dafan Fang
Keyword(s):  
Asymptotic Behaviour ◽  
Population Size ◽  
Branching Process ◽  
Branching Processes ◽  
Random Environments ◽  
Real Numbers ◽  
Size Dependent ◽  
Recurrent Markov Chain ◽  
The Mean ◽  
Positive Recurrent

A population-size-dependent branching process {Zn} is considered where the population's evolution is controlled by a Markovian environment process {ξn}. For this model, let mk,θ and be the mean and the variance respectively of the offspring distribution when the population size is k and a environment θ is given. Let B = {ω : Zn(ω) = 0 for some n} and q = P(B). The asymptotic behaviour of limnZn and is studied in the case where supθ|mk,θ − mθ| → 0 for some real numbers {mθ} such that infθmθ > 1. When the environmental sequence {ξn} is a irreducible positive recurrent Markov chain (particularly, when its state space is finite), certain extinction (q = 1) and non-certain extinction (q < 1) are studied.

Some limit theorems for positive recurrent branching Markov chains: II

1998 ◽  
Vol 30 (03) ◽  
pp. 711-722 ◽  
Author(s):  
Krishna B. Athreya ◽  
Hye-Jeong Kang
Keyword(s):  
Markov Chain ◽  
Limit Theorems ◽  
Law Of Large Numbers ◽  
General State ◽  
Position Distribution ◽  
Large Numbers ◽  
Recurrent Markov Chain ◽  
General State Space ◽  
Watson Process ◽  
Positive Recurrent

In this paper we consider a Galton-Watson process in which particles move according to a positive recurrent Markov chain on a general state space. We prove a law of large numbers for the empirical position distribution and also discuss the rate of this convergence.

Asymptotic behaviour of population-size-dependent branching processes in Markovian random environments

1999 ◽  
Vol 36 (02) ◽  
pp. 611-619 ◽  
Author(s):  
Han-Xing Wang ◽  
Dafan Fang
Keyword(s):  
Asymptotic Behaviour ◽  
Population Size ◽  
Branching Process ◽  
Branching Processes ◽  
Random Environments ◽  
Real Numbers ◽  
Size Dependent ◽  
Recurrent Markov Chain ◽  
The Mean ◽  
Positive Recurrent

A population-size-dependent branching process {Z n } is considered where the population's evolution is controlled by a Markovian environment process {ξ n }. For this model, let m k,θ and be the mean and the variance respectively of the offspring distribution when the population size is k and a environment θ is given. Let B = {ω : Z n (ω) = 0 for some n} and q = P(B). The asymptotic behaviour of lim n Z n and is studied in the case where supθ|m k,θ − m θ| → 0 for some real numbers {m θ} such that infθ m θ &gt; 1. When the environmental sequence {ξ n } is a irreducible positive recurrent Markov chain (particularly, when its state space is finite), certain extinction (q = 1) and non-certain extinction (q &lt; 1) are studied.

Asymptotic behaviour of sample weighted circuits representing recurrent Markov chains

1990 ◽  
Vol 27 (3) ◽  
pp. 545-556 ◽  
Author(s):  
S. Kalpazidou
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Asymptotic Behaviour ◽  
Probabilistic Interpretation ◽  
Stationary Markov Chain

The asymptotic behaviour of the sequence (𝒞n(ω), wc,n(ω)/n), is studied where 𝒞n(ω) is the class of all cycles c occurring along the trajectory ωof a recurrent strictly stationary Markov chain (ξ n) until time n and wc,n(ω) is the number of occurrences of the cycle c until time n. The previous sequence of sample weighted classes converges almost surely to a class of directed weighted cycles (𝒞∞, ωc) which represents uniquely the chain (ξ n) as a circuit chain, and ω c is given a probabilistic interpretation.

Some limit theorems for positive recurrent branching Markov chains: II

1998 ◽  
Vol 30 (3) ◽  
pp. 711-722 ◽  
Author(s):  
Krishna B. Athreya ◽  
Hye-Jeong Kang
Keyword(s):  
Markov Chain ◽  
Limit Theorems ◽  
Law Of Large Numbers ◽  
General State ◽  
Position Distribution ◽  
Large Numbers ◽  
Recurrent Markov Chain ◽  
General State Space ◽  
Watson Process ◽  
Positive Recurrent

In this paper we consider a Galton-Watson process in which particles move according to a positive recurrent Markov chain on a general state space. We prove a law of large numbers for the empirical position distribution and also discuss the rate of this convergence.

Sign in / Sign up

Export Citation Format

Share Document