An interesting random walk on the non-negative integers

1994 ◽  
Vol 31 (1) ◽  
pp. 48-58 ◽  
Author(s):  
Marcel F. Neuts
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Numerical Computation ◽  
Continuous Version ◽  
Positive Recurrence ◽  
Mathematical Arguments ◽  
Stationary Probabilities ◽  
Algorithmic Procedure

A particular random walk on the integers leads to a new, tractable Markov chain. Of the stationary probabilities, we discuss the existence, some analytic properties and a factorization which leads to an algorithmic procedure for their numerical computation. We also consider the positive recurrence of some variants which each call for different mathematical arguments. Analogous results are derived for a continuous version on the positive reals.

An interesting random walk on the non-negative integers

1994 ◽  
Vol 31 (01) ◽  
pp. 48-58 ◽  
Author(s):  
Marcel F. Neuts
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Numerical Computation ◽  
Continuous Version ◽  
Positive Recurrence ◽  
Mathematical Arguments ◽  
Stationary Probabilities ◽  
Algorithmic Procedure

A particular random walk on the integers leads to a new, tractable Markov chain. Of the stationary probabilities, we discuss the existence, some analytic properties and a factorization which leads to an algorithmic procedure for their numerical computation. We also consider the positive recurrence of some variants which each call for different mathematical arguments. Analogous results are derived for a continuous version on the positive reals.

On the absorption probabilities and mean time for absorption for discrete Markov chains

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Nikolaos Halidias
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Markov Chains ◽  
Generating Function ◽  
Discrete Time ◽  
Probability Generating Function ◽  
The Mean ◽  
Mean Time ◽  
Absorption Probabilities

Abstract In this note we study the probability and the mean time for absorption for discrete time Markov chains. In particular, we are interested in estimating the mean time for absorption when absorption is not certain and connect it with some other known results. Computing a suitable probability generating function, we are able to estimate the mean time for absorption when absorption is not certain giving some applications concerning the random walk. Furthermore, we investigate the probability for a Markov chain to reach a set A before reach B generalizing this result for a sequence of sets A 1 , A 2 , … , A k {A_{1},A_{2},\dots,A_{k}} .

On the age distribution of a Markov chain

1978 ◽  
Vol 15 (1) ◽  
pp. 65-77 ◽  
Author(s):  
Anthony G. Pakes
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Limit Theorems ◽  
Age Distribution ◽  
Weak Limit ◽  
Absorbing State ◽  
Absorbing Markov Chain ◽  
Continuous Random Walk ◽  
A Chain ◽  
Watson Process

This paper develops the notion of the limiting age of an absorbing Markov chain, conditional on the present state. Chains with a single absorbing state {0} are considered and with such a chain can be associated a return chain, obtained by restarting the original chain at a fixed state after each absorption. The limiting age, A(j), is the weak limit of the time given Xn = j (n → ∞).A criterion for the existence of this limit is given and this is shown to be fulfilled in the case of the return chains constructed from the Galton–Watson process and the left-continuous random walk. Limit theorems for A (J) (J → ∞) are given for these examples.

scholarly journals Limit theorems for some continuous-time random walks

2011 ◽  
Vol 43 (3) ◽  
pp. 782-813 ◽  
Author(s):  
M. Jara ◽  
T. Komorowski
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Random Walks ◽  
Quantum Transport ◽  
Continuous Time ◽  
Limit Theorems ◽  
Transport Theory ◽  
Sufficient Conditions ◽  
Continuous Time Random Walks ◽  
Quantum Transport Theory

In this paper we consider the scaled limit of a continuous-time random walk (CTRW) based on a Markov chain {Xn,n≥ 0} and two observables, τ(∙) andV(∙), corresponding to the renewal times and jump sizes. Assuming that these observables belong to the domains of attraction of some stable laws, we give sufficient conditions on the chain that guarantee the existence of the scaled limits for CTRWs. An application of the results to a process that arises in quantum transport theory is provided. The results obtained in this paper generalize earlier results contained in Becker-Kern, Meerschaert and Scheffler (2004) and Meerschaert and Scheffler (2008), and the recent results of Henry and Straka (2011) and Jurlewicz, Kern, Meerschaert and Scheffler (2010), where {Xn,n≥ 0} is a sequence of independent and identically distributed random variables.

scholarly journals One dimensional quantum walks with memory

2010 ◽  
Vol 10 (5&6) ◽  
pp. 509-524
Author(s):  
M. Mc Gettrick
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Random Walks ◽  
Quantum Walks ◽  
One Dimensional ◽  
With Memory ◽  
Previous Step

We investigate the quantum versions of a one-dimensional random walk, whose corresponding Markov Chain is of order 2. This corresponds to the walk having a memory of one previous step. We derive the amplitudes and probabilities for these walks, and point out how they differ from both classical random walks, and quantum walks without memory.

On the age distribution of a Markov chain

1978 ◽  
Vol 15 (01) ◽  
pp. 65-77 ◽  
Author(s):  
Anthony G. Pakes
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Limit Theorems ◽  
Age Distribution ◽  
Weak Limit ◽  
Absorbing State ◽  
Absorbing Markov Chain ◽  
Continuous Random Walk ◽  
A Chain ◽  
Watson Process

This paper develops the notion of the limiting age of an absorbing Markov chain, conditional on the present state. Chains with a single absorbing state {0} are considered and with such a chain can be associated a return chain,obtained by restarting the original chain at a fixed state after each absorption. The limiting age,A(j), is the weak limit of the timegivenXn=j(n → ∞).A criterion for the existence of this limit is given and this is shown to be fulfilled in the case of the return chains constructed from the Galton–Watson process and the left-continuous random walk. Limit theorems forA(J) (J →∞) are given for these examples.

Perturbation bounds for the stationary probabilities of a finite Markov chain

1984 ◽  
Vol 16 (04) ◽  
pp. 804-818 ◽  
Author(s):  
Moshe Haviv ◽  
Ludo Van Der Heyden
Keyword(s):  
Markov Chain ◽  
Stationary Distribution ◽  
Finite Markov Chain ◽  
Perturbation Bounds ◽  
Aggregation Technique ◽  
Stationary Probabilities

This paper discusses perturbation bounds for the stationary distribution of a finite indecomposable Markov chain. Existing bounds are reviewed. New bounds are presented which more completely exploit the stochastic features of the perturbation and which also are easily computable. Examples illustrate the tightness of the bounds and their application to bounding the error in the Simon–Ando aggregation technique for approximating the stationary distribution of a nearly completely decomposable Markov chain.

Determining Equivalent Resistance and Nodal Potentials of a Resistive Circuit Using a Reduced Transition Matrix

2020 ◽  
Vol 02 (01) ◽  
pp. 2050004
Author(s):  
Je-Young Choi
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Random Walks ◽  
Transition Matrix ◽  
Present Approach ◽  
Voltage Source ◽  
Equivalent Resistance ◽  
Electrical Circuits ◽  
Electric Potentials ◽  
Dominant Eigenvector

Several methods have been developed in order to solve electrical circuits consisting of resistors and an ideal voltage source. A correspondence with random walks avoids difficulties caused by choosing directions of currents and signs in potential differences. Starting from the random-walk method, we introduce a reduced transition matrix of the associated Markov chain whose dominant eigenvector alone determines the electric potentials at all nodes of the circuit and the equivalent resistance between the nodes connected to the terminals of the voltage source. Various means to find the eigenvector are developed from its definition. A few example circuits are solved in order to show the usefulness of the present approach.

Sign in / Sign up

Export Citation Format

Share Document