Homogeneous Markov chains by bounded transition matrix

1994 ◽  
Vol 31 (2) ◽  
pp. 362-372
Author(s):  
D. J. Hartfiel
Keyword(s):  
Markov Chains ◽  
Efficient Algorithm ◽  
Transition Matrix ◽  
Stochastic Matrix ◽  
Convex Polytope ◽  
Stochastic Matrices ◽  
Work Done

Let A be a stochastic matrix and ε a positive number. We consider all stochastic matrices within ε of A and their corresponding stochastic eigenvectors. A convex polytope containing these vectors is described. An efficient algorithm for computing bounds on the components of these vectors is also given. The work is compared to previous such work done by the author and by Courtois and Semai.

Homogeneous Markov chains by bounded transition matrix

1994 ◽  
Vol 31 (02) ◽  
pp. 362-372
Author(s):  
D. J. Hartfiel
Keyword(s):  
Markov Chains ◽  
Efficient Algorithm ◽  
Transition Matrix ◽  
Stochastic Matrix ◽  
Convex Polytope ◽  
Stochastic Matrices ◽  
Work Done

Let A be a stochastic matrix and ε a positive number. We consider all stochastic matrices within ε of A and their corresponding stochastic eigenvectors. A convex polytope containing these vectors is described. An efficient algorithm for computing bounds on the components of these vectors is also given. The work is compared to previous such work done by the author and by Courtois and Semai.

The embedding problem for Markov chains with three states

1980 ◽  
Vol 87 (2) ◽  
pp. 285-294 ◽  
Author(s):  
Halina Frydman
Keyword(s):  
Markov Chains ◽  
Stochastic Matrix ◽  
Sufficient Conditions ◽  
Parameter Family ◽  
Necessary And Sufficient Conditions ◽  
Embedding Problem ◽  
Stochastic Matrices ◽  
Image Position ◽  
Necessary And Sufficient ◽  
Two Parameter

In this paper we consider the embedding problem for Markov chains with three states. A non-singular stochastic matrix P is called embeddable if there exists a two-parameter family of stochastic matricessatisfyingand such thatThough extensive characterizations of embeddable n × n stochastic matrices have been given in (l), (2), (3), (6), and further characterizations of embeddable 3 × 3 stochastic matrices in (4), they do not provide, except in the case of 2 × 2 stochastic matrices, easily applicable necessary and sufficient conditions for embeddability.

scholarly journals Diagonal Sums of Doubly Substochastic Matrices

2019 ◽  
Vol 35 ◽  
pp. 42-52
Author(s):  
Lei Cao ◽  
Zhi Chen ◽  
Xuefeng Duan ◽  
Selcuk Koyuncu ◽  
Huilan Li
Keyword(s):  
Symmetric Group ◽  
Stochastic Matrix ◽  
Convex Polytope ◽  
Stochastic Matrices ◽  
Doubly Stochastic Matrix ◽  
Doubly Stochastic ◽  
Doubly Stochastic Matrices

Let $\Omega_n$ denote the convex polytope of all $n\times n$ doubly stochastic matrices, and $\omega_{n}$ denote the convex polytope of all $n\times n$ doubly substochastic matrices. For a matrix $A\in\omega_n$, define the sub-defect of $A$ to be the smallest integer $k$ such that there exists an $(n+k)\times(n+k)$ doubly stochastic matrix containing $A$ as a submatrix. Let $\omega_{n,k}$ denote the subset of $\omega_n$ which contains all doubly substochastic matrices with sub-defect $k$. For $\pi$ a permutation of symmetric group of degree $n$, the sequence of elements $a_{1\pi(1)},a_{2\pi(2)}, \ldots, a_{n\pi(n)}$ is called the diagonal of $A$ corresponding to $\pi$. Let $h(A)$ and $l(A)$ denote the maximum and minimum diagonal sums of $A\in \omega_{n,k}$, respectively. In this paper, existing results of $h$ and $l$ functions are extended from $\Omega_n$ to $\omega_{n,k}.$ In addition, an analogue of Sylvesters law of the $h$ function on $\omega_{n,k}$ is proved.

scholarly journals A short note on extreme points of certain polytopes

2020 ◽  
Vol 8 (1) ◽  
pp. 36-39
Author(s):  
Lei Cao ◽  
Ariana Hall ◽  
Selcuk Koyuncu
Keyword(s):  
Short Proof ◽  
Convex Polytopes ◽  
Short Note ◽  
Convex Polytope ◽  
Extreme Points ◽  
Alternative Proof ◽  
Stochastic Matrices ◽  
Doubly Stochastic ◽  
Birkhoff's Theorem ◽  
Birkhoff’S Theorem

AbstractWe give a short proof of Mirsky’s result regarding the extreme points of the convex polytope of doubly substochastic matrices via Birkhoff’s Theorem and the doubly stochastic completion of doubly sub-stochastic matrices. In addition, we give an alternative proof of the extreme points of the convex polytopes of symmetric doubly substochastic matrices via its corresponding loopy graphs.

Characterization of the conditional stationary distribution in Markov chains via systems of linear inequalities

2020 ◽  
Vol 52 (4) ◽  
pp. 1249-1283
Author(s):  
Masatoshi Kimura ◽  
Tetsuya Takine
Keyword(s):  
Markov Chains ◽  
Stationary Distribution ◽  
Continuous Time ◽  
State Transition ◽  
Convex Polytope ◽  
Linear Inequalities ◽  
Systems Of Linear Inequalities ◽  
Free Sets ◽  
Practical Implications

AbstractThis paper considers ergodic, continuous-time Markov chains $\{X(t)\}_{t \in (\!-\infty,\infty)}$ on $\mathbb{Z}^+=\{0,1,\ldots\}$ . For an arbitrarily fixed $N \in \mathbb{Z}^+$ , we study the conditional stationary distribution $\boldsymbol{\pi}(N)$ given the Markov chain being in $\{0,1,\ldots,N\}$ . We first characterize $\boldsymbol{\pi}(N)$ via systems of linear inequalities and identify simplices that contain $\boldsymbol{\pi}(N)$ , by examining the $(N+1) \times (N+1)$ northwest corner block of the infinitesimal generator $\textbf{\textit{Q}}$ and the subset of the first $N+1$ states whose members are directly reachable from at least one state in $\{N+1,N+2,\ldots\}$ . These results are closely related to the augmented truncation approximation (ATA), and we provide some practical implications for the ATA. Next we consider an extension of the above results, using the $(K+1) \times (K+1)$ ( $K > N$ ) northwest corner block of $\textbf{\textit{Q}}$ and the subset of the first $K+1$ states whose members are directly reachable from at least one state in $\{K+1,K+2,\ldots\}$ . Furthermore, we introduce new state transition structures called (K, N)-skip-free sets, using which we obtain the minimum convex polytope that contains $\boldsymbol{\pi}(N)$ .

An extension of a convergence theorem for Markov chains arising in population genetics

2016 ◽  
Vol 53 (3) ◽  
pp. 953-956 ◽  
Author(s):  
Martin Möhle ◽  
Morihiro Notohara
Keyword(s):  
Population Genetics ◽  
Markov Chains ◽  
Convergence Theorem ◽  
Transition Matrix ◽  
Initial Distribution ◽  
Generator Matrix ◽  
Finite Dimensional ◽  
Finite State ◽  
Initial Distributions ◽  
Finite State Space

AbstractAn extension of a convergence theorem for sequences of Markov chains is derived. For every positive integer N let (XN(r))r be a Markov chain with the same finite state space S and transition matrix ΠN=I+dNBN, where I is the unit matrix, Q a generator matrix, (BN)N a sequence of matrices, limN℩∞cN= limN→∞dN=0 and limN→∞cN∕dN=0. Suppose that the limits P≔limm→∞(I+dNQ)m and G≔limN→∞PBNP exist. If the sequence of initial distributions PXN(0) converges weakly to some probability measure μ, then the finite-dimensional distributions of (XN([t∕cN))t≥0 converge to those of the Markov process (Xt)t≥0 with initial distribution μ, transition matrix PetG and limN→∞(I+dNQ+cNBN)[t∕cN]

Truncation approximations of invariant measures for Markov chains

1998 ◽  
Vol 35 (03) ◽  
pp. 517-536 ◽  
Author(s):  
R. L. Tweedie
Keyword(s):  
Markov Chain ◽  
Probability Distribution ◽  
Markov Chains ◽  
Transition Matrix ◽  
Invariant Measures ◽  
Invariant Distribution ◽  
Special Cases ◽  
Recurrent Markov Chain ◽  
Positive Recurrent

Let P be the transition matrix of a positive recurrent Markov chain on the integers, with invariant distribution π. If (n) P denotes the n x n ‘northwest truncation’ of P, it is known that approximations to π(j)/π(0) can be constructed from (n) P, but these are known to converge to the probability distribution itself in special cases only. We show that such convergence always occurs for three further general classes of chains, geometrically ergodic chains, stochastically monotone chains, and those dominated by stochastically monotone chains. We show that all ‘finite’ perturbations of stochastically monotone chains can be considered to be dominated by such chains, and thus the results hold for a much wider class than is first apparent. In the cases of uniformly ergodic chains, and chains dominated by irreducible stochastically monotone chains, we find practical bounds on the accuracy of the approximations.

Permanents of Random Doubly Stochastic Matrices

1974 ◽  
Vol 26 (3) ◽  
pp. 600-607 ◽  
Author(s):  
R. C. Griffiths
Keyword(s):  
Symmetric Group ◽  
Stochastic Matrix ◽  
Stochastic Matrices ◽  
Doubly Stochastic Matrix ◽  
Doubly Stochastic ◽  
Survey Article ◽  
Doubly Stochastic Matrices ◽  
Image Position

The permanent of an n × n matrix A = (aij) is defined aswhere Sn is the symmetric group of order n. For a survey article on permanents the reader is referred to [2]. An unresolved conjecture due to van der Waerden states that if A is an n × n doubly stochastic matrix; then per (A) ≧ n!/nn, with equality if and only if A = Jn = (1/n).

scholarly journals A note on repeated sequences in Markov chains

1987 ◽  
Vol 19 (03) ◽  
pp. 739-742 ◽  
Author(s):  
J. D. Biggins
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Renewal Process ◽  
Transition Matrix ◽  
Repeated Sequences ◽  
Markov Renewal Process ◽  
Conditional Mean ◽  
Sojourn Times

If (non-overlapping) repeats of specified sequences of states in a Markov chain are considered, the result is a Markov renewal process. Formulae somewhat simpler than those given in Biggins and Cannings (1987) are derived which can be used to obtain the transition matrix and conditional mean sojourn times in this process.

Characterization of convergence rates for the approximation of the stationary distribution of infinite monotone stochastic matrices

1996 ◽  
Vol 33 (04) ◽  
pp. 974-985 ◽  
Author(s):  
F. Simonot ◽  
Y. Q. Song
Keyword(s):  
Convergence Rate ◽  
Generating Function ◽  
Convergence Rates ◽  
Transition Probability ◽  
Stochastic Matrix ◽  
Input Sequence ◽  
Transition Probability Matrix ◽  
Stochastic Matrices ◽  
Preceding Result

Let P be an infinite irreducible stochastic matrix, recurrent positive and stochastically monotone and Pn be any n × n stochastic matrix with Pn ≧ Tn , where Tn denotes the n × n northwest corner truncation of P. These assumptions imply the existence of limit distributions π and π n for P and Pn respectively. We show that if the Markov chain with transition probability matrix P meets the further condition of geometric recurrence then the exact convergence rate of π n to π can be expressed in terms of the radius of convergence of the generating function of π. As an application of the preceding result, we deal with the random walk on a half line and prove that the assumption of geometric recurrence can be relaxed. We also show that if the i.i.d. input sequence (A(m)) is such that we can find a real number r 0 > 1 with , then the exact convergence rate of π n to π is characterized by r 0. Moreover, when the generating function of A is not defined for |z| > 1, we derive an upper bound for the distance between π n and π based on the moments of A.

Sign in / Sign up

Export Citation Format

Share Document