A Fast Newton-Shamanskii Iteration for a Matrix Equation Arising from M/G/1-Type Markov Chains

For the nonlinear matrix equations arising in the analysis of M/G/1-type and GI/M/1-type Markov chains, the minimal nonnegative solution G or R can be found by Newton-like methods. We prove monotone convergence results for the Newton-Shamanskii iteration for this class of equations. Starting with zero initial guess or some other suitable initial guess, the Newton-Shamanskii iteration provides a monotonically increasing sequence of nonnegative matrices converging to the minimal nonnegative solution. A Schur decomposition method is used to accelerate the Newton-Shamanskii iteration. Numerical examples illustrate the effectiveness of the Newton-Shamanskii iteration.

Newton-Shamanskii Method for a Quadratic Matrix Equation Arising in Quasi-Birth-Death Problems

In order to determine the stationary distribution for discrete time quasi-birth-death Markov chains, it is necessary to find the minimal nonnegative solution of a quadratic matrix equation. The Newton-Shamanskii method is applied to solve this equation, and the sequence of matrices produced is monotonically increasing and converges to its minimal nonnegative solution. Numerical results illustrate the effectiveness of this procedure.

Extinction Probabilities of Supercritical Decomposable Branching Processes

We focus on supercritical decomposable (reducible) multitype branching processes. Types are partitioned into irreducible equivalence classes. In this context, extinction of some classes is possible without the whole process becoming extinct. We derive criteria for the almost-sure extinction of the whole process, as well as of a specific class, conditionally given the class of the initial particle. We give sufficient conditions under which the extinction of a class implies the extinction of another class or of the whole process. Finally, we show that the extinction probability of a specific class is the minimal nonnegative solution of the usual extinction equation but with added constraints.

Extinction Probabilities of Supercritical Decomposable Branching Processes

We focus on supercritical decomposable (reducible) multitype branching processes. Types are partitioned into irreducible equivalence classes. In this context, extinction of some classes is possible without the whole process becoming extinct. We derive criteria for the almost-sure extinction of the whole process, as well as of a specific class, conditionally given the class of the initial particle. We give sufficient conditions under which the extinction of a class implies the extinction of another class or of the whole process. Finally, we show that the extinction probability of a specific class is the minimal nonnegative solution of the usual extinction equation but with added constraints.

Additive Functionals for Discrete-Time Markov Chains with Applications to Birth-Death Processes

In this paper we are interested in bounding or calculating the additive functionals of the first return time on a set for discrete-time Markov chains on a countable state space, which is motivated by investigating ergodic theory and central limit theorems. To do so, we introduce the theory of the minimal nonnegative solution. This theory combined with some other techniques is proved useful for investigating the additive functionals. This method is used to study the functionals for discrete-time birth-death processes, and the polynomial convergence and a central limit theorem are derived.

Additive Functionals for Discrete-Time Markov Chains with Applications to Birth-Death Processes

In this paper we are interested in bounding or calculating the additive functionals of the first return time on a set for discrete-time Markov chains on a countable state space, which is motivated by investigating ergodic theory and central limit theorems. To do so, we introduce the theory of the minimal nonnegative solution. This theory combined with some other techniques is proved useful for investigating the additive functionals. This method is used to study the functionals for discrete-time birth-death processes, and the polynomial convergence and a central limit theorem are derived.

On the convergence and limits of certain matrix sequences arising in quasi-birth-and-death Markov chains

We study the convergence of certain matrix sequences that arise in quasi-birth-and-death (QBD) Markov chains and we identify their limits. In particular, we focus on a sequence of matrices whose elements are absorption probabilities into some boundary states of the QBD. We prove that, under certain technical conditions, that sequence converges. Its limit is either the minimal nonnegative solution G of the standard nonlinear matrix equation, or it is a stochastic solution that can be explicitly expressed in terms of G. Similar results are obtained relative to the standard matrix R that arises in the matrix-geometric solution of the QBD. We present numerical examples that clarify some of the technical issues of interest.

On the convergence and limits of certain matrix sequences arising in quasi-birth-and-death Markov chains

We study the convergence of certain matrix sequences that arise in quasi-birth-and-death (QBD) Markov chains and we identify their limits. In particular, we focus on a sequence of matrices whose elements are absorption probabilities into some boundary states of the QBD. We prove that, under certain technical conditions, that sequence converges. Its limit is either the minimal nonnegative solution G of the standard nonlinear matrix equation, or it is a stochastic solution that can be explicitly expressed in terms of G. Similar results are obtained relative to the standard matrix R that arises in the matrix-geometric solution of the QBD. We present numerical examples that clarify some of the technical issues of interest.