On a class of continuous-time Markov processes

1985 ◽  
Vol 22 (4) ◽  
pp. 804-815 ◽  
Author(s):  
J. Gani ◽  
Pyke Tin
Keyword(s):  
Markov Process ◽  
Markov Processes ◽  
Generating Functions ◽  
Continuous Time ◽  
Time Dependent ◽  
Stationary Case ◽  
Stationary Distributions ◽  
General Process ◽  
Probability Generating Functions ◽  
Queueing Processes

This paper considers a certain class of continuous-time Markov processes, whose time-dependent and stationary distributions are studied. In the stationary case, the analogy with Whittle's relaxed Markov process is pointed out. The derivation of the probability generating functions of the general process provides useful results for the analysis of some population and queueing processes.

On a class of continuous-time Markov processes

1985 ◽  
Vol 22 (04) ◽  
pp. 804-815 ◽  
Author(s):  
J. Gani ◽  
Pyke Tin
Keyword(s):  
Markov Process ◽  
Markov Processes ◽  
Generating Functions ◽  
Continuous Time ◽  
Time Dependent ◽  
Stationary Case ◽  
Stationary Distributions ◽  
General Process ◽  
Probability Generating Functions ◽  
Queueing Processes

This paper considers a certain class of continuous-time Markov processes, whose time-dependent and stationary distributions are studied. In the stationary case, the analogy with Whittle's relaxed Markov process is pointed out. The derivation of the probability generating functions of the general process provides useful results for the analysis of some population and queueing processes.

scholarly journals The relationship between intensity and stochastic matrices for continuous-time discrete value stochastic non-homogeneous processes with Markov property

2017 ◽  
Vol 13 (3) ◽  
pp. 7244-7256
Author(s):  
Mi los lawa Sokol
Keyword(s):  
Markov Process ◽  
Stochastic Processes ◽  
Markov Processes ◽  
Continuous Time ◽  
Markov Property ◽  
Time Dependent ◽  
Stochastic Matrices ◽  
Homogeneous Markov Process ◽  
The Relationship ◽  
Time Form

The matrices of non-homogeneous Markov processes consist of time-dependent functions whose values at time form typical intensity matrices. For solvingsome problems they must be changed into stochastic matrices. A stochas-tic matrix for non-homogeneous Markov process consists of time-dependent functions, whose values are probabilities and it depend on assumed time pe- riod. In this paper formulas for these functions are derived. Although the formula is not simple, it allows proving some theorems for Markov stochastic processes, well known for homogeneous processes, but for non-homogeneous ones the proofs of them turned out shorter.

Proportional intensities and strong ergodicity for Markov processes

1983 ◽  
Vol 20 (01) ◽  
pp. 185-190 ◽  
Author(s):  
Mark Scott ◽  
Dean L. Isaacson
Keyword(s):  
Markov Process ◽  
Markov Processes ◽  
Discrete Time ◽  
Continuous Time ◽  
Homogeneous Markov Process ◽  
Strong Ergodicity ◽  
Transition Functions ◽  
The Matrix ◽  
Intensity Functions ◽  
Time Point

By assuming the proportionality of the intensity functions at each time point for a continuous-time non-homogeneous Markov process, strong ergodicity for the process is determined through strong ergodicity of a related discrete-time Markov process. For processes having proportional intensities, strong ergodicity implies having the limiting matrix L satisfy L · P(s, t) = L, where P(s, t) is the matrix of transition functions.

Homecomings of Markov processes

1973 ◽  
Vol 5 (01) ◽  
pp. 66-102 ◽  
Author(s):  
J. F. C. Kingman
Keyword(s):  
Markov Process ◽  
Markov Processes ◽  
Continuous Time ◽  
Random Time ◽  
Random Set ◽  
Theoretical Interest ◽  
Different Types ◽  
Treat All ◽  
Image Position

Ifx0is a particular state for a continuous-time Markov processX, the random time setis often of both practical and theoretical interest. Ignoring trivial or pathological cases, there are four different types of structure which this random set can display. To some extent, it is possible to treat all four cases in a unified way, but they raise different questions and require different modes of description. The distributions of various random quantities associated withcan be related to one another by simple and useful formulae.

EXPLICIT SOLUTIONS FOR CONTINUOUS-TIME QBD PROCESSES BY USING RELATIONS BETWEEN MATRIX GEOMETRIC ANALYSIS AND THE PROBABILITY GENERATING FUNCTIONS METHOD

2020 ◽  
pp. 1-16 ◽  
Author(s):  
Gabi Hanukov ◽  
Uri Yechiali
Keyword(s):  
Generating Functions ◽  
Continuous Time ◽  
Geometric Analysis ◽  
Quadratic Equation ◽  
Unknown Boundary ◽  
Birth And Death Processes ◽  
Probability Generating Functions ◽  
Qbd Processes ◽  
The Matrix ◽  
The Stability

Two main methods are used to solve continuous-time quasi birth-and-death processes: matrix geometric (MG) and probability generating functions (PGFs). MG requires a numerical solution (via successive substitutions) of a matrix quadratic equation A0 + RA1 + R2A2 = 0. PGFs involve a row vector $\vec{G}(z)$ of unknown generating functions satisfying $H(z)\vec{G}{(z)^\textrm{T}} = \vec{b}{(z)^\textrm{T}},$ where the row vector $\vec{b}(z)$ contains unknown “boundary” probabilities calculated as functions of roots of the matrix H(z). We show that: (a) H(z) and $\vec{b}(z)$ can be explicitly expressed in terms of the triple A0, A1, and A2; (b) when each matrix of the triple is lower (or upper) triangular, then (i) R can be explicitly expressed in terms of roots of $\det [H(z)]$ ; and (ii) the stability condition is readily extracted.

scholarly journals Possibility of Application of the Theory of Semi-Markov Processes to Determine Reliability of Diagnosing Systems / MOŻLIWOŚĆ ZASTOSOWANIA TEORII PROCESÓW SEMI-MARKOWA DO OKREŚLENIA NIEZAWODNOŚCI SYSTEMÓW DIAGNOZUJĄCYCH

2012 ◽  
Vol 24 (1) ◽  
pp. 49-58 ◽  
Author(s):  
Jerzy Girtler
Keyword(s):  
Markov Process ◽  
Markov Processes ◽  
Continuous Time ◽  
Diagnostic Tests ◽  
The State ◽  
Actual State ◽  
Reliability Model ◽  
Discrete State ◽  
Semi Markov Process ◽  
Semi Markov Processes

Abstract The paper provides justification for the necessity to define reliability of diagnosing systems (SDG) in order to develop a diagnosis on state of any technical mechanism being a diagnosed system (SDN). It has been shown that the knowledge of SDG reliability enables defining diagnosis reliability. It has been assumed that the diagnosis reliability can be defined as a diagnosis property which specifies the degree of recognizing by a diagnosing system (SDG) the actual state of the diagnosed system (SDN) which may be any mechanism, and the conditional probability p(S*/K*) of occurrence (existence) of state S* of the mechanism (SDN) as a diagnosis measure provided that at a specified reliability of SDG, the vector K* of values of diagnostic parameters implied by the state, is observed. The probability that SDG is in the state of ability during diagnostic tests and the following diagnostic inferences leading to development of a diagnosis about the SDN state, has been accepted as a measure of SDG reliability. The theory of semi-Markov processes has been used for defining the SDG reliability, that enabled to develop a SDG reliability model in the form of a seven-state (continuous-time discrete-state) semi-Markov process of changes of SDG states.

scholarly journals Monounireducible Nonhomogeneous Continuous Time Semi-Markov Processes Applied to Rating Migration Models

2012 ◽  
Vol 2012 ◽  
pp. 1-12 ◽  
Author(s):  
Guglielmo D'Amico ◽  
Jacques Janssen ◽  
Raimondo Manca
Keyword(s):  
Distribution Function ◽  
Markov Process ◽  
Markov Processes ◽  
Continuous Time ◽  
Topological Structure ◽  
Credit Rating ◽  
Fundamental Importance ◽  
Sufficient Condition ◽  
Semi Markov Process ◽  
Semi Markov Processes

Monounireducible nonhomogeneous semi- Markov processes are defined and investigated. The mono- unireducible topological structure is a sufficient condition that guarantees the absorption of the semi-Markov process in a state of the process. This situation is of fundamental importance in the modelling of credit rating migrations because permits the derivation of the distribution function of the time of default. An application in credit rating modelling is given in order to illustrate the results.

On some waiting time problems

2000 ◽  
Vol 37 (03) ◽  
pp. 756-764 ◽  
Author(s):  
Valeri T. Stefanov
Keyword(s):  
Survival Analysis ◽  
Finite Number ◽  
Markov Processes ◽  
Waiting Time ◽  
Generating Functions ◽  
Continuous Time ◽  
Waiting Times ◽  
Phase Type ◽  
Phase Type Distributions ◽  
Semi Markov Processes

A unifying technology is introduced for finding explicit closed form expressions for joint moment generating functions of various random quantities associated with some waiting time problems. Sooner and later waiting times are covered for general discrete- and continuous-time models. The models are either Markov chains or semi-Markov processes with a finite number of states. Waiting times associated with generalized phase-type distributions, that are of interest in survival analysis and other areas, are also covered.

The intersite distances between pattern occurrences in strings generated by general discrete- and continuous-time models: an algorithmic approach

2003 ◽  
Vol 40 (4) ◽  
pp. 881-892 ◽  
Author(s):  
Valeri T. Stefanov
Keyword(s):  
Markov Processes ◽  
Waiting Time ◽  
Generating Functions ◽  
Continuous Time ◽  
Finite Alphabet ◽  
Algorithmic Approach ◽  
First Occurrence ◽  
Semi Markov Processes ◽  
Pattern Occurrences ◽  
Continuous Time Models

The formation of patterns from letters of a finite alphabet is considered. The strings of letters are generated by general discrete- and continuous-time models which embrace as particular cases all models considered in the literature. The letters of the alphabet are identified by the states of either discrete- or continuous-time semi-Markov processes. A new and unifying method is introduced for evaluation of the generating functions of both the intersite distance between occurrences of an arbitrary, but fixed, pattern and the waiting time until the first occurrence of that pattern. Our method also covers in a unified way relevant and important joint generating functions. Furthermore, our results lead to an easy and efficient implementation of the relevant evaluations.

On some waiting time problems

2000 ◽  
Vol 37 (3) ◽  
pp. 756-764 ◽  
Author(s):  
Valeri T. Stefanov
Keyword(s):  
Survival Analysis ◽  
Finite Number ◽  
Markov Processes ◽  
Waiting Time ◽  
Generating Functions ◽  
Continuous Time ◽  
Waiting Times ◽  
Phase Type ◽  
Phase Type Distributions ◽  
Semi Markov Processes

A unifying technology is introduced for finding explicit closed form expressions for joint moment generating functions of various random quantities associated with some waiting time problems. Sooner and later waiting times are covered for general discrete- and continuous-time models. The models are either Markov chains or semi-Markov processes with a finite number of states. Waiting times associated with generalized phase-type distributions, that are of interest in survival analysis and other areas, are also covered.

Sign in / Sign up

Export Citation Format

Share Document