Markov chains and queueing theory together provide a robust framework for analysing systems that evolve randomly over time. Markov chains describe stochastic processes where the future state depends ...

The Annals of Applied Probability, Vol. 28, No. 3 (June 2018), pp. 1821-1855 (35 pages) We prove a sample path Large Deviation Principle (LDP) for a class of jump processes whose rates are not ...

This is a preview. Log in through your library . Abstract In an irreducible Markov renewal process either all states are periodic or none are. In the former case they all have the same period.

This paper proposes a hidden state Markov model (HMM) that incorporates workers’ unobserved labor market attachment into the analysis of labor market dynamics. Unlike previous literature, which ...

Markov Models for disease progression are common in medical decision making (see references below). The parameters in a Markov model can be estimated by observing the time it takes patients in any ...