New perturbation bounds for denumerable Markov chains
✍ Scribed by Zahir Mouhoubi; Djamil Aïssani
- Publisher
- Elsevier Science
- Year
- 2010
- Tongue
- English
- Weight
- 305 KB
- Volume
- 432
- Category
- Article
- ISSN
- 0024-3795
No coin nor oath required. For personal study only.
✦ Synopsis
This paper is devoted to perturbation analysis of denumerable Markov chains. Bounds are provided for the deviation between the stationary distribution of the perturbed and nominal chain, where the bounds are given by the weighted supremum norm. In addition, bounds for the perturbed stationary probabilities are established. Furthermore, bounds on the norm of the asymptotic decomposition of the perturbed stationary distribution are provided, where the bounds are expressed in terms of the norm of the ergodicity coefficient, or the norm of a special residual matrix. Refinements of our bounds for Doeblin Markov chains are considered as well. Our results are illustrated with a number of examples.
📜 SIMILAR VOLUMES
In several papers Meyer, singly and with coauthors, established the usefulness of the group generalized inverse in the study and computations of various aspects of Markov chains. Here we are interested in those results which concern bounds on the condition number of the chain and on the error in the
Let P be the transition matrix for an n-state, homogeneous, ergodic Markov chain. Set Q = I -P and let Q # = [q # i,j ] be the group (generalized) inverse of Q. A well-known condition number, due to Funderlic and Meyer, which is used in the error analysis for the computation of the stationary distri
O'Cinneide presented an entrywise perturbation theorem for Markov chains. The error bound he obtained is nearly best possible. We give the best possible error bound.