𝔖 Bobbio Scriptorium
✦   LIBER   ✦

Stationary distributions of perturbed Markov chains

✍ Scribed by Jeffrey J. Hunter

Publisher
Elsevier Science
Year
1986
Tongue
English
Weight
597 KB
Volume
82
Category
Article
ISSN
0024-3795

No coin nor oath required. For personal study only.

πŸ“œ SIMILAR VOLUMES

Singularly Perturbed Markov Chains: Conv
Singularly Perturbed Markov Chains: Convergence and Aggregation
✍ G Yin; Q Zhang; G Badowski πŸ“‚ Article πŸ“… 2000 πŸ› Elsevier Science 🌐 English βš– 215 KB

Asymptotic properties of singularly perturbed Markov chains having measurable andΓ‚or continuous generators are developed in this work. The Markov chain under consideration has a finite-state space and is allowed to be nonstationary. Its generator consists of a rapidly varying part and a slowly chang

Control of Dynamic Systems under the Inf
Control of Dynamic Systems under the Influence of Singularly Perturbed Markov Chains
✍ G Yin; Q Zhang πŸ“‚ Article πŸ“… 1997 πŸ› Elsevier Science 🌐 English βš– 320 KB

This work is concerned with nearly optimal controls of nonlinear dynamic systems under the influence of singularly perturbed Markov chains. The underlying Markov chains have fast and slow components and their states can be divided into a number of groups. Within each group of states, the chain varie

Joint Distributions of the Numbers of Vi
Joint Distributions of the Numbers of Visits for Finite-State Markov Chains
✍ Wolfgang Stadje πŸ“‚ Article πŸ“… 1999 πŸ› Elsevier Science 🌐 English βš– 163 KB

For a discrete-time Markov chain with finite state space [1, ..., r] we consider the joint distribution of the numbers of visits in states 1, ..., r&1 during the first N steps or before the N th visit to r. From the explicit expressions for the corresponding generating functions we obtain the limiti