✦ LIBER ✦

Approximation of Markov chains

✍ Scribed by S. A. Anichkin; V. V. Kalashnikov

Publisher: Springer US
Year: 1986
Tongue: English
Weight: 522 KB
Volume: 32
Category: Article
ISSN: 1573-8795
DOI: 10.1007/bf01084492

No coin nor oath required. For personal study only.

📜 SIMILAR VOLUMES

Translated Poisson Approximation for Mar

Translated Poisson Approximation for Markov Chains

✍ A. D. Barbour; Torgny Lindvall 📂 Article 📅 2006 🏛 Springer US 🌐 English ⚖ 187 KB

Translated Poisson Approximation for Mar

Translated Poisson Approximation for Markov Chains

✍ A. D. Barbour; Torgny Lindvall 📂 Article 📅 2008 🏛 Springer US 🌐 English ⚖ 151 KB

Approximation of Markov chains defined b

Approximation of Markov chains defined by recursion relations

✍ S. A. Anichkin 📂 Article 📅 1986 🏛 Springer US 🌐 English ⚖ 835 KB

Markov approximations of chains of infin

Markov approximations of chains of infinite order

✍ R. Fernández; A. Galves 📂 Article 📅 2002 🏛 Springer 🌐 English ⚖ 86 KB

Estimating the approximation accuracy of

Estimating the approximation accuracy of Harris-recurrent Markov chains

✍ S. A. Anichkin 📂 Article 📅 1986 🏛 Springer US 🌐 English ⚖ 359 KB

Linear stochastic approximation driven b

Linear stochastic approximation driven by slowly varying Markov chains

✍ Vijay R. Konda; John N. Tsitsiklis 📂 Article 📅 2003 🏛 Elsevier Science 🌐 English ⚖ 241 KB

We study a linear stochastic approximation algorithm that arises in the context of reinforcement learning. The algorithm employs a decreasing step-size, and is driven by Markov noise with time-varying statistics. We show that under suitable conditions, the algorithm can track the changes in the stat