๐”– Bobbio Scriptorium
โœฆ   LIBER   โœฆ

Approximation of Markov chains defined by recursion relations

โœ Scribed by S. A. Anichkin


Publisher
Springer US
Year
1986
Tongue
English
Weight
835 KB
Volume
32
Category
Article
ISSN
1573-8795

No coin nor oath required. For personal study only.


๐Ÿ“œ SIMILAR VOLUMES


Approximation of Markov chains
โœ S. A. Anichkin; V. V. Kalashnikov ๐Ÿ“‚ Article ๐Ÿ“… 1986 ๐Ÿ› Springer US ๐ŸŒ English โš– 522 KB
Linear stochastic approximation driven b
โœ Vijay R. Konda; John N. Tsitsiklis ๐Ÿ“‚ Article ๐Ÿ“… 2003 ๐Ÿ› Elsevier Science ๐ŸŒ English โš– 241 KB

We study a linear stochastic approximation algorithm that arises in the context of reinforcement learning. The algorithm employs a decreasing step-size, and is driven by Markov noise with time-varying statistics. We show that under suitable conditions, the algorithm can track the changes in the stat