✦ LIBER ✦

A note on the convergence rate of the value iteration scheme in controlled Markov chains

✍ Scribed by Rolando Cavazos-Cadena

Publisher: Elsevier Science
Year: 1998
Tongue: English
Weight: 106 KB
Volume: 33
Category: Article
ISSN: 0167-6911
DOI: 10.1016/s0167-6911(97)00097-2

No coin nor oath required. For personal study only.

📜 SIMILAR VOLUMES

The convergence of value iteration in av

The convergence of value iteration in average cost Markov decision chains

✍ Linn I. Sennott 📂 Article 📅 1996 🏛 Elsevier Science 🌐 English ⚖ 415 KB

A pause control approach to the value it

A pause control approach to the value iteration scheme in average Markov decision processes

✍ Rolando Cavazos-Cadena 📂 Article 📅 1998 🏛 Elsevier Science 🌐 English ⚖ 124 KB

This work concerns average Markov decision chains with denumerable state space. Assuming that the Lyapunov function condition holds, it is shown that the value iteration scheme yields convergent approximations to the solution of the average cost optimality equation. This result is obtained using a p

A note on the extended convergence of SO

A note on the extended convergence of SOR for two-periodic Markov chains

✍ Wilhelm Niethammer 📂 Article 📅 1999 🏛 Elsevier Science 🌐 English ⚖ 321 KB

It is well known that successive overrelaxation (SOR) can be used to compute the stationary distribution of a homogeneous Markov chain. In a long paper Kontovasalis et al. (K. Kontovasalis, R.J. Plemmons, W.J. Stewart, Linear Algebra Appl. 154-156 (1991) showed together with other results that for p

On the average run lengths of quality co

On the average run lengths of quality control schemes using a Markov chain approach

✍ James C. Fu; Fred A. Spiring; Hansheng Xie 📂 Article 📅 2002 🏛 Elsevier Science 🌐 English ⚖ 122 KB

Control schemes such as cumulative sum (CUSUM), exponentially weighted moving average (EWMA) and Shewhart charts have found widespread application in improving the quality of manufactured goods and services. The run length and the average run length (ARL) have become traditional measures of a contro

A uniform estimate for the rate of conve

A uniform estimate for the rate of convergence in the central limit theorem for homogeneous Markov chains

✍ M. Gharib; M. Abdel-Fattah 📂 Article 📅 1995 🏛 Elsevier Science 🌐 English ⚖ 240 KB

A class of iteration methods based on th

A class of iteration methods based on the moser formula for nonlinear equations in Markov chains

✍ Zhong-Zhi Bai 📂 Article 📅 1997 🏛 Elsevier Science 🌐 English ⚖ 945 KB

Many stochastic models in queueing, inventory, communications, and dam theories, etc., result in the problem of numerically determining the minimal nonnegative solutions for a class of nonlinear matrix equations. Various iterative methods have been proposed to determine the matrices of interest. We