A survey of recent results on continuous-time Markov decision processes
✍ Scribed by Xianping Guo; Onésimo Hernández-Lerma; Tomás Prieto-Rumeau; Xi-Ren Cao; Junyu Zhang; Qiying Hu; Mark E. Lewis; Ricardo Vélez
- Publisher
- Springer-Verlag
- Year
- 2006
- Tongue
- English
- Weight
- 735 KB
- Volume
- 14
- Category
- Article
- ISSN
- 1134-5764
No coin nor oath required. For personal study only.
📜 SIMILAR VOLUMES
This paper addresses the long-term average cost control of continuous time Markov processes. A survey of problems and methods contained in various works is given for continuous control, optimal stopping, and impulse control.
This article describes a methodology that implements a Markov decision process (MDP) optimization technique in a real time fed-batch experiment. Biological systems can be better modeled under the stochastic framework and MDP is shown to be a suitable technique for their optimization. A nonlinear inp