𝔖 Bobbio Scriptorium
✦   LIBER   ✦

Second order bounds for Markov Decision Processes

✍ Scribed by L.C Thomas

Publisher
Elsevier Science
Year
1981
Tongue
English
Weight
167 KB
Volume
80
Category
Article
ISSN
0022-247X

No coin nor oath required. For personal study only.

πŸ“œ SIMILAR VOLUMES

Bounding reward measures of Markov model
Bounding reward measures of Markov models using the Markov decision processes
✍ Peter Buchholz πŸ“‚ Article πŸ“… 2011 πŸ› John Wiley and Sons 🌐 English βš– 388 KB

## SUMMARY For a Markov reward process, where upper and lower bounds for the transition rates and rewards are known, a new approach to bound the expected reward is presented. Based on a previous paper where sharp bounds have been defined for the problem, but only an inefficient and unstable algorit

A Point Process with Second Order MARKOV
A Point Process with Second Order MARKOV Dependent Intervals
✍ F. S. Chong πŸ“‚ Article πŸ“… 1981 πŸ› John Wiley and Sons 🌐 English βš– 391 KB

## Abstract The limiting behaviour of the point process with 2nd order MARKOV‐dependent intervals is analysed through the use of β€œregeneration time”. The results for the case of periodic MARKOV‐dependent intervals are briefly mentioned.