𝔖 Bobbio Scriptorium
✦   LIBER   ✦

A characterization of exponential functionals in finite Markov chains

✍ Scribed by Rolando Cavazos–Cadena; Daniel Hernández–Hernández

Book ID
105857990
Publisher
Springer
Year
2004
Tongue
English
Weight
286 KB
Volume
60
Category
Article
ISSN
0340-9422

No coin nor oath required. For personal study only.

📜 SIMILAR VOLUMES

On the Markov property of a finite hidde
On the Markov property of a finite hidden Markov chain
✍ Peter Spreij 📂 Article 📅 2001 🏛 Elsevier Science 🌐 English ⚖ 119 KB

In this paper we study the question of the conditions under which a hidden Markov chain itself exhibits Markovian behaviour. An insightful method to answer this question is based on a recursive ÿltering formula for the underlying chain.

Penalty function and adaptive control of
Penalty function and adaptive control of constrained finite Markov chains
✍ K. Najim; A. S. Poznyak 📂 Article 📅 1998 🏛 John Wiley and Sons 🌐 English ⚖ 161 KB 👁 2 views

In this paper we consider the adaptive control of constrained finite ergodic controller Markov chains whose transition probabilities are unknown. The control policy is designed to achieve the minimization of a loss function under a set of inequality constraints. The average values of conditional mat