✦ LIBER ✦

Compactification of the discrete state space of a Markov process

✍ Scribed by J. L. Doob

Publisher: Springer
Year: 1968
Tongue: English
Weight: 928 KB
Volume: 10
Category: Article
ISSN: 1432-2064
DOI: 10.1007/bf00536277

No coin nor oath required. For personal study only.

📜 SIMILAR VOLUMES

The number of visits to a subset of the

The number of visits to a subset of the state space by a discrete-parameter semi-Markov process

✍ Attila Csenki 📂 Article 📅 1995 🏛 Elsevier Science 🌐 English ⚖ 293 KB

Germ sigma fields and the natural state

Germ sigma fields and the natural state space of a Markov process

✍ P. W. Millar 📂 Article 📅 1977 🏛 Springer 🌐 English ⚖ 744 KB

On the reduction of the Wallman compacti

On the reduction of the Wallman compactification problem to discrete spaces

✍ A.K. Steiner; E.F. Steiner 📂 Article 📅 1977 🏛 Elsevier Science ⚖ 375 KB

If Ras;sd~ff

Ergodic Control of a Singularly Perturbe

Ergodic Control of a Singularly Perturbed Markov Process in Discrete Time with General State and Compact Action Spaces

✍ T. R. Bielecki; L. Stettner 📂 Article 📅 1998 🏛 Springer 🌐 English ⚖ 193 KB

Risk sensitive control of Markov process

Risk sensitive control of Markov processes in countable state space

✍ Daniel Hernandez-Hernández; Steven I. Marcus 📂 Article 📅 1996 🏛 Elsevier Science 🌐 English ⚖ 450 KB

In this paper we consider infinite horizon risk-sensitive control of Markov processes with discrete time and denumerable state space. This problem is solved by proving, under suitable conditions, that there exists a bounded solution to the dynamic programming equation. The dynamic programming equati

Adaptive Control of a Partially Observed

Adaptive Control of a Partially Observed Discrete Time Markov Process

✍ T. E. Duncan; B. Pasik-Duncan; L. Stettner 📂 Article 📅 1998 🏛 Springer 🌐 English ⚖ 243 KB