✦ LIBER ✦

On Markov measure-valued processes in a finite space

✍ Scribed by E. V. Ostapenko

Publisher: Springer
Year: 2008
Tongue: English
Weight: 93 KB
Volume: 60
Category: Article
ISSN: 0041-5995
DOI: 10.1007/s11253-009-0174-4

No coin nor oath required. For personal study only.

📜 SIMILAR VOLUMES

Value iteration in average cost Markov c

Value iteration in average cost Markov control processes on Borel spaces

✍ Raúl Montes-de-Oca; Onésimo Hernández-Lerma 📂 Article 📅 1996 🏛 Springer Netherlands 🌐 English ⚖ 872 KB

This paper deals with discrete-time Markov control processes with Borel state and control spaces, with possibly unbounded costs and noncompact control constraint sets, and the average cost criterion. Conditions are given for the convergence of the value iteration algorithm to the optimal average cos

On a class of Markov processes in Hilber

On a class of Markov processes in Hilbert space

✍ Richard Duncan 📂 Article 📅 1973 🏛 Springer-Verlag 🌐 French ⚖ 801 KB

A mini-tutorial on measure-valued Markov

A mini-tutorial on measure-valued Markov processes and nonlinear martingale problems—As a reply to McCauley's comment

✍ T.D. Frank 📂 Article 📅 2007 🏛 Elsevier Science 🌐 English ⚖ 213 KB

One goal of this mini-tutorial is to provide an introduction into the theory of measure-valued Markov processes and nonlinear martingales defined by strongly nonlinear Fokker-Planck equations and to discuss the physical relevance of the associated processes. Another goal is to reply to McCauley's co

Sobolev spaces of Banach-valued function

Sobolev spaces of Banach-valued functions associated with a Markov process

✍ Ichiro Shigekawa 📂 Article 📅 1994 🏛 Springer 🌐 English ⚖ 584 KB

Markov processes and exponential familie

Markov processes and exponential families on a finite set

✍ Bernard Ycart 📂 Article 📅 1989 🏛 Elsevier Science 🌐 English ⚖ 425 KB

A New Class of Policies in Vector-Valued

A New Class of Policies in Vector-Valued Markov Decision Processes

✍ Kazuyoshi Wakuta 📂 Article 📅 1996 🏛 Elsevier Science 🌐 English ⚖ 108 KB

For a vector-valued Markov decision process with discounted reward criterion, we introduce a new class of policies called the semi-stationary policies and show that an optimal semi-stationary policy that attains the extreme points of the set of rewards induced by all policies can be described as a c