𝔖 Scriptorium
✦   LIBER   ✦

📁

Poisson Point Processes and Their Application to Markov Processes

✍ Scribed by Kiyosi Itô, Shinzo Watanabe, Ichiro Shigekawa


Publisher
Springer
Year
2016
Tongue
English
Leaves
54
Series
SpringerBriefs in Probability and Mathematical Statistics
Category
Library

⬇  Acquire This Volume

No coin nor oath required. For personal study only.

✦ Synopsis


An extension problem (often called a boundary problem) of Markov processes has been studied, particularly in the case of one-dimensional diffusion processes, by W. Feller, K. Itô, and H. P. McKean, among others. In this book, Itô discussed a case of a general Markov process with state space S and a specified point a ∈ S called a boundary. The problem is to obtain all possible recurrent extensions of a given minimal process (i.e., the process on S \ {a} which is absorbed on reaching the boundary a). The study in this lecture is restricted to a simpler case of the boundary a being a discontinuous entrance point, leaving a more general case of a continuous entrance point to future works. He established a one-to-one correspondence between a recurrent extension and a pair of a positive measure k(db) on S \ {a} (called the jumping-in measure and a non-negative number m< (called the stagnancy rate). The necessary and sufficient conditions for a pair k, m was obtained so that the correspondence is precisely described. For this, Itô used,  as a fundamental tool, the notion of Poisson point processes formed of all excursions of  the process on S \ {a}. This theory of Itô's of Poisson point processes of excursions is indeed a breakthrough. It has been expanded and applied to more general extension problems by many succeeding researchers. Thus we may say that this lecture note by Itô is really a memorial work in the extension problems of Markov processes. Especially in Chapter 1 of this note, a general theory of Poisson point processes is given that reminds us of Itô's beautiful and impressive lectures in his day.

✦ Table of Contents


Front Matter....Pages i-xi
Poisson Point Processes....Pages 1-18
Application to Markov Processes....Pages 19-43

✦ Subjects


Probability Theory and Stochastic Processes; Measure and Integration; Functional Analysis


📜 SIMILAR VOLUMES


Markov Point Processes and Their Applica
✍ M N M Van Lieshout 📂 Library 📅 2000 🏛 Imperial College Press 🌐 English

The splitting extrapolation method is a newly developed technique for solving multidimensional mathematical problems. It overcomes the difficulties arising from Richardson's extrapolation when applied to these problems and obtains higher accuracy solutions with lower cost and a high degree of parall

Markov Point Processes and Their Applica
✍ van Lieshout M.N.M. 📂 Library 📅 2000 🏛 World Scientific 🌐 English

These days, an increasing amount of information can be obtained in graphical forms, such as weather maps, soil samples, locations of nests in a breeding colony, microscopical slices, satellite images, radar or medical scans and X-ray techniques. "High level" image analysis is concerned with the glob

Markov Decision Processes With Their App
✍ Professor Qiying Hu, Professor Wuyi Yue (auth.) 📂 Library 📅 2008 🏛 Springer US 🌐 English

<p><P>Markov decision processes (MDPs), also called stochastic dynamic programming, were first studied in the 1960s. MDPs can be used to model and solve dynamic decision-making problems that are multi-period and occur in stochastic circumstances. There are three basic branches in MDPs: discrete-time

Markov Decision Processes With Their App
✍ Professor Qiying Hu, Professor Wuyi Yue (auth.) 📂 Library 📅 2008 🏛 Springer US 🌐 English

<p><P>Markov decision processes (MDPs), also called stochastic dynamic programming, were first studied in the 1960s. MDPs can be used to model and solve dynamic decision-making problems that are multi-period and occur in stochastic circumstances. There are three basic branches in MDPs: discrete-time

The Dynkin Festschrift: Markov Processes
✍ V. M. Blinovskii, R. L. Dobrushin (auth.), Mark I. Freidlin (eds.) 📂 Library 📅 1994 🏛 Birkhäuser Basel 🌐 English

<p>Onishchik, A. A. Kirillov, and E. B. Vinberg, who obtained their first results on Lie groups in Dynkin's seminar. At a later stage, the work of the seminar was greatly enriched by the active participation of 1. 1. Pyatetskii­ Shapiro. As already noted, Dynkin started to work in probability as far