Countable state Markov process bootstrap
β Scribed by R.J. Kulperger
- Book ID
- 104340710
- Publisher
- Elsevier Science
- Year
- 1999
- Tongue
- English
- Weight
- 114 KB
- Volume
- 76
- Category
- Article
- ISSN
- 0378-3758
No coin nor oath required. For personal study only.
β¦ Synopsis
Bootstrap methods have been applied to various dependent sequences. Markov processes and Markov chains have a special structure. In particular, Markov chains have a discrete state-space. This paper considers an ergodic countable state-space Markov chain. Given data Xt; t = 0; : : : ; n, one can observe a ΓΏnite number of visited states. This paper proposes a bootstrap method that with probability 1 produces a bootstrap Markov chain that is ergodic. It involves a tuning parameter.
π SIMILAR VOLUMES
In this paper we consider infinite horizon risk-sensitive control of Markov processes with discrete time and denumerable state space. This problem is solved by proving, under suitable conditions, that there exists a bounded solution to the dynamic programming equation. The dynamic programming equati