Time-inhomogeneous discrete stochastic search methods for optimal Bernoulli parameters
✍ Scribed by Ahmed, Mohamed A. ;Alkhamis, Talal M. ;Miller, Douglas R.
- Publisher
- John Wiley and Sons
- Year
- 1998
- Tongue
- English
- Weight
- 160 KB
- Volume
- 14
- Category
- Article
- ISSN
- 8755-0024
No coin nor oath required. For personal study only.
✦ Synopsis
We present two time-inhomogeneous search processes for finding the optimal Bernoulli parameters, where the performance measure cannot be evaluated exactly but must be estimated through Monte Carlo simulation. At each iteration, two neighbouring alternatives are compared and the one that appears to be better is passed on to the next iteration. The first search process uses an increasing sample size of each configuration at each iteration. The second search process uses a sequential sampling procedure with increasing boundaries as the number of iterations increases. At each iteration the acceptance of a new configuration depends on the iterate number, therefore, the search process turns out to be inhomogeneous Markov chain. We show that if the increase occurs slower than a certain rate, these search processes will converge to the optimal set with probability one.