Approximate algorithms for neural-Bayesian approaches

✍ Scribed by Tom Heskes; Bart Bakker; Bert Kappen

• Book ID: 104325403
• Publisher: Elsevier Science
• Year: 2002
• Tongue: English
• Weight: 240 KB
• Volume: 287
• Category: Article
• ISSN: 0304-3975
• DOI: 10.1016/s0304-3975(02)00132-9

✦ Synopsis

We describe two speciÿc examples of neural-Bayesian approaches for complex modeling tasks: survival analysis and multitask learning. In both cases, we can come up with reasonable priors on the parameters of the neural network. As a result, the Bayesian approaches improve their (maximum likelihood) frequentist counterparts dramatically. By illustrating their application on the models under study, we review and compare algorithms that can be used for Bayesian inference: Laplace approximation, variational algorithms, Monte Carlo sampling, and empirical Bayes.