Investigating the influence of the choice of the ensemble members in accuracy and diversity of selection-based and fusion-based methods for ensembles
✍ Scribed by Anne M.P. Canuto; Marjory C.C. Abreu; Lucas de Melo Oliveira; João C. Xavier Jr.; Araken de M. Santos
- Publisher
- Elsevier Science
- Year
- 2007
- Tongue
- English
- Weight
- 447 KB
- Volume
- 28
- Category
- Article
- ISSN
- 0167-8655
No coin nor oath required. For personal study only.
✦ Synopsis
One of the most important steps in the design of a multi-classifier system (MCS), also known as ensemble, is the choice of the components (classifiers). This step is very important to the overall performance of a MCS since the combination of a set of identical classifiers will not outperform the individual members. The ideal situation would be a set of classifiers with uncorrelated errors -they would be combined in such a way as to minimize the effect of these failures. This paper presents an extensive evaluation of how the choice of the components (classifiers) can affect the performance of several combination methods (selection-based and fusion-based methods). An analysis of the diversity of the MCSs when varying their components is also performed. As a result of this analysis, it is aimed to help designers in the choice of the individual classifiers and combination methods of an ensemble.
📜 SIMILAR VOLUMES
Comparison of several calibration methods (principal component regression (PCR), partial least-squares, multiple linear regression), with and without feature selection, applied on near-infrared spectroscopic data is presented for a pharmaceutical application. It is shown that PCR with selection of p
The aim of this paper is to suggest a bootstrap-based method for choosing the number of components in Partial Least Squares Regression (PLSR). Cross-validated Q h 2 statistic is used, for which is intended to derive a bootstrap distribution and to perform a hypothesis testing. Monte Carlo approximat