𝔖 Bobbio Scriptorium
✦   LIBER   ✦

A statistical unified framework for rank-based multiple classifier decision combination

✍ Scribed by Afşar Saranli; Mübeccel Demirekler


Publisher
Elsevier Science
Year
2001
Tongue
English
Weight
643 KB
Volume
34
Category
Article
ISSN
0031-3203

No coin nor oath required. For personal study only.

✦ Synopsis


This study presents a theoretical investigation of the rank-based multiple classi"er decision combination problem, with the aim of providing a uni"ed framework to understand a variety of such systems. The combination of the decisions of more than one classi"ers with the aim of improving overall system performance is a concept of general interest in pattern recognition, as a viable alternative to designing a single sophisticated classi"er. The problem of combining the classi"er decisions in the raw form of candidate class rankings is formulated as a discrete optimization problem. The objective function to be maximized is selected as the overall probability of correct decision. This formulation introduces a set of observation statistics about the joint behavior of the classi"ers which are to be estimated by observing the classi"ers operated on a cross-validation test set. The resulting binary programming problem is shown to have a simple and global optimum solution but which also necessitates a prohibitive number of observation statistics. From the objective function expansion, the problem observation space is de"ned and a method based on partitioning is introduced to reduce its prohibitive dimensionality. Within this partitioning formalism called as the Partitioned Observation Space (POS) theory, the number of behavior observation statistics can be reduced to levels which are feasible to estimate from the available cross-validation test data. It is shown by examples that such speci"c partitionings can be de"ned when reasonable assumptions or prior knowledge about the classi"ers are incorporated into the problem domain. It is also demonstrated that certain speci"c partitionings of the classi"er observation space e!ectively lead to the highest rank, Borda count and logistic regression rank-based decision combination methods from the literature. The analysis presented is general and promises to lead to a class of algorithms for rank-based decision combination. The potential of the theory and practical issues in implementation are illustrated by applying it in a real-life phonetic discrimination problem from speech pattern classi"cation with encouraging results.


📜 SIMILAR VOLUMES


Multiple classifier implementation of a
✍ Önsen Toygar; Adnan Acan 📂 Article 📅 2004 🏛 Elsevier Science 🌐 English ⚖ 367 KB

This paper presents a multiple classifier system for the face recognition problem-based on a novel divide-andconquer approach using appearance-based statistical methods, namely principal component analysis (PCA), linear discriminant analysis (LDA) and independent component analysis (ICA). A facial i