[ACM Press the 27th annual international conference - Sheffield, United Kingdom (2004.07.25-2004.07.29)] Proceedings of the 27th annual international conference on Research and development in information retrieval - SIGIR '04 - Feature selection using linear classifier weights

✍ Scribed by Mladenić, Dunja; Brank, Janez; Grobelnik, Marko; Milic-Frayling, Natasa

• Book ID: 121865024
• Publisher: ACM Press
• Year: 2004
• Tongue: English
• Weight: 311 KB
• Category: Article
• ISBN-13: 9781581138818
• DOI: 10.1145/1008992.1009034

✦ Synopsis

This paper explores feature scoring and selection based on weights from linear classification models. It investigates how these methods combine with various learning models. Our comparative analysis includes three learning algorithms: Naïve Bayes, Perceptron, and Support Vector Machines (SVM) in combination with three feature weighting methods: Odds Ratio, Information Gain, and weights from linear models, the linear SVM and Perceptron. Experiments show that feature selection using weights from linear SVMs yields better classification performance than other feature weighting methods when combined with the three explored learning algorithms. The results support the conjecture that it is the sophistication of the feature weighting method rather than its apparent compatibility with the learning algorithm that improves classification performance.