Evaluating success in search systems
β Scribed by Edie Rasmussen; Elaine G. Toms; Bernard J. Jansen; Gheorghe Muresan
- Publisher
- Wiley (John Wiley & Sons)
- Year
- 2006
- Tongue
- English
- Weight
- 12 KB
- Volume
- 42
- Category
- Article
- ISSN
- 0044-7870
No coin nor oath required. For personal study only.
β¦ Synopsis
Abstract
The focus of this panel is on methodologies and measures for evaluating information retrieval (IR) systems from a humanβcentred perspective. Current research especially with regard to search engines is challenged by βInternet timeβ β the need for near instantaneous results that are also reliable and valid. The session will begin with an assessment of the current status of IR evaluation, followed by presentations on emerging methods used in recent evaluations, as well as on types of data collected and the measures used for analysis. A discussion among the panelists and the audience will critique current methods, and suggest how those methods may be enhanced. The outcome from this panel will be a fresh critical examination of IR evaluation methods.
π SIMILAR VOLUMES
Several previous studies have measured differences in the information search success of novices and experts. However, the definitions of novices and experts have varied greatly between the studies, and so have the measures used for search success. Instead of dividing the searchers into different gro