Toward a unified retrieval outcome analysis framework for cross-language information retrieval
✍ Scribed by Jiangping Chen
- Publisher
- Wiley (John Wiley & Sons)
- Year
- 2006
- Tongue
- English
- Weight
- 876 KB
- Volume
- 42
- Category
- Article
- ISSN
- 0044-7870
No coin nor oath required. For personal study only.
✦ Synopsis
Abstract
This paper proposes a Retrieval Outcome Analysis Framework, or ROA Framework, to systematically evaluate retrieval performance of Cross‐Language Information Retrieval systems. The ROA framework goes beyond TREC‐type retrieval evaluation methodology by including procedures focusing on individual queries, especially difficult queries. The framework is comprised of four interrelated components: (1) Overall System Performance Evaluation, (2) Query Categorization, (3) Translation Analysis, and (4) Individual Query Analysis. An example of applying the framework is discussed in detail. The author believes the proposed framework would be especially useful for the development of real‐world Cross‐Language Information Retrieval systems because the evaluation guided by the framework has the potential to discover causes behind poor retrieval performance.
📜 SIMILAR VOLUMES
## Abstract This study proposes and explores a natural language processing‐ (NLP) based strategy to address out‐of‐dictionary and vocabulary mismatch problems in query translation based English–Chinese Cross‐Language Information Retrieval (EC‐CLIR). The strategy, named the __LKB approach__, is to c
## Abstract This proposed exploratory study seeks to contextualize music information retrieval (MIR) in relation to similarities across genre. Drawing upon relevant MIR studies, we propose a holistic theoretical framework that future researchers could utilize to develop systems that facilitate cros