ImageCLEF: Experimental evaluation in visual information retrieval

✍ Scribed by Paul Clough, Henning Müller, Mark Sanderson (auth.), Henning Müller, Paul Clough, Thomas Deselaers, Barbara Caputo (eds.)

• Publisher: Springer-Verlag Berlin Heidelberg
• Year: 2010
• Tongue: English
• Leaves: 570
• Series: The Information Retrieval Series 32
• Edition: 1
• Category: Library

✦ Synopsis

The creation and consumption of content, especially visual content, is ingrained into our modern world. This book contains a collection of texts centered on the evaluation of image retrieval systems. To enable reproducible evaluation we must create standardized benchmarks and evaluation methodologies. The individual chapters in this book highlight major issues and challenges in evaluating image retrieval systems and describe various initiatives that provide researchers with the necessary evaluation resources. In particular they describe activities within ImageCLEF, an initiative to evaluate cross-language image retrieval systems which has been running as part of the Cross Language Evaluation Forum (CLEF) since 2003.

To this end, the editors collected contributions from a range of people: those involved directly with ImageCLEF, such as the organizers of specific image retrieval or annotation tasks; participants who have developed techniques to tackle the challenges set forth by the organizers; and people from industry and academia involved with image retrieval and evaluation generally.

Mostly written for researchers in academia and industry, the book stresses the importance of combing textual and visual information – a multimodal approach – for effective retrieval. It provides the reader with clear ideas about information retrieval and its evaluation in contexts and domains such as healthcare, robot vision, press photography, and the Web.

✦ Table of Contents

Front Matter....Pages I-XXVIII
Front Matter....Pages 1-2
Seven Years of Image Retrieval Evaluation....Pages 3-18
Data Sets Created in ImageCLEF....Pages 19-43
Creating Realistic Topics for Image Retrieval Evaluation....Pages 45-61
Relevance Judgments for Image Retrieval Evaluation....Pages 63-80
Performance Measures Used in Image Information Retrieval....Pages 81-94
Fusion Techniques for Combining Textual and Visual Information Retrieval....Pages 95-114
Front Matter....Pages 115-116
Interactive Image Retrieval....Pages 117-139
Photographic Image Retrieval....Pages 141-162
The Wikipedia Image Retrieval Task....Pages 163-183
The Robot Vision Task....Pages 185-198
Object and Concept Recognition for Image Retrieval....Pages 199-219
The Medical Image Classification Task....Pages 221-238
The Medical Image Retrieval Task....Pages 239-257
Front Matter....Pages 259-260
Expansion and Re–ranking Approaches for Multimodal Image Retrieval using Text–based Methods....Pages 261-275
Revisiting Sub–topic Retrieval in the ImageCLEF 2009 Photo Retrieval Task....Pages 277-294
Knowledge Integration using Textual Information for Improving ImageCLEF Collections....Pages 295-313
Leveraging Image, Text and Cross–media Similarities for Diversity–focused Multimedia Retrieval....Pages 315-342
University of Amsterdam at the Visual Concept Detection and Annotation Tasks....Pages 343-358
Intermedia Conceptual Indexing....Pages 359-380
Conceptual Indexing Contribution to ImageCLEF Medical Retrieval Tasks....Pages 381-396
Front Matter....Pages 259-260
Improving Early Precision in the ImageCLEF Medical Retrieval Task....Pages 397-413
Lung Nodule Detection....Pages 415-434
Medical Image Classification at Tel Aviv and Bar Ilan Universities....Pages 435-451
Idiap on Medical Image Classification....Pages 453-465
Front Matter....Pages 467-468
Press Association Images — Image Retrieval Challenges....Pages 469-482
Image Retrieval in a Commercial Setting....Pages 483-505
An Overview of Evaluation Campaigns in Multimedia Retrieval....Pages 507-525
Back Matter....Pages 527-541

✦ Subjects

Information Storage and Retrieval; Image Processing and Computer Vision; System Performance and Evaluation; Computational Biology/Bioinformatics