Multimedia Information Retrieval

✍ Scribed by Stefan M. Rüger

• Publisher: Morgan & Claypool Publishers
• Year: 2010
• Tongue: English
• Leaves: 171
• Series: Synthesis Lectures on Information Concepts, Retrieval, and Services #10
• Category: Library

✦ Table of Contents

Preface
What is Multimedia Information Retrieval?
Information Retrieval
Multimedia
Multimedia Information Retrieval
Challenges of Automated Multimedia Indexing
Summary
Exercises
Memex
Loops and Interaction
Automated vs Manual
Compound Text Queries
Search Types
Basic Multimedia Search Technologies
Metadata Driven Retrieval
Piggy-back Text Retrieval
Content-based Retrieval
Automated Image Annotation
Fingerprinting
Audio Fingerprinting
Image Fingerprinting
Exercises
Search Types Continued
Intensity Histograms
Fingerprint Block Probabilities
Fingerprint Block False Positives
Shazam's Constellation Pairs
One Pass Algorithm for Min Hash
Content-based Retrieval in Depth
Content-based Retrieval Architecture
Features
Colour Histograms
Statistical Moments
Texture Histograms
Shape
Spatial Information
Other Feature Types
Distances
Geometric Component-wise Distances
Geometric Quadratic Distances
Statistical Distances
Probabilistic Distance Measures
Ordinal and Nominal Distances
String-based Distances
Feature and Distance Standardisation
Component-wise Standardisation using Corpus Statistics
Range Standardisation
Ratio Features
Vector Normalisation
High-dimensional Indexing
Fusion of Feature Spaces and Query Results
Single Query Example with Multiple Features
Multiple Query Examples
Order of Fusion
Exercises
Colour Histograms
HSV Colour Space Quantisation
CIE LUV Colour Space Quantisation
Skewness and Kurtosis
Boundaries for Tamura Features
Distances and Dissimilarities
Ordinal Distances --- Pen-pal Matching
Asymmetric Binary Features
Jaccard Distance
Levenshtein Distance
Co-occurrence Dissimilarity
Chain Codes and Edit Distance
Time Warping Distance
Feature Standardisation
Curse of Dimensionality
Image Search
Added Services
Video Summaries
Paradigms in Information Visualisation
Visual Search and Relevance Feedback
Browsing
Geo-temporal Aspects of Media
Importance of Geography as Context
Geo-temporal Browsing and Access
Exercises
Interface Design and Functionality
Shot Boundary Detection for Gradual Transitions
Relevance Feedback: Optimal Weight Computation
Relevance Feedback: Lagrangian Multiplier
Geographic Attributes
View of the World --- Retrieval and Context
Multimedia Information Retrieval Research
Multimedia Representation and Management
GATE
AXMEDIS
NM2
3DTV
VISNET II
X-Media
MediaCampaign
SALERO
LUISA
SEMEDIA
Digital Libraries
Greenstone
Informedia
SCULPTEUR
CHLT
DELOS
BRICKS
StoryBank
Metadata and Automated Annotation
aceMedia
LAVA
KerMIT
POLYMNIA
User Needs and Evaluation
Adapt
VIRAMI
INEX XML Multimedia Track
TRECVid
ImageCLEF
GeoCLEF
MIREX
Multimedia Search and Mining Systems
PHAROS
VITALAS
TRIPOD
Browsing and Presentation
üBase
SPIRIT
mSpace
Imagination is the Only Limit
Exercises
Search Types Continued
Overview Diagram of Projects
Summary
Bibliography
Author's Biography