Integration of Natural Language and Vision Processing: Computational Models and Systems

✍ Scribed by Ryuichi Oka (auth.), Paul Mc Kevitt (eds.)

• Publisher: Springer Netherlands
• Year: 1995
• Tongue: English
• Leaves: 306
• Edition: 1
• Category: Library

✦ Synopsis

Although there has been much progress in developing theories, models and systems in the areas of Natural Language Processing (NLP) and Vision Processing (VP) there has heretofore been little progress on integrating these subareas of Artificial Intelligence (AI). This book contains a set of edited papers addressing computational models and systems for the integration of NLP and VP. The papers focus on site descriptions such as that of the large Japanese $500 million Real World Computing (RWC) project, on historical philosophical issues, on systems which have been built and which integrate the processing of visual scenes together with language about them, and on spatial relations which appear to be the key to integration. The U.S.A., Japan and the EU are well reflected, showing up the fact that integration is a truly international issue. There is no doubt that all of this will be necessary for the InformationSuperHighways of the future.

✦ Table of Contents

Front Matter....Pages i-12
The Real World Computing Program....Pages 13-19
An Investigation into the Common Semantics of Language and Vision....Pages 21-30
Hierarchical Labelling for Integrating Images and Words....Pages 31-53
Quantitative Perceptual Representation of Prepositional Semantics....Pages 55-66
From Vision to Multimodal Communication: Incremental Route Descriptions....Pages 67-82
VIsual TRAnslator: Linking Perceptions and Natural Language Descriptions....Pages 83-95
A Vision of ‘Vision and Language’ Comprises Action: An Example from Road Traffic....Pages 97-122
What You Say is What You See — Interactive Generation, Manipulation and Modification of 3-D Shapes Based on Verbal Descriptions....Pages 123-142
Towards an American Sign Language Interface....Pages 143-161
Integrating Natural Language Understanding with Document Structure Analysis....Pages 163-184
Computational Models for Integrating Linguistic and Visual Information: A Survey....Pages 185-205
Grounding Language in Perception....Pages 207-227
Connectionist Visualisation of Tonal Structure....Pages 229-244
Use of Captions and Other Collateral Text in Understanding Photographs....Pages 245-266
The DenK-architecture: A Fundamental Approach to User-Interfaces....Pages 267-281
AI Meets Authoring: User Models for Intelligent Multimedia....Pages 283-304
Book Reviews....Pages 305-309

✦ Subjects

Artificial Intelligence (incl. Robotics); Computer Imaging, Vision, Pattern Recognition and Graphics; Data Structures, Cryptology and Information Theory