Advances in Natural Multimodal Dialogue Systems

✍ Scribed by Niels Ole Bernsen, Laila Dybkjær (auth.), Jan C. J. van Kuppevelt, Laila Dybkjær, Niels Ole Bernsen (eds.)

• Publisher: Springer Netherlands
• Year: 2005
• Tongue: English
• Leaves: 375
• Series: Text, Speech and Language Technology 30
• Edition: 1
• Category: Library

✦ Synopsis

References 74 Part II Annotation and Analysis of Multimodal Data: Speech and Gesture 4 FORM 79 Craig H. Martell 1. Introduction 79 2. Structure of FORM 80 3. Annotation Graphs 85 4. Annotation Example 86 5. Preliminary Inter-Annotator Agreement Results 88 6. Conclusion: Applications to HLT and HCI? 90 Appendix: Other Tools, Schemes and Methods of Gesture Analysis 91 References 95 5 97 On the Relationships among Speech, Gestures, and Object Manipulation in Virtual Environments: Initial Evidence Andrea Corradini and Philip R. Cohen 1. Introduction 97 2. Study 99 3. Data Analysis 101 4. Results 103 5. Discussion 106 6. Related Work 106 7. Future Work 108 8. Conclusions 108 Appendix: Questionnaire MYST III - EXILE 110 References 111 6 113 Analysing Multimodal Communication Patrick G. T. Healey, Marcus Colman and Mike Thirlwell 1. Introduction 113 2. Breakdown and Repair 117 3. Analysing Communicative Co-ordination 125 4. Discussion 126 References 127 7 131 Do Oral Messages Help Visual Search? Noëlle Carbonell and Suzanne Kieffer 1. Context and Motivation 131 2. Methodology and Experimental Set-Up 134 3. Results: Presentation and Discussion 141 4. Conclusion 153 References 154 Contents vii 8 159 Geometric and Statistical Approaches to Audiovisual Segmentation Trevor Darrell, John W. Fisher III, Kevin W. Wilson, and Michael R. Siracusa 1. Introduction 159 2. Related Work 160 3. Multimodal Multisensor Domain 162 4. Results 166 5. Single Multimodal Sensor Domain 167 6.

✦ Table of Contents

Natural and Multimodal Interactivity Engineering - Directions and Needs....Pages 1-19
Front Matter....Pages 21-21
Social Dialongue with Embodied Conversational Agents....Pages 23-54
A First Experiment in Engagement for Human-Robot Interaction in Hosting Activities....Pages 55-76
Front Matter....Pages 77-77
Form....Pages 79-95
On the Relationships Among Speech, Gestures, and Object Manipulation in Virtual Environments: Initial Evidence....Pages 97-112
Analysing Multimodal Communication....Pages 113-129
Do Oral Messages Help Visual Search?....Pages 131-157
Geometric and Statistical Approaches to Audiovisual Segmentation....Pages 159-180
Front Matter....Pages 181-181
The Psychology and Technology of Talking Heads: Applications in Language Learning....Pages 183-214
Effective Interaction with Talking Animated Agents an Dialogue Systems....Pages 215-243
Controlling the Gaze of Conversational Agents....Pages 245-262
Front Matter....Pages 263-263
Mind: A Context-Based Multimodal Interpretation Framework in Conversational Systems....Pages 265-285
A General Purpose Architecture for Intelligent Tutoring Systems....Pages 287-305
Miamm — A Multimodal Dialogue System Using Haptics....Pages 307-332
Adaptive Human-Computer Dialogue....Pages 333-354
Machine Learning Approaches to Human Dialogue Modelling....Pages 355-370

✦ Subjects

Computational Linguistics; System Performance and Evaluation; Multimedia Information Systems; User Interfaces and Human Computer Interaction; Artificial Intelligence (incl. Robotics)