Multimodal Interaction with W3C Standards: Toward Natural User Interfaces to Everything

✍ Scribed by Deborah A. Dahl (eds.)

• Publisher: Springer International Publishing
• Year: 2017
• Tongue: English
• Leaves: 430
• Edition: 1
• Category: Library

✦ Synopsis

This book presents new standards for multimodal interaction published by the W3C and other standards bodies in straightforward and accessible language, while also illustrating the standards in operation through case studies and chapters on innovative implementations. The book illustrates how, as smart technology becomes ubiquitous, and appears in more and more different shapes and sizes, vendor-specific approaches to multimodal interaction become impractical, motivating the need for standards. This book covers standards for voice, emotion, natural language understanding, dialog, and multimodal architectures. The book describes the standards in a practical manner, making them accessible to developers, students, and researchers.

• Comprehensive resource that explains the W3C standards for multimodal interaction clear and straightforward way;
  
• Includes case studies of the use of the standards on a wide variety of devices, including mobile devices, tablets, wearables and robots, in applications such as assisted living, language learning, and health care;
  
• Features illustrative examples of implementations that use the standards, to help spark innovative ideas for future applications.

✦ Table of Contents

Front Matter....Pages i-xxix
Front Matter....Pages 1-1
Introduction to the Multimodal Architecture Specification....Pages 3-17
The Role and Importance of Speech Standards....Pages 19-36
Extensible Multimodal Annotation for Intelligent Interactive Systems....Pages 37-64
EmotionML....Pages 65-80
Introduction to SCXML....Pages 81-107
Dialogue Act Annotation with the ISO 24617-2 Standard....Pages 109-135
Six-Layered Model for Multimodal Interaction Systems....Pages 137-153
WebRTC: Handling Media on the Web....Pages 155-169
Front Matter....Pages 171-171
Developing Portable Context-Aware Multimodal Applications for Connected Devices Using the W3C Multimodal Architecture....Pages 173-211
SCXML on Resource Constrained Devices....Pages 213-255
Standard Portals for Intelligent Services....Pages 257-269
Applications of the Multimodal Interaction Architecture in Ambient Assisted Living....Pages 271-291
Front Matter....Pages 293-293
Assembling the Jigsaw: How Multiple Open Standards Are Synergistically Combined in the HALEF Multimodal Dialog System....Pages 295-310
A Case Study of Audio Alignment for Multimedia Language Learning: Applications of SRGS and EMMA in Colibro Publishing....Pages 311-321
Front Matter....Pages 323-323
Discovery and Registration: Finding and Integrating Components into Dynamic Systems....Pages 325-349
Multimodal Interactivity in Foreign Language Testing....Pages 351-365
Multi-Device Applications Using the Multimodal Architecture....Pages 367-383
Multimodal Interaction Description Language Based on Data Modeling....Pages 385-392
Multimodal Fusion and Fission within the W3C MMI Architectural Pattern....Pages 393-415
Back Matter....Pages 417-422

✦ Subjects

Signal, Image and Speech Processing;Electronics and Microelectronics, Instrumentation;User Interfaces and Human Computer Interaction;Image Processing and Computer Vision;Information Systems Applications (incl. Internet)