Estimating Spoken Dialog System Quality with User Models

✍ Scribed by Klaus-Peter Engelbrecht (auth.)

Publisher: Springer-Verlag Berlin Heidelberg
Year: 2013
Tongue: English
Leaves: 135
Series: T-Labs Series in Telecommunication Services
Edition: 1
Category: Library

No coin nor oath required. For personal study only.

✦ Synopsis

Spoken dialog systems have the potential to offer highly intuitive user interfaces, as they allow systems to be controlled using natural language. However, the complexity inherent in natural language dialogs means that careful testing of the system must be carried out from the very beginning of the design process. This book examines how user models can be used to support such early evaluations in two ways: by running simulations of dialogs, and by estimating the quality judgments of users. First, a design environment supporting the creation of dialog flows, the simulation of dialogs, and the analysis of the simulated data is proposed. How the quality of user simulations may be quantified with respect to their suitability for both formative and summative evaluation is then discussed. The remainder of the book is dedicated to the problem of predicting quality judgments of users based on interaction data. New modeling approaches are presented, which process the dialogs as sequences, and which allow knowledge about the judgment behavior of users to be incorporated into predictions. All proposed methods are validated with example evaluation studies.

✦ Table of Contents

Front Matter....Pages i-xiv
Introduction....Pages 1-8
MeMo: Usability Workbench....Pages 9-20
Evaluation of the MeMo User Simulation—Use Case Inspire Smart Home System....Pages 21-40
Detection of Usability Problems Using an Ad-Hoc User Simulation....Pages 41-60
Prediction of User Judgments....Pages 61-85
Application of Prediction Models in a Realistic Usage Scenario....Pages 87-100
Conclusions and Future Work....Pages 101-108
Back Matter....Pages 109-127

✦ Subjects

Signal, Image and Speech Processing; User Interfaces and Human Computer Interaction; Engineering Acoustics; Communications Engineering, Networks

📜 SIMILAR VOLUMES

User Models in Dialog Systems

📁 User Models in Dialog Systems

✍ Wolfgang Wahlster, Alfred Kobsa (auth.), Alfred Kobsa, Wolfgang Wahlster (eds.) 📂 Library 📅 1989 🏛 Springer-Verlag Berlin Heidelberg 🌐 English

User models have recently attracted much research interest in the field of artificial intelligence dialog systems. It has become evident that flexible user-oriented dialog behavior of such systems can be achieved only if the system has access to a model of the user containing assumptions about hi

Quality of Telephone-Based Spoken Dialog

📁 Quality of Telephone-Based Spoken Dialogue Systems

✍ Sebastian Möller (auth.) 📂 Library 📅 2005 🏛 Springer US 🌐 English

Quality of Telephone-Based Spoken Dialogue Systems is a systematic overview of assessment, evaluation, and prediction methods for the quality of services such as travel and touristic information, phone-directory and messaging, or telephone-banking services. A new taxonomy of quality-of-service

Quality of Telephone-Based Spoken Dialog

📁 Quality of Telephone-Based Spoken Dialogue Systems

✍ Moller S. 📂 Library 📅 2005 🌐 English

"Quality of Telephone-Based Spoken Dialogue Systems is a systematic overview of assessment, evaluation, and prediction methods for the quality of services such as travel and touristic information, phone-directory and messaging, or telephone-banking services. A new taxonomy of quality-of-service is p

Modeling Users' Experiences with Interac

📁 Modeling Users' Experiences with Interactive Systems

✍ Evangelos Karapanos (auth.) 📂 Library 📅 2013 🏛 Springer-Verlag Berlin Heidelberg 🌐 English

Over the past decade the field of Human-Computer Interaction has evolved from the study of the usability of interactive products towards a more holistic understanding of how they may mediate desired human experiences. This book identifies the notion of diversity in usersʼ experiences wi

Modeling Users' Experiences with Interac

📁 Modeling Users' Experiences with Interactive Systems

✍ Evangelos Karapanos 📂 Library 📅 2012 🏛 Springer 🌐 English

Over the past decade the field of Human-Computer Interaction has evolved from the study of the usability of interactive products towards a more holistic understanding of how they may mediate desired human experiences. This book identifies the notion of diversity in usersʼ experiences with

Practical Spoken Dialog Systems

📁 Practical Spoken Dialog Systems

✍ Suzanne Liebowitz Taylor (auth.), Deborah Dahl (eds.) 📂 Library 📅 2004 🏛 Springer Netherlands 🌐 English

For professional speech researchers, there is a rich technical literature covering many years of primary research in speech. However, this literature is not necessarily applicable to the needs of business people, application developers, and students who are interested in learning about the pra