Evaluation of Text and Speech Systems

✍ Scribed by Sadaoki Furui (auth.), Professor Laila Dybkjær, Holmer Hemsen, Professor Wolfgang Minker (eds.)

• Publisher: Springer Netherlands
• Year: 2007
• Tongue: English
• Leaves: 305
• Series: Text, Speech and Language Technology 37
• Edition: 1
• Category: Library

✦ Synopsis

In its nine chapters, this book provides an overview of the state-of-the-art and best practice in several sub-fields of evaluation of text and speech systems and components. The evaluation aspects covered include speech and speaker recognition, speech synthesis, animated talking agents, part-of-speech tagging, parsing, and natural language software like machine translation, information retrieval, question answering, spoken dialogue systems, data resources, and annotation schemes. With its broad coverage and original contributions this book is unique in the field of evaluation of speech and language technology.

This book is of particular relevance to advanced undergraduate students, PhD students, academic and industrial researchers, and practitioners.

✦ Table of Contents

Front Matter....Pages i-xxiii
Speech and Speaker Recognition Evaluation....Pages 1-27
Evaluation of Speech Synthesis....Pages 29-64
Modelling and Evaluating Verbal and Non-Verbal Communication in Talking Animated Interface Agents....Pages 65-98
Evaluating Part-of-Speech Tagging and Parsing Patrick Paroubek....Pages 99-124
General Principles of User-Oriented Evaluation Margaret King....Pages 125-161
An Overview of Evaluation Methods in TREC Ad Hoc Information Retrieval and TREC Question Answering....Pages 163-186
Spoken Dialogue Systems Evaluation....Pages 187-219
Linguistic Resources, Development, and Evaluation of Text and Speech Systems....Pages 221-261
Towards International Standards for Language Resources Nancy Ide and Laurent Romary....Pages 263-284
Back Matter....Pages 285-288

✦ Subjects

Computational Linguistics; User Interfaces and Human Computer Interaction