๐”– Bobbio Scriptorium
โœฆ   LIBER   โœฆ

Evaluation in the context of natural language generation

โœ Scribed by C Mellish; R Dale


Publisher
Elsevier Science
Year
1998
Tongue
English
Weight
184 KB
Volume
12
Category
Article
ISSN
0885-2308

No coin nor oath required. For personal study only.

โœฆ Synopsis


What role should evaluation play in the development of natural language generation (๏ฎ๏ฌ๏ง) techniques and systems? In this paper we describe what is involved in natural language generation, and survey how evaluation has figured in work in this area to date. We comment on the issues raised by this existing work and on how the problems of ๏ฎ๏ฌ๏ง evaluation are different from the problems of evaluating work in natural language understanding. The paper is concluded by suggesting a way forward by looking more closely at the component problems that are addressed in natural language generation research; a particular text generation application is examined and the issues that are raised in assessing its performance on a variety of dimensions are looked at.


๐Ÿ“œ SIMILAR VOLUMES


The Set of Minimal Words of a Context-fr
โœ Jean Berstel; L. Boasson ๐Ÿ“‚ Article ๐Ÿ“… 1997 ๐Ÿ› Elsevier Science ๐ŸŒ English โš– 360 KB

Let A be a finite, totally ordered alphabet, and let P be the lexicographic ordering on A\*. Let X be a subset of A\*. The language of minimal words of X is the subset of X composed of the lexicographically minimal word of X for each length: The aim of this paper is to prove that if L is a context-

The Role of Contrast Categories in Natur
โœ Timothy Verbeemen; Veerle Vanoverberghe; Gert Storms; Wim Ruts ๐Ÿ“‚ Article ๐Ÿ“… 2001 ๐Ÿ› Elsevier Science ๐ŸŒ English โš– 139 KB

In this paper, seven experiments are described in which the effect of contrast categories on the within-category structure of superordinate and basic level natural language concepts was studied. Intension-based and extensionbased predictors originating from both the target category and a contrast ca

Advances in natural language call routin
โœ Hong-Kwang J. Kuo; Olivier Siohan; Joseph P. Olive ๐Ÿ“‚ Article ๐Ÿ“… 2003 ๐Ÿ› Institute of Electrical and Electronics Engineers ๐ŸŒ English โš– 179 KB

This paper describes Bell Labs' efforts in developing core technologies toward natural language call routing (NLCR) applications. NLCR refers to technology allowing callers of a call center to be automatically routed to their desired destination based on natural spoken responses to an open-ended pro

An evaluation of strategies for selectiv
โœ RONNIE W. SMITH ๐Ÿ“‚ Article ๐Ÿ“… 1998 ๐Ÿ› Elsevier Science ๐ŸŒ English โš– 299 KB

As with human-human interaction, spoken human-computer dialog will contain situations where there is miscommunication. One natural strategy for reducing the impact of miscommunication is selective verification of the user utterance meanings. This paper reports on both context-independent and context