✍ Scribed by R López-Cózar; A De la Torre; J.C Segura; A.J Rubio; V Sánchez
No coin nor oath required. For personal study only.
This paper presents a novel technique that allows testing spoken dialogue systems by means of an automatic generation of conversations. The technique permits to easily test spoken dialogue systems under a variety of lab-simulated conditions, as it is easy to vary or change the utterance corpus used to check the performance of the system. The technique is based on the use of a module called user simulator whose purpose is to behave as real users when they interact with dialogue systems. The behaviour of the simulator is decided by means of diverse scenarios that represent the goals of the users. The simulator aim is to achieve the goals set in the scenarios during the interaction with the dialogue system. We have applied the technique to test a dialogue system developed in our lab. The test has been carried out considering different levels of white and babble noise as well as a VTS noise compensation technique. The results prove that the dialogue system performance is worse under the babble noise conditions. The VTS technique has been effective when dealing with noisy utterances and has lead to better experimental results, particularly for the white noise. The technique has permitted to detect problems in the dialogue strategies employed to handle confirmation turns and recognition errors, suggesting that these strategies must be improved.
📜 SIMILAR VOLUMES
The basic method to evaluate the solar collectors thermal behaviour is characterized by a general test method, that is testing of flat plate collectors efficiency under nearly steady state conditions while it might be impossible to guarantee steady state conditions for solar water heater systems ins