TRAINS-96 System Evaluation.
ROCHESTER UNIV NY DEPT OF COMPUTER SCIENCE
Pagination or Media Count:
In this report we describe an experiment designed to 1 evaluate the performance of the TRAINS-96 system as a whole 2 examine the utility of a new robust post-parser module, recently added to the TRAINS system, and 3 explore the benefit to the user of receiving system feedback on speech input. The evaluation uses the same task-based methodology as was used for the TRAINS-95 evaluation, in which the user and computer cooperatively solve a given problem. Success is measured in terms of task performance measures such as time to completion of a task, and the quality of the final plan produced.