Eucalyptus: Integrating Natural Language Input with a Graphical User Interface
NAVAL RESEARCH LAB WASHINGTON DC
Pagination or Media Count:
This report describes Eucalyptus, a natural language NL interface that has been integrated with the graphical user interface of the KOALAS Test Planning Tool, a simulated Naval air combat command system. The multimodal, multimedia interface handles both imperative commands and database queries either typed or spoken into a microphone while still allowing full use of the original graphical interface. In this way the precision and consistency of direct manipulation is balanced and augmented by the descriptive power and reduced redundancy of NL. The two input media used together yield such powerful interaction techniques as deixis simultaneous speech and pointing and the ability to use mouse clicks and verbal referring expressions interchangeably. Finally, the systems discourse handling capability allows abbreviated NL follow-ups anaphora and ellipsis to receive full interpretations based on the prior interaction context, whether verbal or graphical. Natural language processing, Human-computer interface, Speech recognition.
- Computer Programming and Software