Computational Modeling of Multimodal I/O in Simulated Cockpits
Final rept. 1 Jun 1996-30 Dec 2000
MICHIGAN UNIV ANN ARBOR DIV OF RESEARCH DEVELOPMENT AND ADMINISTRATION
Pagination or Media Count:
This report summarizes the results of a project on modeling the effects of localized 3-D sound to facilitate performance in a complex cockpit-like dual task. This task that had been previously observed to produce a significant automation deficit effect when one of the tasks has to be resumed at short notice, the human operator takes some time to catch up and reach the normal steady-state level of performance in the task, apparently because it takes visual search and inspection to identify the proper object on the display to process. Providing a localized sound cue to identify the proper object alleviates the automation deficit effect to some extent. Constructing computational cognitive models that include representation of the perceptual-motor systems underlying performance showed that the benefit appears to be due to low-level orienting reflex eye movements rather than high-level strategic use of the sound information.