Accession Number : ADA308044

Title :   Eye/Voice Mission Planning Interface (EVMPI).

Descriptive Note : Final rept. 12 May-11 Dec 95,

Corporate Author : SYNTHETIC ENVIRONMENTS INC MCLEAN VA

Personal Author(s) : Hatfield, Franz ; Jenkins, Eric A. ; Jennings, Michael W.

PDF Url : ADA308044

Report Date : DEC 1995

Pagination or Media Count : 113

Abstract : Pilots and other crew station operators need better ways of interacting with their systems, including more efficient human-machine dialog and better physical interface devices and interaction techniques. The goal of the Eye/Voice Mission Planning Interface (EVMPI) research is to integrate voice recognition and eye-tracking technology with aviation displays in order to reduce pilot cognitive and manual workload. The EVMPI technology allows an operator to gaze on user interface items of interest and issue verbal commands/queries that can be interpreted by the system, thus permitting hands-free operation of cockpit displays. This report describes the concept for the EVMPI, general principles for integrating eye and voice input, an EVMPI architecture, and the user interface implementation and evaluation of several aviation mission planning tasks. A primary benefit that arises from the integration of multiple input modalities to infer user intent is that robust performance can be obtained, even when the component technologies (eye and voice) are imperfect. This reduces the accuracy requirements on the individual technologies. GOMS models for eye/voice and conventional throttle/stick interaction protocols were developed for a select set of operator tasks. A preliminary comparison reveals that eye/voice interaction can significantly reduce the total number of operations that need to be performed in particular tasks. Additional empirical research is required to substantiate these findings and to generalize the results to broad classes of operator tasks.

Descriptors :   *COCKPITS, *FLIGHT CREWS, *PILOTS, *TRACKING, *SPEECH RECOGNITION, *EYE, *DATA DISPLAYS, *MAN MACHINE SYSTEMS, INPUT, REQUIREMENTS, INTERACTIONS, MISSION PROFILES, COGNITION, ACCURACY, EFFICIENCY, AERONAUTICS, INTEGRATION, USER NEEDS, MANUAL OPERATION, WORKLOAD, VOICE COMMUNICATIONS.

Subject Categories : Military Aircraft Operations
      Human Factors Engineering & Man Machine System
      Voice Communications

Distribution Statement : APPROVED FOR PUBLIC RELEASE