Human Systems/Subsystems Research

Mission planning system operators need better ways of interacting with their systems. This includes more efficient man-machine dialog and better physical interface devices and interaction techniques. The proposed research effort will result in the development of the Multi-Model Mission Planning System Interface (M3PI). This system will integrate voice recognition and eye-tracking as a separable component that can be fully integrated with existing and future mission planning systems. The Phase I effort will produce a system design and a demonstration of integrated voice/eye interaction for a mission planning problem as well as a full development plan for both ground-based and airborne (in cockpit) M3PI systems. The Phase II effort will develop the M3PI on a UNIX workstation and will interface to a ground-based mission planning system. Further development (e.g., during Phase III) will be oriented toward extending the functionality of the M3PI to enable airborne real-time mission planning and replanning support, developing a portable voice/eye interaction application programming interface (API), and re-packaging the system for delivery as a workstation/PC add-in board. This voice/eye system can be used in a wide variety of applications that emphasize use of emerging non-command-based interaction such as virtual reality and agent-based user interfaces. Moreover, the technology will augment conventional command-based HCI technologies that support hands-busy applications and applications for the physically challenged.