Intelligent Advisor for Multi-Modal Human-Computer Interface (HCI) Design

"Recent advances in multi-modal technologies are now sufficiently mature to be embedded in future multi-modal interfaces. The question remains as to how designers can use this technology to provide a more intuitive interface that will allow users toprocess information more quickly, build a better state of situation awareness, and make better decisions. A large amount of research has been conducted to understand human thought and information processing capabilities in order to design effectivedisplays that are engaging and easy to use. However, it is ultimately the responsibility of designers to be aware of and understand the implications of this research. The primary objective for Phase I is to develop an innovative approach for providinginterface design support. Our first task will be to examine methods (e.g., task analysis, simulation modeling, artificial intelligence) to include in the Multi-modal Interface Design Advisor (MIDA). The second task will be to research theories regardinghuman-computer interaction (HCI). Then we will review different display technologies and collect interface guidance information with a deliberate focus on multi-modal interactions. The fourth task will be to understand the issues involved in developingMIDA. Finally, we will design sample prototype interfaces that demonstrate our approach. This project will provide the Navy with an approach for developing a tool that can support upgrades to the