Transportable Multi-Modal Interactive Device for the Dismounted Soldier

Technology Engineering Research Inc (TERI) proposes to build upon its success from its Phase I research to develop a Transportable Multi-Modal Interactive Device (TM2ID) that provides the Dismounted Soldier with enhanced Man-Machine Interface (MMI) operational capabilities to support OFW initiatives. The TERI TM2ID has developed and demonstrated advanced interface technologies that include the combined use of speech, head/eye-tracking, touch, gesture, display and 3-D audio response technologies without adding additional weight or bulky add-ons. The TM2ID provides a set of interactive sight and sound interfaces for high level commands and communications to conduct training, provide advanced situational awareness and to perform mission planning and rehearsal tasks. This Phase II research will result in a fully functional prototype of the TM2ID integrated with an OFW similar HW/SW platform. In order to support a higher level of soldier performance, these technologies will exploit Embedded Training (ET) as a means of soldier enhancement. The TERI developed Phase II prototype will be architectured to support the design research results from Phase I creating a combined human language and gesture interactive multi-modal interface capability that has proven to far exceed the capabilities of uni-modal interface designs. Our goal is to design and develop a multi-modal system with synergistic interface technologies that complement one another enabling us to take advantage of their inherent strengths. A design centered around supporting interface techniques for the core spoken language technology will enable us to demonstrate improvements in error avoidance and resolution which will increase the effectiveness and efficiency of the Warrior. The result will be a mobile and adaptable interface capability with improved robustness to support dismounted soldier embedded training and simulation environments in even the most challenging and chaotic environments.