Hands-Free or Limited-Manipulation Language Translation Tools for Non-Linguist Soldiers

The overall objective of this research is to design and build a portable and hands-free multimodal Arabic-English translation system that can utilize both verbal and non-verbal information and scenarios to facilitate communication between soldiers and Arab coalition partners as well as native Arabic speaking civilians. The specific objectives of the phase I research are to (1) review all currently available and near future prototype commercial off the shelf and government off the shelf language translation tools, as well as any multimodal technology that aids in limiting the need for hands-on manipulation in computing (including interface design, speech recognition and input control ergonomics), (2) explore the possibility and feasibility of developing scenario-based picture language and animations that can be used to communicate with minimal manipulation or hands-free interfaces, and (3) develop a design specification for a set of language translation tools that will allow limited but mission critical language translation for up to 3 operational scenarios. In Phase II, the development and testing of a prototype system in a realistic simulated environment will be undertaken.