Hands-Free and Heads-Up Control of Unmanned Ground Vehicles

Think-A-Move"s (TAM"s) Phase II proposal will create a hands-free and heads-up control system for Unmanned Ground Vehicles (UGVs). TAM will build upon the Phase I work by (1) developing and implementing a robust algorithm for spotting spoken commands that will enable the UGV Operator to give speech commands to the UGV completely hands-free, (2) enhancing the performance of TAM"s SPEAR speech recognition system [12] in stressful battlefield conditions, and (3) enhancing two sub-vocal control modes that were developed in Phase I - whisper speech and teeth clicks to make them more robust to noise. TAM will partner with Autonomous Solutions, Inc. (ASI) so that the Operator can drive a UGV, with a high level of fidelity, to a location selected by the Operator by using hands-free commands in conjunction with image segmentation and video overlays. In addition, Rockwell Collins will provide soldier worn video display systems that were assessed in Phase I. The proposed Phase II effort will culminate in a demonstration of a hands-free, heads-up system, implemented on a PackBot, that will enable the Operator have a high level of fidelity for control of the system while maintaining his situational awareness.