User Interaction Tools Supporting Collaborative Applications in Immersive Virtual Environments

SYTRONICS proposes an innovative dual-mode speech recognition technique, combining both command/control and dictation modes for easy navigation of menus and environments, enabling natural interactions, and capturing auxiliary data in the collaborativesession within the CAVE Automatic Virtual Environment (CAVE) virtual environment. The Phase I work will show the feasibility of using two speech recognition engines together on one PC and seamlessly switching between command/control and dictation modes,and show the feasibility of processing speech on a separate PC platform linked to the UNIX-based CAVE systems. The experimental Dual-mode, Advanced Speech Harness (DASH) system will be installed in the CAVE in Phase I, making it immediately available forexperimental speech work. The Phase I Objectives will be to define the operational, performance, integration, and testing requirements for DASH; prepare a preliminary design to define the experimental prototype configuration and to prepare for Phase II;develop, test, and evaluate an experimental prototype; and assess commercialization potential, defining markets, and obtaining customers and commercialization partners. The Phase I results will be the requirements, the preliminary design andspecifications for Phase II, the DASH demonstrable prototype installed in the CAVE, and a quantified feasibility assessment based on experimental results and analyses.DASH speech control can replace conventional systems or be used as a supplement tostandard manual input devices in myriad Government and commercial applications. The combined potential of conventional and evolving speech controls can be exploited to provide a variety of new channels for controlling electronic devices. DASH can supportusers in space operations, field medicine (military and civilian paramedic), biological and chemical hazards, quality/control inspection, aircraft or automobile maintenance, rehabilitative engineering, and numerous other fields.