Multi-dimensional, User-oriented Synthetic Environment (MuUSE): A Standard Interface Toolset System for Improving Air Force C4I Tasks

We propose a standard software system that enables a natural, intuitive interface between computer operators and their data, for improving and increasing the capability of Air Force C4I systems. Specifically, the tasks addressed here are: (1) multi-dimensional map displays for interactive planning tools; (2) new tools for modernization of base-level business processes; and (3) improved human interfaces for airborne radar.The proposed interface system will be based on the proven functionality of the Multi-dimensional, User-oriented Synthetic Environment, MuUSE. MuUSE has already demonstrated its utility in transforming many kinds of data into 3D, time-based representations--including digital terrain data, map data, CAD, MRI, oil reservoir data and applications programs--while simultaneously displaying text, photographs and video, and data sonification. These advanced capabilities allow operators to access, process, manipulate and integrate CAD data, programs, models and simulations, by using natural body motion, head tracking, voice commands and synthesized speech. A wrap-around synthetic environment shell that is both hardware and software independent, MuUSE is designed for real-time operations, and supports simultaneous heterogeneous environments, e.g., flat screen displays, VR displays, audio and haptic devices.