A Head-Coupled Visual and Aural Sensor System for Teleoperated Rotorcraft Research Vehicle

Inside Out vs Outside In! It seems reasonable to hypothesize that the pilot of an air vehicle will feel more in harmony with the actions of his vehicle when he is at the relative "origin" of the coordinate frame of reference of that vehicle ... and will respond more quickly and with greater accuracy, precision, and efficiency. Experience teaches that this occurs for a piot when utilizing an "inside-out" configuration of cues which square with his physicological sensations. Our goal is to supply those cues utilizing the visual and aural stimulii acquired by appropriate placement of a stereo camera and directional microphone array. A customized version of Polhemus Laboratories binocular, color, high resolution, head-worn display (Looking Glass) system, modified to include a six DOF head tracker and stereo audio system will be provided as the key components of the forthcoming FFRRV ground-based Virtual Cockpit. A PLI Eyeglass display was delivered to NASA-ARC on 16 June '92 for integration with teleoperated camera platforms mounted on an unmanned vehicle. The head tracker (there are three candidates) will supply orientation commands to cameras moundted in the FFRRV, and will be an interactive component in the isolation or confirmation of significant aural cues. an interactive component in the isolation