3D HMD Applications for improving performance and Warfighter Knowledge (3D-HAWK)

ABSTRACT: In a growing number of current and near-future Air Force mission contexts, Head and Helmet Mounted Displays (HMDs) are providing critical information for pilots and warfighters. The recent availability of stereoscopic HMD technology provides an additional visual dimension to reduce clutter or call attention to time-critical information. To demonstrate the potential efficacy of this technology, we propose to design and demonstrate 3D HMD Applications for improving performance and Warfighter Knowledge (3D-HAWK). Four components characterize our approach. First, we will conduct a holistic analysis with fighter pilots resulting in a breakdown of tasks and perceptual constraints. Second, we will develop guidance and techniques for proof-of-concept displays linking known perceptual mechanisms to appropriate perceptual and cognitive tasks. Third, we will develop a toolkit for the rapid design and evaluation of simulated displays. Fourth, we will create a preliminary evaluation plan that combines perceptual and cognitive perspectives to test the efficacy of design concepts. The resulting information displays developed under the 3D-HAWK approach will reduce the potential for display clutter and allow pilots to efficiently see and effectively understand the complex information provided by the new sensor integration capabilities of the F-35 Mission System environment. BENEFIT: Initially, we will focus on transitioning 3D-HAWK to HMDs under development for the F-35 variants within the U.S. Air Force and other Armed Forces. The underlying information display design principles will also be applicable for guiding effective 3D HMD use in supervising remotely-piloted aircraft as well as augmented display devices for cyber operators. In addition, we see significant promise in the commercial application of novel 3D stereo displays; we therefore plan to transition into specific enhancements to our DRIVE visualization toolkit to increase its adaptability and suitability for HMD and cockpit display prototyping in commercial aviation, as well as in the entertainment industry.