Helmet-Mounted Display ASsessment System for the Evaluation of eSsential Skills

ABSTRACT: Under this Phase II effort, Design Interactive (DI) proposes the development of the Helmet-Mounted Display ASsessment System for the Evaluation of eSsential Skills (HMD-ASSESS), which will incorporate [neuro] physiological sensor technology with traditional behavioral and system-collected metrics to better understand how a pilot interacts with data presented in the HMD, including reactions and actions taken based on the data provided. This comprehensive, objective understanding of pilot interactions will be used to measure and diagnose pilot deficiencies/ inefficiencies, and can be used to dynamically monitor pilot performance, provide training evaluations and assessments of pilot proficiency, and populate targeted AARs/debriefings to enhance understanding of pilot errors and related root cause(s). Such an innovative measurement and diagnostic solution will substantially improve pilot performance assessment during initial and sustainment training by quantitatively evaluating visual scan and search tasks associated with HMD-presented information. Such innovative metrics will peer into the"mind of the pilots", thereby providing the capability to monitor traditionally"unobservable"performance related to perceptual and cognitive aspects of piloting. BENEFIT: The HMD ASSESS tool is hypothesized to lead to significant increases in the training effectiveness and efficiency of simulation based training. Specifically, the HMD ASSESS approach will lead to significant increases in diagnosis of trainee knowledge, skills, abilities which will facilitate smarter interventions to optimally tailor scenarios and feedback to the trainee"s progress. The expected benefits of HMD ASSESS are: Decreased Training Time: Training is accelerated and compressed as HMD ASSESS detects traditionally unobservable perceptual and cognitive performance deficiencies such as inefficient scan and high workload, allowing an instructor to more effectively target deficiencies in debrief and future training Improved Training: Trainees reach higher levels of performance as feedback is tailored to trainee specific decrements at a very granular level effectively remediating required knowledge and skill decrements and leading to Warfighters being better prepared for live training and operations.