Knowledge Assessment System for Evaluating Performance in Dynamic Environments

The Air Force Research Laboratory has identified the need for a software tool that supports and augments Distributed Mission Operations (DMO) training by providing psychometrically valid assessments of an individual’s mission essential knowledge as a result of performance during DMO training sessions. The problem is specifically focused on the need for realistic continuation training for Air Weapons Controllers, because they play a supporting role in DMO training missions with pilots and therefore have little opportunity for repetition of specific mission elements. The Air Weapons Controller’s job is very knowledge based and includes situation assessment in dynamic, information-dense environments that requires multitasking, complex perceptual and cognitive tasks, ill defined problems and also involves significant teamwork, communication and coordination. This effort will result in a set of knowledge assessment tools that provide a high level of fidelity and ecological validity of the environment and support rehearsal of situation assessment and decision making skills and will allow for repetition of specific mission elements. These tools will use recordings of actual displays, playback of actual DMO missions, and playback of actual team communications to achieve these goals.