Knowledge Assessment System for Evaluating Performance in Dynamic Environments

The Air Force Research Laboratory has identified the need for an interactive knowledge assessment tools that provide realistic vignette examples to support performance assessment in Distributed Mission Operations (DMO). Assessments of improvements and gaps in Mission Essential Competencies (MEC) Knowledge and Skills are used to evaluate DMO training effectiveness and guide training decisions. Micro Analysis & Design, Inc. and Lumir Research Institute, Inc., have proposed to conduct innovative research and development to provide a software tool that supports and augments DMO training by providing psychometrically valid assessments of an individual’s mission essential knowledge as a result of performance during DMO training. The proposed approach will leverage and extend current knowledge assessment methodologies and provide realistic vignettes with targeted mission element examples to evaluate the individual’s application of specific MEC knowledge elements during situation assessment and decision making performance. A Phase I proof of concept demonstration will be developed for an Air Weapons Controller mission. The level of fidelity of the assessment environment will address a need for realistic continuation training for Air Weapons Controllers. Proposed enhancements include functionality to support: distributed assessment via Internet/SIPRNET, authoring of assessment vignettes/items, feedback for mission element rehearsal, and adaptive sequencing for diagnostic assessment.