Development of the d-THREE Electronic Toolkit (d3ET)

ABSTRACT: An opportunity exists to develop methodologies and tools to objectively assess the overall training effectiveness of a simulation and pinpoint specific system characteristics such as fidelity and training strategy support (e.g., measurement technology, feedback methods, etc.) which contribute to the training effectiveness or lack thereof. To address this, Design Interactive (DI) proposes to develop the d-THREE Electronic Toolkit (d3ET), a Training Effectiveness Evaluation (TEE) software support tool which allows users to: 1) determine how well existing simulators are addressing training objectives, 2) diagnose specific system characteristics (e.g., fidelity specifications, training strategy support) which impact training effectiveness, 3) develop recommendations for system certification (e.g., maintain, improve or decertify system), and 4) compare training effectiveness of different systems to determine the most cost effective system to train target objectives. The d3ET achieves this utilizing a hierarchical approach that focuses on performance-outcome requirements and has three levels of inquiry that lead to a comprehensive assessment of a system"s training effectiveness, including Cue Fidelity Evaluation, Training Performance Evaluation and Training Transfer Evaluation. The d3ET will facilitate a less resource intensive and more objective evaluation of training systems which is flexible enough to be performed anytime in the training system life cycle (design to deployment). BENEFIT: The d3ET software support tool has the potential to lead to significant benefits with respect to cost, schedule and performance. Specifically, d3ET has the potential to reduce costs by reducing the resources necessary to conduct a TEE and reducing training system costs by identifying most cost effective training system(s) to meet training objectives. d3ET has the potential to reduce schedule impacts by reducing the time it takes to conduct a TEE and the decision time for training system certification by providing objective and quantifiable metrics of training effectiveness. Finally, d3ET has the potential to improve performance through an increase in Training and Readiness Levels by increasing the quality of training simulators and thus opportunities for learning to occur while decreasing training time by eliminating simulation training which does not lead to significant gains in transfer performance.