Rapid Simulation Development Processes and Tools for Job Performance Assessment

Job performance measurement is of critical importance to any organization’s health. It is important not only to recognize and reward good performance, but also to groom future leaders. Developing effective assessment techniques that are valid, effective and fair is an ongoing challenge. Assessing factual knowledge using multiple-choice test batteries is relatively inexpensive and tends to be commonly used. Hands-on assessment is the most effective in assessing task proficiency but is very resource intensive and expensive. Computer-based simulations provide an alternative where users can be assessed in the context of skill application under controlled conditions. However, simulations are expensive to produce and maintain. Validated guidelines and methodologies are needed to help organizations develop effective assessment simulations. Rapid simulation development tools are needed to reduce costs. This proposal addresses both these challenges. We propose to develop a standard, prescriptive methodology for developing assessment simulations. Using our existing products as a basis, we also propose to develop rapid simulation-development tools that make this solution cost-effective. This tool will enable organizations to create and administer assessment simulations and integrate the data with their employee managements systems. Phase I will result in a prototype methodology, a prototype simulation, and a validation of both these products.