Data Integration for Validation of Effectiveness of Systems -(DIVES)

The U.S. Navy is taking advantage of the revolution in information technology to support rapid evolution of its command and control systems. Along with the ability to rapidly reconfigure displays and controls comes the need to rigorously evaluate the effectiveness of new human-machine interface designs. This evaluation must produce information not only on the usability of designs but also on their effectiveness in supporting mission success. Successful measurement of total system effectiveness results from the combination of (1) a model or theory that guides what is to be measured; (2) a thorough understanding of the environment in which measurement is to take place; and (3) the combination of measures from three different sources: observers, systems, and the warfighters themselves. This integrated picture facilitates the diagnosis of total system performance and usability issues, which is necessary for enhancing warfighter performance through improved system design. DIVES, the envisioned product of this SBIR, is a unique tool that will integrate data from various sources on operator use of command and control technologies. DIVES will provide insights into performance and usability issues by providing an easy-to-use tool for analyzing the integrated data to create a coherent and understandable set of specifications for system redesign.