HASTE: Human and Autonomous Systems Team Evaluation

As mixed human/agent/robot teams become more prevalent throughout civilian and defense applications, proper testing and evaluation of team performance becomes increasingly essential. Several challenges remain to understanding how to evaluate such teams. To address these problems, Aptima and our partners propose to design and develop HASTE (Human and Autonomous Systems Team Evaluation) an innovative approach for measuring and evaluating mixed human/agent/robot teams. HASTE addresses the key problems with current evaluation methodologies by supporting team interdependence, evaluating teams based on both task performance and team processes, and generalizing across domains, platforms, and team compositions. Phase I work will include the development of a prototype tool for testing and evaluation that will: (1) analyze performance of a given human/agent/robot team for a specific task; (2) suggest the best team composition for that specific task; and (3) recommend refinements to the ways team members collaborate.