Software Tools that Control a Framework of Perceptual Interfaces and Visual Display Systems for Human-System Interaction with Robotic and Autonomous Systems

Turbogizmo, LLC will develop new software technology for Human-System Interaction (HSI) for NASA that increases performance and reduces the risk of conducting manned exploration missions. This HSI technology combines intelligent software agents, decision support systems and perceptual interfaces to facilitate human collaboration with robotic and autonomous systems while supporting the use of augmented cognition models. This will provide the optimal configuration of multi-modal user interfaces to improve performance and safety during critical mission operations. Future exploration missions will involve greater information availability for crewmembers and enhancements to EVA systems will provide visual information for situational awareness. HSI technology that manages the exchange of information between Human and Robotic or Autonomous systems using augmented cognition models will result in reduced cognitive load caused by inappropriate information while minimizing the effort required when interacting with autonomous systems. Turbogizmo proposes to develop a service-based architecture for configuring a suite of multi-modal HCI technologies based on operational scenarios, evaluation of perceptual interfaces with cost/value propositions for interface configurations. This framework will be validated by experimentation and demonstration This technology will close a critical technology gap by enabling improved interaction for exploration crewmembers performing routine and contingency operations.