Ecological Gesturing Ontology (EGO)

Intelligence from strategic areas of interest comes from numerous sources, such as Unmanned Aerial Vehicles (UAVs) and Rapid Aerostat Initial Deployment (RAID) cameras, and in various formats, such as imagery, video, audio, and text. Searching through the information for analysis can be challenging, particularly when the intelligence analyst is not co-located within the conflict area. Design Interactive, Inc., along with the Electrical Engineering and Computer Science (EECS) group at the University of Central Florida, proposes the Ecological Gesturing Ontology (EGO), a primarily naturalistic gesture-based control interface for fully-immersive, synthetically-augmented displays. EGO allows the teleworking intelligence analyst to stand within a fully-immersive synthetically-augmented environment and, through ecologically designed naturalistic gesturing and vocal commands, purposefully investigate integrated intelligence data within the environment by exploring, searching for, finding, and reviewing sensor data. Further, the naturalistic human-machine interaction will incorporate a graphical interface that enables efficient interaction with and transitions between various modes of information presentation GEOINT, HUMINT, SIGINT, etc. EGO shall be the first naturalistic human machine interface design to support the best practices of multimodal information presentation across multiple interaction modalities that will increase presence, decrease workload, and support decision-making.