Natural Dialogue based Gesture Recognition for Unmanned Aerial System Carrier Deck Operations

"Remotely sensed data has an inherent physical detachment from the environment being sensed. At a high-level, we propose leveraging Oblong Industries"revolutionary g-speak platform to restore fully embodied situational awareness through multimodal interaction within the ICEbox environment. The g-speak spatial operating environment (SOE) is the world"s first fully-embodied, spatially aware computing environment, and the result of nearly 25 years of research and development into novel methods of human-computer interaction. The g-speak system"s conceptual debut was in the movie Minority Report and recently appeared in the Iron Man films. What began as a movie concept has developed into a spatially aware, networked OS, designed from the ground-up as a whole-body, human-computer interaction platform. The g-speak SOE is designed to help programmers write applications that use gestural input, function well on large screens and for simultaneous users, work across multiple computers and screens, and can be built from loosely-coupled small programs. By design, g-speak understands the relationships between the operator and the environment. By using a variety of hand gestures, as well as interaction with physical objects and/or mobile devices, g-speak is uniquely capable of restoring embodiment to the task of computing in general, and immersive situational awareness in particular."