Tactical Assault Kit-Gesture User Interface for Drone Engagement (TAK-GUIDE)

Air Force Special Operations Command (AFSOC) has identified situational awareness in their FY2021-2040 Areas of Interest, and seeks to, “Improve the ability to collect, disseminate, correlate, fuse and display threat, target and C2 data.” The Multi-Mission Headset (MMH) is an Augmented Reality/Virtual Reality (AR/VR) enabled combat vision system designed to meet the situational awareness needs of AFSOC operators and aircrew. End users require a means to manipulate the headset that does not greatly distract from their ability to perform combat tasks on the battlefield. Pison proposes the development of the Tactical Assault Kit-Gesture User Interface for Drone Engagement (TAK-GUIDE) to integrate machine learning enabled wearable gesture control into MMH’s Tactical Assault Kit (TAK)-based situational awareness system. This project will develop and deploy a prototype ATAK plug-in (TAK-GUIDE) MMH application for AFLCMC/WIS. TAK-GUIDE will provide a standardized, open, and extensible endpoint architecture with a set of common and API-accessible graphical user interface (GUI) elements and a multi-level / redundant human-machine interface (HMI) to allow users to control the Multi-Mission Headset in a tactically sound, discreet and effective manner. Gesture control features will be implemented for toggling menu navigation, EUD screen mirror mode, and drone feed windows.