Translator for HMI-Action Linking for Application Modular Universal Smartphones (THALAMUS)

AFSPECWAR and other DAF personnel frequently engage in complex missions that demand rapid access to digital tools and information through their End User Devices (EUDs), primarily Android smartphones. These missions require real-time data such as mapping, communications, and operational commands accessed through applications like ATAK and SWAK. However, the interface solutions provided with these devices, mainly touchscreens and occasional physical enhancements, have not evolved to meet the demands of modern military operations. Despite the critical role of these applications in mission success, the available interface tools are often not optimized for the diverse and dynamic environments in which DAF personnel operate, resulting in a gap between the functionality of the software and the ability of personnel to interact effectively with it. Current HMI solutions have been slow to integrate new technologies, often failing to support a wide range of functions or requiring extensive customization, which is impractical in field conditions. Tailored HMIs may meet specific mission requirements but fail to offer scalable benefits across the DAF, while generic HMIs promising broader applicability often struggle with integration and costs. Emerging HMIs thus often fail to achieve significant long-term impacts. A successful approach to modernize HMIs must integrate various control devices with existing EUDs, reducing the need for per-app integration software development. This is crucial as the scope of missions and technologies evolves, requiring interfaces that can adapt to broader capabilities.  THALAMUS is an innovative HMI solution designed to bridge the gap between novel and emerging HMI peripherals, EUDs, and the wide range of applications and functions warfighters rely on. The core of THALAMUS is the Universal Touchscreen Translation Layer (UTTL), a user-configurable grid system that overlays on the touchscreen, allowing seamless integration with various HID-compliant peripherals. It supports alternative input methods such as gesture controls, voice commands, and body-mounted devices, enabling more intuitive and efficient interactions with mission-critical applications. By adapting to the active application and screen state, THALAMUS ensures that the most relevant controls and information are always accessible, enhancing situational awareness and reducing cognitive load. The Phase II effort focuses on advancing THALAMUS to Technology Readiness Level (TRL) 6 through development, integration, and testing. Expected outcomes include a fully functional THALAMUS prototype that enhances mission capabilities, improves operational efficiency, and demonstrates technical feasibility for broader Defense and commercial applications. This advancement addresses critical HMI limitations, providing a versatile and adaptable solution for diverse operational environments.