Multi-Capable Airman Training Research for Interface Experience (MATRIX)

S2RC is proposing MATRIX which builds upon our Phase I efforts to is develop a natural UI for JITMMA/W and MCA training. MATRIX centers on the development of a standalone training system that utilizes an OA approach to integrate the right hardware, software, technology, and HMIs to provide the DAF with enhanced training suite at home and during ACE. The preliminary MATRIX system incorporates Multi-Modal HMI, Generative AI, MR Applications, and traditional 2D applications to provide rapid training. Our Phase II approach is centered on our user-centered design philosophy and goal of providing an initial operations capability to MCA as quickly as possible. This approach was chosen based on the challenges and pain points from MCA, DAF, and DoD personnel gathered from end users within our network and research done by various organizations studying ACE and MCA. Our approach will address: Lack of MCA Training Standardization: This challenge is twofold as MCA training varies greatly by unit and MCA lack standardization across equipment i.e., there is not a standard AR headset MATRIX Approach and Solution: MATRIX is designed to harness the full potential of OA, common filetypes, and common APIs to creates a modular and scalable framework, enabling seamless integration and futureproofing against rapidly evolving technological landscapes. Our approach enables us to integrate existing software, content, and content creation tools to address unit specific training. Lack of MCA Training Equipment: A critical concern is the lack of financial resources, equipment, and personnel for MCA training efforts. A RAND study found “most wing-level MCA programs do not have their own equipment, or at least enough equipment, and thus rely on borrowing from various units on base. Accordingly, multiple wings reported difficulties securing equipment—particularly communications equipment—for MCA training and exercises.” MATRIX Approach and Solution: MATRIX includes hardware dedicated to MCA training alleviating the hardware burden. Furthermore, the inclusion of digital twins into the MATRIX will also help mitigate the lack of operational hardware available for training such as communications systems. Limited User Interface Options: MCA do not have a Multi-Modal HMI option for controlling MR and other devices, hindering training and user experience. MATRIX Approach and Solution: MATRIX provides end users with the ability to pick and choose their preferred HMI or combination of HMI to meet the needs of their training task. Use of OpenXR makes integration of future HMI options significantly easier as opposed to a proprietary interface. Lack of DDIL Mitigation: Most fielded training systems require cloud connectivity. MATRIX Approach and Solution: MATRIX provides a graceful degradation of capabilities through a Connectivity PACE plan. MATRIX offers reachback support through the cloud all the way to offline training and the ability to create physical copies of instructions.