Enabling VR Aircrew Training through a Common HMI API

Vertex Solutions (Vertex) understands that virtual and mixed reality (VR and MR) technologies can revolutionize military aircrew and pilot training by accurately simulating task performance in a high-fidelity, multisensory virtual environment at significantly lower cost than traditional physical simulators. To realize VR’s training potential, however, great care must be taken in system design and implementation. Both the interface and user interaction must be intuitive and natural so aviators can “train as they fight,â€Â while avoiding frustration. Various groups within the Air Force are developing VR solutions to fit within their overall training curricula but are encountering similar challenges in implementing natural human interaction with virtual aircraft controls. In Phase II, Vertex proposes to substantially advance the capabilities of the human-machine interface software development kit VertexMultiSensor to address specific Air Force training technology capability requirements to maximize virtual training immersion and fidelity. The resulting technology will be integrated with training solutions on site at AETC/PTN and Hurlburt AFB and enhance the user experience within deployed immersive training devices (ITDs) to provide meaningful cockpit interaction in a way that improves switchology transfer from ITD to aircraft and improves the effectiveness of virtual mission qualification training.