Augmented reality and data fusion for CBRN threats

As an increasing number of CBRN and situational awareness sensors are deployed on the battlefield on vehicles and on unmanned ground and aerial platforms, an unprecedented amount of data is now available to support DoD missions. Collecting, correlating, analyzing, and communicating the different types of data produced by these sensors, including CBRNE, location/tracking, and situational awareness, is a time consuming and burdensome process for the Warfighter and Commanders, and manually correlating these separate pieces of data is also prone to human error. New situational awareness and training tools employing augmented reality (AR), virtual reality (VR) and mixed reality (XR) interfaces also provide more ways to collect and display the data. With the wide deployment of sensors and the adoption of new data communication and visualization tools, new capabilities are needed to bridge the gap between sensors and visualization platforms and overcome the challenges of integrating sensor data into an AR client or HUD system. Gamma Reality Inc. proposes to extend the capabilities developed under Phase I to enable faster, more efficient, real-time, on-the-move CBRN hazard detection, assessment, and response through the visualization and communication of radioactive and chemical hazards in AR in a HUD through the deployment of vehicle-mounted, as well as off-board sensor systems in Phase II.