CBRNE Augmented Reality Display and Device Integration Network

To address the CBD’s need for an augmented reality (AR) display that shows chemical, biological, radiological, nuclear (CBRN), and electro-optical/infrared (CBRNE) threats, Intellisense Systems, Inc. (Intellisense) proposes to develop a new CBRNE Augmented Reality Display and Device Integration Network (CARDDIN), based on a modular network that incorporates CBRNE and geolocation information from all sensors and nodes in the network, fuses that data in real-time at each node, and streams AR video to a heads-up display (HUD) worn by on-the-move users while minimizing the size, weight, and power consumption (SWaP) of the electronics carried by each user. CARDDIN is platform agnostic, enabling integration with any reconnaissance vehicle, command and control (C2) systems, CBRNE sensor (whether vehicle?mounted or handheld), and HUD. As a result, CARDDIN is compatible with existing and future platforms and can be easily upgraded and tailored for specific concepts of operation (CONOPs). Situational awareness is maintained by using intuitive warning indicators, and CARDDIN’s scene management algorithm addresses issues of overlapping threat regions, ensuring situational awareness without increasing the cognitive load on the user. In Phase I, Intellisense will demonstrate the feasibility of CARDDIN by showing direct communication of mature radioisotope identification device (RIID) and mass spectrometer data to a HUD device to generate an AR display of sensor data with localization of threats. By the conclusion of Phase II, Intellisense plans to demonstrate the CARDDIN system in a relevant platform combining the sensors on a vehicle exterior with the real-time AR view on a HUD device from the interior of a vehicle to demonstrate real-time CBRNE situational awareness.