HoloWarriorTM Augmented Reality CBRN Threat Display for Mounted Situational Awareness

VR Rehab, Inc. (VRR) HoloWarrior™:CBRN system’s intuitive AR/MR 3D visualizations enables enhanced CBRN situational awareness for better and faster decision making while also reducing cognitive workload. This CBD/DTRA sponsored Phase-II will quantify the large-scale performance increases and usability optimizations. Benefits are anticipated to align with our similar AR/MR visualizations large-scale successes (scientific publication of our AR/MR visualizations enhancing situational awareness for faster (3X to 5X faster) and better (99.4% to 99% accurate) decision making while also reducing cognitive workload. HoloWarrior:CBRN provides real-time, geospatially accurate, augmented reality display of various CBRNE sensor data to mounted and dismounted warfighters in fulfillment of all Phase-I requirements along with selected Phase -II requirements early. Specifically, HoloWarrior as required presents scene-linked Augmented Reality (AR) cues depicting real-time data from Chemical, Biological, Radiological, and Nuclear (CBRN) sensors. The HoloWarrior:CBRN proof-of-concept systems have been successfully demonstrated showing; (A) Direct communication of a mature Radioisotope Identification Device (RIID) and Chemical Detectors data from multiple different manufacturers (including ANSI standards, &/or any CSV or XML documented format) to AR/MR-HMDs as Head-Up Displays (HUD) real-time generating AR displays of sensor data as special partial domes based upon Risk Estimate Distance standards, and new classes of 3D point clouds with interpolation and extrapolation innovations enabling accurate localization of threats. (B) Phase-I successes include evolution from VRR’s previous CBRN visualization and AR user interface developments, towards transitions to the Army’s IVAS AR/MR-Helmet-Mounted Display tested/evaluated with COTS HoloLens2 modified by VRR for outdoor use. VRR’s also support inexpensive hardware solutions utilizing AR-MR Video-See-Through from built-in cameras within commercial smartphones, tablets, laptops suitable for both mounted and dismounted CBRN uses. and (C) Integration with the Android Tactical Assault Kit (ATAK) and CivTAK. Additionally, VRR has innovatively developed technology for mitigating distracting AR visual effects resulting from GPS inaccuracies via VRR’s Pulsing Graphics technology which productively exploits human visual and perception limitations. An extensive requirements matrix is presented to ensure that VRR’s proposed solution meets all of DRTA’s stated requirements. HoloWarrior also supports control of UxVs with CBRN sensors, and thru ATAK Call for Fire and Close Air Support for the mitigation/elimination of threats including appropriate CBRN threats. Phase II plans are presented for further developing, integrating, and testing HoloWarrior:CBRN together with transition & dual use commercialization plans for civilian emergency responders & other applications. Additional capabilities within non-public text due to ITARS.