Educational Medical Simulation and Training Augmented-Reality Tool

To address the DHP and USAMRMC need for a system to augment a dynamic 3D scene registration using augmented reality (AR) to provide anatomically accurate registration and overlays to aid in medical training, Physical Optics Corporation (POC) proposes to develop a new Educational Medical Simulation and Training Augmented-Reality (EMSTAR) tool. The tool is based on the unique combination of low-cost stick-on quick-response (QR) codes with joint color gradient features that when imaged by the mobile devices built-in camera provides accurate and dynamic registration of the standardized patients or mannequins and rendering anatomical overlays. Specifically, the innovative enhanced QR code fiducials and unique predictive algorithms with AR overlays will enable the mobile device running the EMSTAR tool to accurately provide dynamic overlays on the standardized patient or mannequin with high accuracy and occlusion resistance and to render AR content using multi-platform industry standard graphics engines. In Phase I, POC will develop a proof-of-concept demonstration tool that justifies the accuracy and sensitivity of the tool, reaching TRL-4. In Phase II, POC plans to improve EMSTAR by applying it over broader areas using fully dynamic models to support orientation and joint movement, as well as complete a user-group usefulness survey, reaching TRL-6.