Educational Medical Simulation and Training Augmented-Reality Tool

To address the DHA and USAMRMC need for a system to augment a dynamic 3D scene registration using augmented reality (AR), Physical Optics Corporation (POC) proposes to advance the development of the Educational Medical Simulation and Training Augmented-Reality (EMSTAR) tool proven feasible in Phase I. The tool is based on the unique combination of quick-response (QR) codes with joint color fiducial features that when imaged by the mobile devices built-in camera provides accurate and dynamic registration of the standardized patients or mannequins and rendering anatomical overlays. Specifically, the innovative enhanced QR code fiducials and unique deep-learning algorithms with AR overlays will enable the mobile device running the EMSTAR tool to accurately provide dynamic overlays on the standardized patient or mannequin with high accuracy and occlusion resistance and to render AR content using multi platform mobile devices. In Phase II, POC will improve EMSTAR by applying it over broader areas using fully dynamic models to support orientation and joint movement, as well as complete a user-group usefulness survey. We will work with the DHA, Lockheed Martin, Boeing, and Visible Body to develop solutions for transitioning the technology and to utilize additional resources including contracting beyond Phase II.