Scene Registration Augmented Reality as an Educational Tool to Identify Underlying Anatomy during Medical Simulation Training

A scene registration augmented reality proof-of-concept for medical education is proposed with the goal of making medical education, especially anatomical learning, intuitive, effective, accurate, and productive by leveraging the latest augmented reality technologies. To achieve the goal, following aspects will be investigated and developed: 1) recognize the fiducial markers on a mannequin or on a standard patient using the built-in camera on mobile devices such as iPad, or on AR devices such as HoloLens; 2) bring up the corresponding 3D AR anatomical model with the proper orientation relative to the mannequin or standard patient; 3) allow the user to interact with the 3D anatomical model by zooming in/out, moving, rotating, and manipulating multi-layers; 4) allow the user to lock the 3D AR anatomical model to look around the model at all angles even when the markers are out of sight of the camera; 5) provide access to relevant educational materials such as articles, images, and videos; 6) allow the instructor to share scenes during the instruction. In addition, 3D scene registration technologies will be closely monitored and tested to explore the possibility of bringing up anatomical models using the registered 3D scenes of a mannequin or a standard patient without