Novel Methods for the Flexible Ultrasound System Utilizing Augmented Reality Just-In-Time Procedural Guidance

NASA's future manned spaceflight missions will require medical diagnosis and treatment capabilities that address both the anticipated health risks and perform well in austere, remote operational environments. Spaceflight- ready medical devices will need to be capable of an increased degree of autonomous operation, acquiring clinically relevant and diagnosable data by every astronaut, not just select physician crew members credentialed in spaceflight medicine. Ultrasound is a diagnostic and treatment technology that currently fulfills mission medical capability support on ISS and is planned to accompany future deep-space missions. The Flexible Ultrasound System (FUS) is a new platform that is currently being developed by NASA and research partners to support this mission role. We propose three specific aims for this project proposal for methodological development utilizing the FUS platform: 1.) Define a list of highest priority/yield ultrasound methods to develop and implement using the FUS and our guidance prototype through careful review of the HRP roadmap and direct discussion with ExMC Physicians. 2.) Expand an Augmented Reality (AR) user interface for these ultrasound methods that provides procedural guidance in acquiring and initially diagnosing sonographic data for ultrasound procedures to enhanced degree of procedural competency. 3.) Develop and test the integration of magnetic-based Volume Navigation, and complementary dimensional referencing technologies, on the FUS platform to allow for 3-dimensional ultrasound procedural guidance through the Head Mounted Display. 4.) Integrate the current system with procedural guidance resources such as Electronic Procedures (eProc) and existing ultrasound training materials. 5.) Develop deep machine learning capabilities on the FUS platform to enable image recognition and analysis that can aid in not only quality image acquisition, but also analysis in austere, and remote operational environments.