Interactive Treatments for HAZMAT Training with the PerSim Mixed Reality Patient Simulator

Abstract Significance: Although current patient simulators have demonstrated improved learning outcomes in medical training, there is a significant lack of realism. Thus, they do not effectively provoke a realistic emotional response in trainees. This significantly limits their educational value to the emergency medical service (EMS) training agencies, as does – in the case of mannequins – their cost, reliance on electricity, and lack of portability. To address these significant limitations of the current medical patient simulators, the PI developed PerSim, a commercial patient simulator product using mixed reality (MR), which includes HAZMAT signs and symptoms. However, additional research and development is needed to effectively support HAZMAT treatments. Commercial Need: Since being released in 4th quarter 2017, there are over 100 institutions that have purchased PerSim for $20-30K each, on average, including a $12K per year subscription fee, and are using the system for emergency medicine and HAZMAT training. Based on interviews with our customers and individuals at emergency medicine training agencies, MR- based simulated HAZMAT treatments will address a critical need in HAZMAT education. Preliminary Data: The PI developed PerSim, an MR-based patient simulator that can be used in person or remotely over the internet. Via the Microsoft HoloLens 2 MR display, the system projects high-resolution, realistic animations of a patient onto any surface a trainee chooses such as low- fidelity mannequin as a physical reference for haptic input during procedures. The instructor uses a handheld tablet as both a controller for the simulation and an automated assessment system to track trainee performance. The system utilizes another tablet to act as a defibrillator and a physiologic monitor to provide real-time vital sign and heart rhythm data. The system’s control interfaces and registration algorithms are patented. Specific Aims: This project proposes to develop and evaluate interactive, virtual autoinjectors and patches for HAZMAT treatments in the PI's innovative MR-based patient simulator, PerSim. In Specific Aim 1, the PI will work with medical artists and a HAZMAT educator co-I to create realistic treatments and integrate them with the PerSim system. The PI plans to develop autoinjector and patches textures and models based on NFPA 472 Standard for Competence of Responders to Hazardous Materials, specifically to treat poisonous gas inhalation, corrosive materials, and poisonous materials. In Specific Aim 2, the PI will evaluate the usability and realism of the HAZMAT treatments with HAZMAT instructors and students.