Fused Reality(tm) Maintenance System

The solicitation for this topic stresses the need for alternative approaches to conducting equipment maintenance. A PC-based technology called Fused Reality(tm) created by Systems Technology Inc. (STI) currently employs live video capture, real-time video editing, and virtual environment simulation to enable the fusing of physical images into a virtual scene, which can then be moved within that scene. Fused Reality(tm) uses chromakey to identify areas of interest in the physical scene. One of the key innovations of the proposed Fused Reality Maintenance System (FRMS) is modifying Fused Reality(tm) to use machine vision for identifying real objects so that they can be fused into and moved within the virtual environment. Other novel innovations include the integration of novel 3D interfaces (such as image-based head tracking) with a 3D modeling software tool such as Solidworks, and using Solidworks to generate the virtual scene layer for use with Fused Reality(tm). In order to provide an integrated solution for the maintainer’s challenges, the system will employ state-of-art technologies including: machine vision recognition, voice recognition, neural networks, and knowledge-based expert systems. Novel design in human-machine interface design will balance cognitive workload with task execution. Key issues pertaining to diagnostics, component replacement, and logistics are addressed.