Mixed Reality Point Cloud Manipulation

Toyon Research proposes a mixed reality (MR) software application to address the challenges of efficiently handling and visualizing large point cloud datasets for ship inspections and modernization planning. The solution leverages an external computer to preprocess and stream point cloud data to MR headsets, reducing rendering latency through techniques like level-of-detail filtering, voxelization, and 3D Gaussian splatting. This approach ensures responsive interaction when working with the data, and seamless transitions between third-person and first-person perspectives. The software also streamlines data workflows, reducing the technical burden on users and fostering collaboration among multiple users in a shared virtual space. The software utilizes natural user interfaces for MR interaction, standardized annotation formats, and data revision tracking to meet techniciansí needs. The MR point cloud exploration and annotation tool enables multiple users to collaborate simultaneously in the same virtual space. The overall system enables both automatic and manual spatial analysis of 3D data, comparing as-designed and as-built versions of ships, for the detection of physical interferences and design conflicts. By supporting OpenXR and Unity, the solution ensures compatibility with a wide range of MR headsets, though it is optimized for TAA-compliant hardware such as the Varjo XR-4 Secure Edition.