Advanced Virtual Environment with Real Time Integrated Visualizations

Karagozian and Case, Inc. seeks to develop a novel software application called  AVERTv (Advanced Virtual Environment with Real-Time integrated Visualizations) which provides an ultra-low latency mixed reality environment for end-to-end real-time collaboration between two geographically separated teams. AVERTv provides a mixed reality (MR) environment for the main team (on-site) and a full virtual reality (VR) environment for a geographically removed person located away (off-site). Microsoft’s HoloLens2 will be used for the on-site personnel which utilizes a see-through display to view surroundings, along with a digital avatar of the off-site person. The off-site person will use an Oculus Rift S headset which will provide a digital copy of the meeting room, data feeds and screen outputs, and digital avatars of the on-site personnel. The proposed software architecture will leverage Unity and WebRTC. Unity is a leading platform for creating interactive VR/AR applications and WebRTC is the standard for real-time communications. K&C will develop several modules with tools to enhance user collaboration and ability to interact with each other and surrounding digital assets. K&C has also developed a holistic approach to achieve ultra-low latency that addresses both the rendering and data transfer inherent in any VR/MR real-time collaborative tool.