20/20 Immersive Display System Based on Eye Tracking

The U.S. military relies heavily on immersive simulations to train pilots and other war fighters. However, it is not currently possible to display immersive environments in a manner that represents a real world scene viewed with 20/20 eyesight. The effect is that pilots train as if they have less than 20/20 eyesight. Simulations can be tailored to compensate for this reduced resolution, but this produces inaccuracies in the simulated world. What is needed is a method to display the immersive world at a resolution that better simulates the real world. Cybernet proposes to leverage previous work in helmet mounted display (HMD) design, eye tracking, and small robotic systems to develop an HMD that provides very high resolution imagery at the point where the fovea is focused and lower resolution imagery throughout the rest of the scene. As we have done in the past, we will leverage COTS projection displays to develop the overall displays and our existing eye tracking technology to monitor how to move the high-resolution screen to keep it aligned with the fovea.