Precision Control Lens Eye Tracking Sensors

Eye tracking technology is enabling new ways of interacting with computers via head mounted displays (HMD). ĀEye trackers are now available that can auto adjust interpupillary distance, account for HMD slip, monitor cognitive load, optimize training, and allow hands free human-computer interaction. ĀThese eye trackers can enable measurement of binocular eye gaze vectors, pupil size, blinks, and even saccades. In laboratory settings, eye tracking systems are highly accurate but invasive or large. ĀScleral coil based systems require anesthetization of the eyes and have a wire connecting to processing electronics located outside of the eye . ĀPurkinje image based eye trackers require a lab bench due to their size, as well as a chin rest for precision alignment . ĀSmaller eye tracking systems also exist that use camera sensors. ĀThese reduced form factor eye trackers are much easier to integrate into HMDs but traditionally suffer from slippage on the head during field usage that degrades accuracy. ĀActive contact lens based systems, such as the eye tracking subsystem in the Mojo Vision display system, have been worked on as recently as 2022, but have failed even with funding of over $200 million dollars and nearly 10 years of development . ĀA new approach to eye tracking is needed that has high performance but has low size, weight, power, and cost (SWaP-C). Ā The Merge Plot team proposes a unique hybrid system using sensors and passive contact lenses that track binocular eye gaze vector, pupil size, blinks, and saccades with high performance, reduced power, and a reduced compute platform. ĀHybrid systems are key in delivering a working eye tracking product within the next 4-5 years. ĀPure contact lens based eye tracking systems are at least a decade away from being fieldable in a combat environment. ĀHybrid sensor fusion in fields such as head tracking (visual-inertial) and vehicle tracking (visual, inertial, GPS, odometry) has been key in developing tracking systems that work outside a laboratory environment. ĀThe same will be true for eye tracking. ĀMerge Plot will develop this by using our long history and expertise in the head mounted display space, where we use/design eye tracking to drive HMD vision systems. ĀOur approach is also less invasive than a full contact lens based solution. Ā Ā