Precision Contact Lens Eye-Tracking Sensor

To address the Army’s need for precision contact lens eye-tracking sensors for extended reality (XR) interaction, training optimization, and cognitive monitoring, Intellisense Systems, Inc. (Intellisense) proposes, in Phase II, to advance the development of a new Precision Contact Lens Eye-Tracking Sensor (PCLETS) proven feasible in Phase I. The innovative modular PCLETS design integrates light-emitting diodes (LEDs), a mark-embedded contact lens, position-sensitive detectors (PSDs), and eye-tracking processing algorithms. Specifically, the innovation in embedding marks into the contact lens and the use of LEDs and PSDs to interrogate spots (mark locations) for eye tracking enables fast, accurate, and high-precision measurement of eye movement in a form factor that is acceptable for mission demands. The innovations of PCLETS enable the contact lens to be used as a controller; users can rely on their eyes rather than using a physical controller or gesture recognition, thereby increasing the speed and intuitive nature of interacting with head-mounted display (HMD) interfaces. As a result, PCLETS can operate in rugged, highly mobile Army environments. It allows for operational integration into multiple wartime dynamic scenarios for joint mission precision, to include manned and unmanned air operations and ground vehicle systems. PCLETS will also enhance command and control (C2) capabilities in XR environments, optimizing training and cognitive monitoring to enable real-time adaptive systems. In Phase I, we developed a system architecture based on an infrared (IR) laser, IR dye/marks embedded in contact lenses, and a PSD. We demonstrated the operational concept of using IR dye to track eye movement and developed a model for integrating PCLETS with augmented reality glasses. We also designed custom electronics for practical implementation of PCLETS. The same concepts for optical raytracing and integration model development can be applied to an XR system selected by the Army in future. We also demonstrated high-precision eye tracking including the detection of eye gaze position, pupil size, and blink events. We successfully demonstrated the feasibility of PCLETS, which established a solid foundation for advancement in Phase II. The proposed Phase II development will significantly advance the Phase I PCLETS technology by improving the concept design and proof-of-concept prototype developed in Phase I using data collected and lessons learned from Phase I development. Intellisense will work closely with the Army to improve PCLETS development to address Army needs. Based on input from the Army, we will implement improvements to optimize the design and develop a Phase II working prototype of testbed and sensors which can collect binocular eye gaze position, pupil size, and blinks and compare it to gold standard high-precision eye trackers. We will also improve PCLETS based on studying human factors feasibility and soldier touchpoints in Phase II Sequential.