ScanEval: An approach for Integrating Eye Tracking into Automated Instructional Environments

A concept for intelligent, multimedia computer-based training systems integrating intelligent agents with eye tracking and speech (ScanEval) is presented as a means of developing training systems that are more responsive, engaging, and motivating to trainees than current systems relying on more traditional user interface and pedagogical sequencing mechanisms. It is argued, based on published research, that the underlying interaction technologies will be viable and cost-effective using consumer hardware platforms widely available in the near term. ScanEval builds on earlier research by individuals of the proposed team in developing intelligent interface agents and in eye- and voice-controlled systems, and on the experience of the principal investigator in the design and application of computer-based training. The proposed Phase I effort will culminate in a proof-concept demonstration that will show attention-sensitive, reactive presentation and narration of training materials using eye-tracking and speech synthesis.