Interaction with Experiences

This project will develop a prototype cognitive assistant that utilizes multiple sensors to monitor and then assess the state of a human subject. Using subcontractors from University of New Mexico and Drexel University we will combine high resolution EEGand fNIR sensors to monitor the subject state. Our system will assign semantic labels to the sensor output and utilize these labels within a learning system that is able to associate subject stimulus and sensor data to develop mappings of these inputs intoassessments of the subject state. Having determined the human subject state, it is then possible for our system to use learned experiences to assist the subject in performing their tasks if this is considered necessary.