Multi-modal cloud based system for detecting early signs of driver cognitive decline and/or high risk driving behaviors

Project Summary/AbstractPhysical Sciences Inc. (PSI), in collaboration with Michigan State University (MSU) and the University of Michigan (U-M), proposes to develop a novel technology that will non-intrusively monitor driver cognitive decline and/or high-risk driving behavior that is especially suited for seniors (aged andgt;65). Contextual physiological biomarkers along with computer vision based drive quality measurements will be obtained through a cloud-based acquisition system. Real-time risk assessments that are measures of cognitive status will be performed on the cloud to provide comprehensive analysis on drive quality metrics for seniors with varying levels of cognitive impairment.Assessment of a driver’s cognitive status requires the use of a complex monitoring platform that can be seamlessly installed into any automobile without interfering or adding complexity to driving. Therefore, our goal is to develop a cloud-based, multi-modal routine cognitive/drive assessment system that combines a Smart Steering Sleeve (S3), which monitors physiological biomarkers, along with a Computer Vision (CV) system that provides contextual insight for biomarker changes and monitors a driverandapos;s habits. The Cloud-based Computer Vision Smart Steering Sleeve (C-CVS3) sensor system will be capable of monitoring biomarkers such as heart rate, hand gripping force, and the presence of excessive sweat from the skin surface indicating stress levels affecting potential drive quality degradation, which are also factors expected to be associated with cognitive impairment during critical events. Dash cameras provide temporal context including reaction times to unexpected hazards in addition to driver’s safety measures, such as staying within the lane, and maintaining distance to surrounding vehicles. The transmitted data to the cloud from both modalities will be used to derive cognitive/drive quality indices (QI) for driving risks that can be associated with increased stress levels, attention deficiency and/or cognitive decline in individuals. This modality will result in an add-on adaptive platform in automobiles that gauges cognitive status/decline providing value to the auto insurance industry, RMV, as well as to the caregivers of the cognitively impaired patient apart from the individual himself to identify a quantifiable parameter before giving up driving or to seek additional cognitive diagnosis.The basic functions of this comprehensive drive monitoring system will be evaluated in Phase I on a number of individuals in a driving simulator. The technology will be improved in Phase II and will be further tested during real-world driving scenarios.Project NarrativeRoutine cognitive screening in a controlled cognition-involved environment such as driving, an everyday activity, provides a non-intrusive method to identify patterns of cognitive decline and/or high-risk driving behavior. PSI, in conjunction with MSU and U-M, will develop a cloud-based, multi-modal system combining a Cognitive Smart Steering Sleeve (CS3) measuring physiological biomarkers and a Computer Vision (CV) module monitoring drive safety measures for frequent and non-intrusive monitoring of high risk driving behavior/cognitive status.