STTR Phase I: Eye-Gaze Correction for more Effective Telepresence

This Small Business Technology Transfer Research (STTR) project will develop a novel real-time depth sensor that exploits the inverse square law, e.g., the light radiance falls off as a function of distance. Compared to existing commercial full-frame sensors, it is expected to provide high resolution (e.g. 640x480) depth maps while reducing the cost by one or two orders of magnitude. Secondly it utilizes a hybrid approach for scene depth estimation, combing both active sensors and passive stereovision in an optimization-based probabilistic framework. The outcome from the project is expected to significantly improve the quality and robustness of the synthesized view. The telepresence market is enjoying 100% annualized growth with a projected market size of $1B in year 2011. It is anticipated that the proposed technology could offer tremendous communication improvements for telepresence systems. As cameras, large displays, and broadband become more and more ubiquitous, telepresence can be realized on every desktop and laptop. With correct eye gaze, life size imagery, and fluid motion, compelling telepresence experiences could someday significantly reduce the need for travel. Additionally, the proposed active range sensor can deliver video streams with depth information, which can be used in many markets such as immersive gaming, intelligent automotive, security, distance education, and factory automation.