Automatic scene understanding and generation of textual descriptions

The primary goal of this SBIR Phase II is to build a software system capable of automated scene understanding and labeling based on advanced image processing and computer vision algorithms. The system allows a user to perform content based search and retrieval queries in a context-aware fashion. The system seeks to answer the following questions in a fully-automated manner: (i) What objects are present in the scene? (ii) Where are they located in the scene with respect to each other? The system does not label every item in the image/video frames rather it reviews an image/video and automatically forms a semantic, easily understandable description of the images/videos. In this Phase II.5 effort, we plan to bring this technology to a commercially ready product to the level that is applicable to an actual system in a mission.