ORACLE - Opportunistic Real-time Analysis, Content Labeling and Exploitation of Multimodal Sensory Data

Military and open-source data contain a wealth of information about entities of interest to US and coalition forces. This information is in the form of unstructured text, audio, imagery, video, SIGINT, and structured data. Intelligence analysts have access to these distributed, disparate data sources but are severely limited in exploiting the information. The success of military and security operations often depend on the level of situational awareness. A primary intelligence task is the development of patterns of life for the target of interest to determine target intent based on observation. To meet this challenge, DECISIVE ANALYTICS Corporation (DAC) and the Stevens Institute of Technology proposes a system for Opportunistic Real-time Analysis, Content Labeling and Exploitation (ORACLE) from multi-modal sensory data. The ORACLE system will enable real-time threat analysis and situational awareness from multi-modal data sources by automatically identifying the targets of interest, providing intent prediction based on patterns of life, and enabling the analyst to annotate targets of interest at both the (video) frame level and topic (event) level for future search. ORACLE will provide a distributed operational environment, where analysts from different departments, each with their own databases and perspectives, can analyze and collaborate on a common platform.