Synthesizing Contextual Knowledge for Advanced Perception and Situational Effectiveness (SYNAPSE)

Significant advances in deep learning and the increased availability of multi-modal sensor data have not resulted in methods and tools to exploit contextual information and a-priori domain knowledge with which these systems could increase the confidence of existing object recognition methods.Ā Knowledge Based Systems, Inc. (KBSI) proposes to design, and demonstrate an innovative approach and a solution, Synthesizing Contextual Knowledge for Advanced Perception and Situational Effectiveness (SYNAPSE) technology will enable the following capabilities: (i) semantic reasoning and analytics-based methods to provide improved context-based scene understanding; (ii) knowledge discovery and fusion methods for object, relation, and activity recognition; and (iii) adaptive learning mechanisms for dynamically revising the knowledge and analytics models.Ā The proposed Phase I project will achieve the following: (i) establish multi-modal sensor information processing requirements to enable semantic scene understanding for threat assessment; (ii) design an ontological framework that provide comprehensive, cross-domain contextual representation to captures all relevant aspects of a situation and the systems interactions within it for improved decision-making and situational awareness; (iii) design methods for semantic reasoning and adaptive learning with spatiotemporal factors derived from multi-modal sensor information to detect anomalies, identify potential threats, and discern patterns of behavior; (iv) design explainability features through question-answering methods to interactively probe, and query machine-generated spatiotemporal contextual insights andĀ understand why the proposed AI components made a certain decision; (v) design and demonstrate SYNAPSE solution architecture; and (vi) document the Phase I results and establish a technology maturation and transition plan.Ā Phase II will harden the SYNAPSE technology leading to accelerated technology transition and commercialization.???????