Visual Information Digital Assistant

To address the DHS need for an intelligent system to automatically process and analyze video sent from 911 callers and to efficiently share relevant content with emergency responders, Intellisense Systems, Inc. (Intellisense) proposes to develop a new Visual Information Digital Assistant (VIDA), based on novel integration of deep/machine-learning-based video analytics with multi-tiered information abstraction and sharing (MIAS). Specifically, the innovation in a novel cloud-compliant intelligent video analytics system design with MIAS representation of information will enable the VIDA to automatically analyze multimedia video, extract useful and actionable information, and share relevant information to the first responders. As a result, this system offers real-time automated video analysis to reduce the burden and workload of 911 telecommunicators. In Phase I, Intellisense will demonstrate the feasibility of VIDA by conducting interviews of Public Safety Answering Point (PSAP) personnel, defining operational requirements, identifying methods for operational incorporation, developing video analysis and sharing algorithms, defining training data requirements, and illustrating VIDA's usage for content grouping and call priority ranking. In Phase II, Intellisense plans to further mature the Phase I design with addition of analysis of video/data including data requirements for training the algorithms, operational incorporation, and sharing of relevant information with emergency responders. The successful completion of this project at the end of Phase III will benefit the nation in the government and commercial sectors by improving the efficiency and effectiveness of emergency responding capability. Commercial applications for this technology include facility surveillance, UAV surveillance, and video analysis.