Knowledge Discovery using Mobile Devices

OV designed and implemented a system for ISR knowledge discovery, including a mobile application for Android smartphones which aids the dismounted warfighter in collecting and exploiting ISR data in the field. During Phase I, the team prototyped a multifunction mobile device to be carried by the warfighter, equipped with cameras, microphones, and position sensors. This device sends regular status messages and user initiated A/V queries to an Analysis Server via a wireless data link. The Analysis Server, which has a high bandwidth connection to the ISR enterprise, integrates the incoming data with other ISR data, and sends query results and context-based alerts back to the mobile device, where they are announced to the user and displayed as a map overlay or augmented reality interface. For Phase II, the team will build upon this framework to add new features, increase performance, and ready the system for field testing. This effort will focus on deeper integration with GHub and other DoD projects, incorporation of mission-oriented features, and object detection and classification modules for the mobile device. The option includes tasks to increase scalability and extensibility, improve performance, and ready the system for field testing.