Innovative Application of Urban ISR (Intelligence, Surveillance, Reconnaissance) Imagery for High Fidelity Training Devices

Toyon Research Corporation and Brown University propose to develop a complete real-time software solution which ingests multi-sensor ISR imagery and produces geo-specific, realistic simulated imagery for flight simulators and training devices. The technical innovations enabling this solution include fully automated 3-d model construction from sequences of ISR video frames, and geo-registration of multi-sensor video to enable realistic multi-spectral imagery simulation. Real-time processing will be achieved with a proposed massively parallel graphics processing unit (GPU)-based implementation. A key component of the proposed development plan is indentifying appropriate data formats and protocols for interfacing with current and future commercial flight simulation products. The focus of the Phase I effort will be on demonstrating the performance of the component algorithms and software prototypes, benchmarking key components of the GPU implementation, and developing a plan for Phase II development and flight simulator integration. Algorithm demonstrations will be performed in Phase I using ISR video available at Toyon and Brown Univ., from past and ongoing involvement in multiple DoD ISR video exploitation programs.