EO-IR Multi-Sensor Fusion Tracker Algorithm

In Phase II, Toyon Research Corp. proposes to perform research and development of an EO-IR Multi-Sensor Fusion Tracker prototype which can be used to aid in exploitation of airborne co-boresighted multi-sensor EO-IR video. Proposed work includes development of algorithms and real-time software implementations that perform data-driven registration of EO and IR video, electronic video stabilization, image statistical background modeling and clutter suppression, automated moving target detection and segmentation, multiple-target feature/appearance-aided tracking, and target geo-location/geo-registration. The developed prototype will include a GUI that will allow for selection of a target of interest (TOI), and the prototype will also output TOI track information in the form of control signals that can be used to keep the TOI in the field of view of the co-boresighted EO-IR sensors. Integration with Navy systems will be pursued during Phase II. Extensive testing and algorithm evaluation will also be performed, including testing using both stored ground-truthed video and live testing integrated with Navy systems.