Smart Multimodal Image Registration and Fusion (SMIRF)

To increase all-weather, visual search capabilities, modern submarine surface imaging systems have installed several different modality cameras in the periscope or photonic mast. The current system displays each sensor modality independently, where the operator must decide which modality is optimal for which environment, and must constantly switch between modalities to search for critical information. 21st Century Systems, Incorporated is pleased to propose SMIRF (Smart Multimodal Image Registration and Fusion technology). SMIRF will produce a higher contrast resultant image through fusion of multiple sensor modalities while reducing image clutter from maritime environments. SMIRF’s key innovations include the use of spatial, temporal and cross-modality information to meaningfully identify salient versus non-salient corresponding regions within each image modality. Information quality statistics from each region are then used to dynamically decide for each local region which fusion strategy available within the data-fusion module is optimal. An adaptive approach allows SMIRF to intelligently choose “the right tools for each job.” With our extensive experience in video analysis products and with a 100th percentile SBIR commercialization rating, we are just the company to deliver this capability so submarine commanders can focus on seeing what’s in the area and not on which setting to use.