Fusion Technology for Multispectral Imager with Adjunct Sensors

ABSTRACT: Field measurement campaigns typically deploy numerous sensors having different spatial, temporal, and spectral sampling characteristics. This makes it difficult to process experiment data when a phenomenon of interest spans multiple sensors. There is a clear need for a new software tool that can process sequences of sensor imagery in disparate formats and produce a time sequence of data accurately resampled to a common grid. We demonstrated end-to-end processing performance: 1) cross-sensor spatial registration via scene-based methods; 2) temporal upsampling to common time base via optical flow interpolation; and 3) advanced"fused"image products (e.g. pan sharpened imagery). Our proposed Phase II effort will culminate in a functional prototype software tool. BENEFIT: The first planned product that will incorporate the proposed technology is a Windows Application for ingestion, registering, resampling and fusing multiple imager camera data. This prototype will ingest common format data sets and produce industry standard output data products, including ENVI-compatible data files and standard image and video format imagery (e.g. JPEG, MPEG). This product is intended to demonstrate the capabilities and provide a lead-in to development of custom solutions. We anticipate that probable customers for this initial product include researchers in Government laboratories, Prime Government contractors, Academic researchers, medical imaging device OEM manufacturers and research facilities, biotechnology researchers and commercial providers of manufacturing control and monitoring equipment. Commercial applications include monitoring of manufacturing processes, factories and equipment as well as diagnostic imaging equipment used in the biotechnology and medical device community. This work will benefit the Government directly by providing the processing needed to combine multiple sensor data sets from imagers typically used by AEDC and other government facilities to monitor system and device testing, as well as monitoring and launches.