Biologically-inspired Integrated Vision System

ABSTRACT: The U.S. Air Force has a need to develop a new class of advanced, wide field of view (WFOV) imaging sensors that sample the radiation field in multiple modes: spectral, temporal, polarization, and detailed object shape. These multimodal sensors are to be deployed on high altitude drones to enhance their intelligence, surveillance, and reconnaissance (ISR) capabilities. Smaller versions of the sensor are to be integrated with autonomous micro-air vehicles (MAV) to provide guidance, navigation, control and motion detection information within cluttered environments. The Spectral Imaging Laboratory (SPILAB) has teamed with the University of Arizona's Department of Neuroscience and College of Optical Sciences to investigate the development of the new sensor, taking inspiration from biological systems. The proposed optical portion of the sensor will combine the WFOV, multimodal compound eye attributes of mantis shrimps with the high resolution single aperture attributes of jumping spiders. The proposed neuromorphic processing portion of the sensor will be designed on the basis of known functional connections in the visual brain areas of insects and crotalid snakes. The integrated system is expected to provide high-speed motion detection, targeted distance information and camouflage deciphering against a cluttered background in daylight or darkness. BENEFIT: The proposed multimodal integrated vision system can provide the US Air Force with enhanced intelligence, surveillance, and reconnaissance capabilities on various aircraft. The wide angle optics coupled to a fast neuromorphic focal plane can enhance the guidance, navigation and control of seekers and autonomous vehicles. Commercial applications include surveillance, robotics, machine vision, and high end automobile collision avoidance systems, which can benefit from motion sensing, autonomous navigation, and distortion free, wide angle viewing without the need for focus adjustment.