Programmable Neuromorphic Microchip for Accelerating Dismount Identification in WFOV Video

ABSTRACT: Wide field of view (WFOV) video capability on unmanned aerial systems (UAS) has outpaced data transmission capability. Identifying regions of interest (often performed though object recognition) enables selective video compression and maximizes the useful content in data transmission. Neuromorphic classifiers currently hold the records for greatest accuracy of object recognition and speech recognition, but are too computationally intensive for deployment in autonomous systems. This proposal describes a programmable microchip for energy-efficient acceleration of neuromorphic classifiers. Neuromorphic classifiers interpret sensor data much like the human brain does, allowing them to efficiently recognize dismounts, equipment, buildings, terrains, and other interesting features in video. The proposed platform will increase the capabilities of UAS while greatly reducing the form factor and power requirements of the control systems. Achieving these goals is possible through the creation of specialized hardware accelerators which can potentially yield>100x improvement in energy efficiency and performance over general purpose computing solutions. Additional benefits of the platform include greater radiation and fault tolerance due to the distributed nature of the neuromorphic architecture, and the ability to efficiently provide hints to the classifier. BENEFIT: The proposed system can function as a general purpose data classifier with little modification. Many commercial electronics are looking for new ways of interacting with the outside world that can benefit through this technology. In each of these applications the proposed system will be able to perform the task with much greater accuracy and performance with a lower power budget than other solutions. Military applications include object recognition for autonomous systems, navigation for autonomous systems through optical flow, and voice and gesture recognition for human interfaces. Potential consumer applications include medical devices that include data classifiers for detecting heart attacks or seizures, voice and object recognition for handheld devices like cell phones, and human interfaces for automobiles.