Three-dimensional Context and Feature Aided Multitarget Tracking

Dismount discrimination is often based on static EO or IR target attributes such as height, length, and color. Various algorithms such as gait estimation have been developed to distinguish dismounts from other moving objects. Techniques that build high-fidelity 3D models of dismounts are fragile when applied to real imagery (i.e., video mounted on an unmanned aerial vehicle (UAV) with limited communication bandwidth and operating in windy conditions). A novel approach is to exploit the information derived from the track state being provided by a tracker to enhance existing methods for gait estimation and 3D target modeling. Specific attention will be given to managing lower resolution EO/IR data and combining the strengths of recently developed concepts in order to provide robust methods for dismount discrimination and feature aided tracking. In addition, micro-doppler radar features will be exploited to provide dismount gait estimation, which leads to the benefit of a layered sensing approach. The micro-doppler radar features are highly dependent on target orientation to the sensor. Knowledge of this orientation provided by other layers in the sensing network will significantly enhance the radar-based discrimination and classification. The layered sensing paradigm provides opportunities for data fusion at the measurement or track level. BENEFIT: The specific problem of three-dimensional multi-intelligence surveillance systems is addressed. The developmental sections of the software can be translated into a real-time system for direct use by the military and civilian reconnaissance communities. Specific DoD programs include instantiations of several UAV sensor platforms, the recently deployed Angel Fire system, and the evolving ARGUS-IS persistent video platform. UAV video platforms are becoming increasing prolific and provide new opportunities to employ layered sensing architectures. Demonstration of Numerica’s capabilities in the layered sensing problem domain will be directly marketable to civil application areas such as include border patrol and urban surveillance. The recent increase in aerial systems capable of providing persistent radar or video will be appropriate for homeland defense applications that require wide area sensor coverage along with high-confidence tracking solutions. The tracking technology developed under this SBIR will be extensible to private surveillance systems without the need to modify existing hardware systems. As such, a licensable version of a matured software suite will be realizable. Numerica has on-going relationship with Boeing, Lockheed Martin, Raytheon, and various other DoD contractors with programs related to surveillance systems.