TETMAN: Three-dimensional Exploitation Techniques for Moving And Non-rigid targets

The Air Force is seeking a means of using multiple types of sensors (EO, IR, RF) on multiple platforms to perform layered sensing of a large region. The sensors will combine their outputs – including feature extraction/data representation – through a shared GIS system. The multi-sensor, co-registered data will result in improved situational awareness. Human dismounts will be the smallest object of interest. Relatedly, the Air Force also seeks an ability to model human (non-rigid) motion. This requires 3D modeling. Furthermore, in the context of the layered sensing scenario above, this 3D human motion modeling implies an ability to detect, recognize/categorize/identify, and track dismounts at some distance. Also, given that at least some of the sensors will be airborne, this implies that the sensor and non-rigid target object both will be moving. The sensor output will feed into the above GIS layered sensing system. In response to these needs, Photon-X, Inc. proposes to research the use of its 3D spatial phase imaging camera to discern humans within a scene, capture human motion, and relay the information to a GIS database for continuous situation awareness. The Photon-X system uses a single video camera to capture a high-resolution 3D image at any range (lens-determined). BENEFIT: If successful, the proposed research would provide the basis for high-resolution tracking of human motion, placed in precise context within a GIS framework. This would greatly enhance situation awareness within the monitored target area. Capabilities for layered sensing and GIS-registered data would offer a significant additional surveillance and intelligence tool for numerous government entities. Furthermore, many of the technologies expected in this SBIR project lend themselves to commercial uses, including: security monitoring for trespassers, group segmentation to differentiate individuals at a security access point, and human motion modeling for various remote control or gaming and entertainment uses.