Enhanced Smartphone Video Processing Platform

ABSTRACT: A SUAS video processing platform is developed based on clustering multiple COTS smartphones in which each is deployed with software modules of the clustering support, third-party video processing libraries, and an interface wrapper between video applications and the clustering environment. The smartphones are clustered in a local network built from the available interfaces of the phones. The message passing interface framework is employed to implement the clustering environment. The functions in a user program written in traditional languages calling third party video processing libraries such as OpenCV are hooked to the functions in the wrapper, and then the wrapper automatically decide the parallelization approach based on the function characteristics and current load situations in the cluster. This ensures the traditional video processing algorithms to be easily ported to the platform. BENEFIT: Anticipated Benefits: These products will have the following competitive advantages, when compared with current state-of-the-art products such as traditional radar surveillance systems: Ability to do intensive video processing using COTS smartphones with good SWAP capabilities Ability to scale up the performance by increasing the computing power to achieve 70 mega pixels per second Video processing algorithm development is facilitated in this platform by automatic parallelization and hiding low-level details from high-level programming Commercial Applications: The technologies in this proposal technology can be implemented as a video processing algorithm engine and sold as products or licenses for the mobile imaging and video service markets. The potential applications for the ESVPP technology exhibit excellent potential in a wide variety of markets in both government and commercial sectors, especially in traffic control market, the commerce data processing/data-mining market, and the surveillance market.