Low-Latency Embedded Vision Processor (LLEVS)

ABSTRACT: In this Phase I effort, the PI2 team will perform a set of technology and algorithmic trade studies with the goal of finding innovative new system concepts for a VPHS using all digital processing, and with extremely low latency (at most one frame) from light into the sensor to light out of the display. We approach this attempting to meet the system threshold and objective goals as stated, and expect to develop multiple implementation options as we perform the trade study. At a minimum, two solutions will be architecteda high risk approach, which targets the objective goals, and a low risk approach, which is free to relax metrics to the threshold goals. We will also explore value-added information and techniques that can be derived from the all-digital VPHS and presented to the operator. Finally, after selection of appropriate imager, microdisplay, SoC, and FPGA technologies, along with image processing algorithms and techniques, we will develop requirements and an architecture for the proposed VPHS to be developed in this research, predicted performance metrics, and plans for prototyping and demonstration in Phase II. The Phase I effort will conclude with a Final Review and Final Report.; BENEFIT: Head mounted displays using analog technology are extremely important to the tactical warfighter, but cant take advantage of modern information overlays possible with digital imaging. Digital imaging, on the other hand, suffers from latency which is unacceptable in close-quarters combat situations, and requires much more power, which shortens mission time on batteries. This research will develop low-latency digital imaging systems for the warfighter, enabling tactical information to be displayed as an overlay. There is significant commercial interest in augmented and virtual reality headsets, and this research is addressing one of the barriers to that technology's viability. Hence, this research has significant commercial applicability as well as tactical military importance.