Human-computer Environment for Advanced PED (HEAP)

ABSTRACT: FMV collection presents a challenge to the Air Force Special Operation Command (AFSOC), charged with the processing, exploitation, and dissemination (PED) of raw motion imagery to create meaningful intelligence for the warfighter.In order to overcome this challenge, AFSOC operators must be provided with robust human-centered tools and technologies to rapidly, efficiently, and effectively execute FMV PED.Knowledge Based Systems, Inc. (KBSI), along with their research partner PatchPlus, propose to design, assemble and demonstrate an innovative Human-computer Environment for Advanced PED (HEAP) Framework. HEAP is a suite of mixed initiative tools in an extensible framework that supports the use of intuitive human-machine interaction (HMI) technologies, collaboration tools, and anticipatory FMV analysis features to advance the PED paradigm for robust human-machine teaming.HEAP will contain interface abstractions that allow for new input paradigms such as Human Gesture Control, Human Eye Control, and Voice Recognition that will revolutionize FMV PED by increasing efficiency and reducing manpower requirements.Additionally, HEAP will allow the PED system to monitor the human and generate anticipatory actions, alerts, or UI reconfigurations based on human affective state, behaviors, and the task at hand.As a result, PED operators will perform more efficiently in the complex FMV PED environment.; BENEFIT: HEAP provides several benefits to the warfighter including (i) increased human-machine team efficiency using mixed initiative FMV PED capabilities, (ii) reduced manpower requirements by using state-of-the-art interaction technologies to execute tasks more effectively than with a keyboard and mouse, (iii) reductions in human workload by repetitive task reduction, human-centered UI adaptations, and alerts to reduce human operator workload, (iv) rapid integration of new and innovative FMV PED capacities to support the future of FMV PED operations, and (v) improved efficiencies in reporting and product generation due to rapid FMV analysis and intelligence collection.In the short term, the HEAP Framework will facilitate data sensemaking for FMV PED analysts in the intelligence communities of the DoD.Our sponsors from the Human Effectiveness Directorate of AFRL value from a human-centered FMV PED framework that can be tested, verified, and validated in a laboratory setting as well as extended to meet their internal application requirements.Additionally, in the long term, commercial entities in various domains will benefit from not only an ability to quickly identify and analyze video threats, but also a societal advancement to the state-of-the-art of motion video analysis and interaction.The market segment for motion video tools which reduces future investments and improve operations is enormous and we plan to exploit this segment using our intelligence domain skills, intelligence SME input, and unique access to potential end-users.