Automated Processing, Exploitation and Dissemination

Parry Labs proposes the research and development of a distributed, scalable, heterogeneous system to perform automated Processing, Exploitation, and Dissemination (PED) of data feeds.The proposed system will run as a distributed cluster that employs Server-less function execution and Containers to enable the reliable, scalable running of applications. The cluster will employ a peer-to-peer overlay network that incorporates aspects of both Software Defined Networking (SDN) and Delay/Disruption Tolerant Networking (DTN). The proposed system will reduce the human workloads both for analyzing and requesting data feeds by automating the workflow. The PED cycle time will be reduced by automated the collection, ingest, processing, and generation of data feeds. On order, data feeds not requiring human intervention will be automatically processed and disseminated. Data feeds requiring additional human analysis can be flagged for review and update by an analyst. Workflows will include options for generating metrics, setting alerts, and managing subscribers for data feeds. Workflow curators will select from one or more data feeds, specify filter criteria, select additional processing, and specify the type of output.