Distributed Event Streaming Platform

TrustedQA, Inc. proposes to research and develop an innovative Distributed Event Streaming Platform (DESP) to revolutionize the monitoring of tactical data link messages and synchronization of track data within the AEGIS Weapon System. This Phase I effort will leverage cutting-edge open-source distributed event streaming frameworks, such as Apache Kafka, Apache Pulsar, and Apache Storm, to achieve real-time synchronization of Track Numbers, Track Identification/Classification, and Identification Friend or Foe (IFF) modes and codes. The DESP introduces a decoupled producer-consumer architecture, enabling seamless scalability limited only by AEGIS infrastructure while ensuring robust fault tolerance, linear scalability, interoperability, and adaptability.The DESP will consist of two primary components: the DESP Cluster and endpoint simulations representing key systems like Cooperative Engagement Capability (CEC), Link 16, System Track Manager/Track Server (STM/TS), and Joint Track Manager (JTM). These open-source solutions are already in use within the DoD, mitigating security concerns and expanding the available talent pool for future transitions beyond Phase I. TrustedQA will focus on extensive integration, customization, and deployment configurations tailored to Navy-specific requirements, ensuring data synchronization accuracy and real-time availability across weapon systems.Key Phase I technical objectives include:Seamless interaction with JTM and other AEGIS systems.Real-time monitoring of all tactical data link (TDL) message types, including Link 16 and CEC.Ensuring interoperability across multiple producers and consumers within the AEGIS Weapon System.Developing automated data correction mechanisms to maintain data integrity.Demonstrating consistent, reliable data reception, processing, and synchronization without data loss.Implementing real-time data comparison algorithms for synchronized track attributes.Ensuring minimal resource impact, operating DESP in the background with less than 10% system resource usage.Synchronizing all critical track attributes, including Track Numbers, Identification/Classification, and IFF modes and codes.Exceeding ACS performance benchmarks by 10% or more in data throughput, correction speeds, and reduced message latency.Demonstrating robust fault tolerance and failover mechanisms to ensure zero data loss.The DESP will operate in parallel with existing data transmission methods, functioning as a secondary mechanism to ensure data integrity and synchronization. This architecture allows consumers to pull data from the DESP Cluster, compare it with their Track Stores, and correct discrepancies as needed. Acknowledgment messages and data pointers will guarantee reliable data transmission and reception, ensuring consistent synchronization.