Deep Learning Enhanced Multi-modal Sensing System for Real-time Distance Measurement During Underway Replenishment Operations

Replenishment ships play a crucial role in modern naval operations. These vessels provide essential supplies and support services to other naval vessels at sea with underway replenishment (UNREP), enabling them to operate effectively and sustainably over extended periods of time. However, it is also a challenging operation that requires precise execution and effective communication to ensure the safety of personnel and equipment. For the safety of UNREP operation, it is crucial to establish an advanced sensing-communication system that can 1) consistently and accurately monitor the distance between two ships in all different weather conditions; 2) promptly deliver the measured distant information to the crew members and the station; and 3) enable secure and clear voice communication between the captains on two ships. Leveraging the emerging machine learning technologies and the much-improved performance of modern distance sensing technologies, Intelligent Fusion Technology, Inc. proposes to develop a novel deep learning based hybrid sensing system that takes advantage of multiple domains of sensing data for the measurement of the relative distance between the receiving ship and the replenishment ship. Moreover, a software defined radio system will be established for RF communication between the distance sensing system and the command centers on both ships.