Dual-Filter Approach to Trust in Hybrid Human-Machine Systems

Autonomous systems, when subjected to novel environments and tasks, suffer from issues with unknown unknowns. Under these circumstances, human intervention is frequently required. In deep space, such as a manned mission to Mars, communications with Earth require minutes round trip, effectively removing a typical safety net for the astronauts onboard when dealing with autonomous systems and sensors. Kalman filters provide bounds for system error which are only accurate when sensors perform as expected, and with estimates leaving their advertised bounds when trusted sensors fail. This derivation of the trust-based filter is not only intended to solve this problem but also is based on a human understanding of trust, thereby making it interpretable by astronauts. By providing both autonomous agents and astronauts with the ability to determine which agents are trustworthy, decision-making is simplified and more systems can become autonomous, reducing mental and physical load on the most important assets for the mission.