Multi-Sensor Information Fusion and Information Visualization

"In general, time-critical decision processes require advanced data fusion techniques and innovative visualization capabilities to support the decision making process. It is our position, however, that systems involving complex environments, such as thecockpit of a tactical aircraft, require much more. For systems such as these, the data fusion capability must be fully integrated with an advanced decision optimization capacity in order to present the pilot with the essential, prioritized elements ofeach decision process. Furthermore, the pilot needs an indication of the uncertainty of the data and the confidence in the recommended courses of action. The objective of this research is to demonstrate the combination of Bayesian Network technology,decision theory, and new tools for dynamically constructing large-scale networks, to provide an advanced decision support capability that meets these needs. We will demonstrate the feasibility of this concept by developing a prototype decision supportsystem for dynamic, in-flight, mission planning. This prototype will continually fuse multi-source data, while also providing the pilot with mission plan alternatives that evolve as the combat situation evolves. Additionally, we will leverage ongoingresearch with techniques for cockpit visualization of uncertain data to formulate an approach for Phase II development of a visualization prototype. This background research will greatly facilit