Automated Auditory Cueing and Spatialization System

The proposed innovation is a back-end/front-end integration of an authoring system for data-driven audio cues and a delivery system for simulated spatial audio display. The innovation includes adaptive incorporation of the integrated system with existing speech communications, in a real-time operations pipeline that accepts operational data streams and converts them into relevant auditory cues. Compared to previous auditory display research, this proposed system moves beyond spatial/positional data from operators to incorporate data from operational signals and events. Data-driven audio cues will be provided and supported by patented technologies developed at NCSA/UIUC. Spatial simulation will be provided by AuSIM's proprietary AuSIM3D¿ technologies. This proposal is innovative because it integrates two robust and mature systems that have never been commercially integrated: broad, adaptable tools for data sonification and a rendering pipeline for spatial audio simulation. These technologies are complementary and each has been demonstrated effectively in industrial contexts outside of the laboratory. The resulting system will provide a comprehensive audio operations environment to orchestrate and integrate existing speech communications with synthetic environmental cues that respond to changing conditions represented in operations data. These innovations directly address the stated goals of enhancing system monitoring, crew-system integration and remote collaboration.