Framework for Integrating Cognitive Models into Virtual Environments

We propose to develop a framework for linking cognitive models with virtual environment simulations of the sort that are typically used in military training applications. The framework will be designed to accommodate a variety of different cognitive models and simulations. It will supply a cognitive model with sensory information obtained from a simulation, and enact cognitive model motor and other commands in the simulation, while imposing human-like limitations on sensory information processing and control. The framework will be based on a formal analysis of requirements, including surveys of candidate simulations, cognitive architectures, and human performance data. It will include its own graphics and physics engines so that, where necessary, it can supplement an attached simulation in order to present cognitive models with complete and consistent phenomena. It is based on portable software and distributed processing middleware, allowing the framework to operate on and be accessed from many common computing platforms and language. And it includes logging, replication and monitoring mechanisms to facilitate experimentation.