C2I Surrogate Behaviors using Subsumption Architecture and Critic-based Learning

Warfighter decision-making is increasingly being pushed down to lower-levels of command in search of better and more rapid response. This increases requirements for simulation-based assessment, training, and mission rehearsal. Unfortunately, the C2Imodeling of both adversary and friendly forces in simulation is poor, requiring too much labor to set up and run simulations. Even though process-based AI approaches are labor-intensive, they can still produce unrealistic models. Improved cognitivemodeling, especially when capable of learning, holds promise to address the C2I modeling problem, enabling better simulation-based assessment, training, and mission rehearsal, without prohibitively high labor costs.During Phase I, M¿K Technologies identified key technologies that can be used to develop a robust behavior representation and generation system. These technologies were prototyped within a commercial CGF system. The Phase I research and prototypes providea strong foundation for Phase II development and commercialization. M¿K will also leverage its experience in developing powerful, yet easy-to-use toolkits to create a mechanism that will allow the community at large to access the behavior representationtechnology developed under this effort.The proposed approach builds upon a previous successful integration of MIT developed Behavior Based Robotics technology with an HLA-compliant CGF. In addition to achieving believable, unpredictable, adaptable C2Isurrogates, the proposed Phase II approach lays a foundation for future development by providing tools for use by future CGF developers and users to create new, realistic, complex behaviors. It also enables R&D into the development of standards forbehavioral representation. It enables advanced research of CGF-based human behavioral modeling. If successful, the results of this effort will be incorporated into MAK's commercial CGF product, and transitioned to other DoD programs, such as OneSAF andthe STRICOM Robotics STO.