Benchmarking Analysis for Rapid Transition (BART)

The selection of model fidelity in military simulations, particularly for the Missile Defense Agency (MDA), presents a challenge due to the high computational cost of high-fidelity models. These costs limit the exploration of operational scenarios. Introducing a range of model fidelities could significantly enhance the analytic research environment, providing the flexibility to choose the appropriate model for each study, thereby reducing computational costs and expanding the evaluation range. The development of benchmarks to measure model accuracy against a 'nominal dataset' is central to this approach enables automatic model tuning to optimize simulations. The Benchmarking Analysis for Rapid Transition (BART) capability establishes a benchmarking framework within a software toolkit for auto-generating models for MDA analyses, focusing initially on ballistic missile models in the Advanced Framework for Simulation and Integrated Modeling (AFSIM). This effort includes collecting benchmark data, optimizing model creation, and ensuring models are robust across a variety of scenarios. Confidence in model fidelity is crucial, requiring standardized, technically sound benchmarking techniques. Phase I of this initiative focuses on establishing benchmarks for ballistic missile models, while Phase II plans to extend these benchmarks to include more complex vehicle types and improve model accuracy across broader operational parameters. Approved for Public Release | 24-MDA-11906 (16 Sep 24)