Automated Factor-Based Sensitivity Analysis

Numerica proposes a novel approach to automated factor-based sensitivity analysis in high-dimensional search spaces, leveraging recent advances in physics and machine learning utilizing low-rank tensor models and adaptive sampling techniques to overcome the curse of dimensionality for many problems. Based on this technology, we propose an automated software analysis tool that exercises the algorithm under test (e.g., a mission-critical BMDS algorithms such as AEGIS FOM) by searching the potentially huge space of input parameters (model/algorithm parameters, scenario parameters, Monte Carlo realizations, code modifications, etc.) to analyze a specified set of quantities of interest (e.g., to identify optimal performance configurations, sensitivities to input data, performance boundaries, behavioral trends, potential bugs, etc.). To allow deeper insights into the internal details of the algorithm under test, we also propose to incorporate outputs of code execution analysis tools - such as code coverage and profiling tools - in addition to the algorithm’s native outputs. Approved for Public Release | 20-MDA-10643 (3 Dec 20)