Supporting MultiPhysics Workflows for Particle Accelerator Simulations

The DOE High Energy Physics Accelerator Technology subprogram supports the development of new particle accelerators to enable discovery science in high‐energy physics, and through accelerator stewardship works to make accelerator technology widely available to science and industry. The DOE High Energy Physics (HEP) program was created to understand how our universe works at its most fundamental level. Breakthroughs resulting from the program have broad applicability in areas as diverse as science, medicine, industry, and homeland security. Yet despite the recognized importance of accelerators, creating advances in this field has been hindered by the lack of effective computational tools. Designing new systems is extremely complex, and the current workflow is difficult to use, prone to error, and does not effectively use high performance computing and other resources. A customizable software application based on the Computational Model Builder (CMB) for accelerator modeling and simulation is being developed to address the needs of multi‐physics workflows. CMB is an open‐source framework designed to support the creation of customized applications for numerical simulations. CMB will be extended for advanced accelerator design, simulation, and optimization by supporting multi‐physics workflows, enabling simple management of high performance computing resources, and tight integration across pre‐processing, simulation, and post‐processing tasks using scalable computing architectures. Phase I focused on providing an end‐to‐end application for defining electromagnetic simulations based on the Omega3P simulation module, one of six multi‐physics modules provided by ACE3P (Advanced Computational Electromagnetics 3D Parallel) analysis suite. The application was successfully executed on the NERSC HPC systems, including final post‐processing of the results. In Phase II we propose extending this work to support all of the ACE3P modules resulting in an end user system capable of fully supporting multi‐physics simulations for high‐energy accelerator systems as well as improving its ease of use. In addition, this work will improve the utilization of DOE’s HPC resources by incorporating in situ visualization techniques into the simulation environment. Particle accelerators are essential to scientific discovery as they advance our understanding of the fundamental properties of matter, energy, space, and time. Opportunities exist to design new accelerators, which can promote innovation and develop new products and services. Because the system developed here is being released as open‐source software, the resulting work will facilitate the creation of extended research communities, and provide a commercialization strategy based on services and customization. Keywords: High Energy Simulation, Multi‐Physics Simulation, HPC Job Management, Asset/Artifact Tracking, Visualization, Post‐Processing, Pre‐Processing