Dynamic Computational Load Balancing During Simulations of Instability Flows

Aleksandra M. Titova
FSUE "RFNC-VNIITF named after Academ. E.I. Zababakhin"

Nikita A. Mikhaylov
FSUE "RFNC-VNIITF named after Academ. E.I. Zababakhin"

Yulius F. Yusupov
FSUE "RFNC-VNIITF named after Academ. E.I. Zababakhin"


Abstract


In this work we describe the algorithm of dynamic computational load balancing during modeling of instability flows over dynamically refined mesh using three dimensional eulerian gas dynamic program. Balancing of computational load between MPI-fragments is executed along lines (set of MPI-fragments that are situated along preferential direction) independently and may be carried out in three regimes: accounting number of cells, accounting real calculation time, and automatic (or composite) regime. We use adaptation with reservation to minimize overheads for adaptation and balancing: we construct a sequence of adaptation, balancing and calculation stages during fixed count of steps – "Adaptation — Balancing — Calculation" cycle (A–B–C cycle). The optimal count of steps in A–B–C cycle is determined by minimization of task calculation time that depends on count of cells. For testing of realized algorithm we considered a spherical implosion of a light material by a dense shell (Youngs’ problem). A source of instabilities was the initial harmonic perturbation on the contact boundary. The calculations are made using second-level dynamically adaptive mesh refinement in the region of instability growth. We analyze the calculation time of the problem using different regimes of load balancing algorithm. The result of the research proves the efficiency of using adaptive mesh refinement with reservation within A–B–C cycle. The automatic regime of load balancing is the most stable for three-dimensional modelling.

Keywords


gas dynamics; instability flows; spherical implosion; adaptation mesh refinement; load balancing; computational load

References


Yanilkin Y.V., Stacenko V.P., Kozlov V.I. Mathematical Modeling of Turbulent Mixing in Compressible Medium. Vol. 2: Training manual. Sarov: Russia Research Nuclear Center – All-Russian SRI of Experimental Physics, 2020. 407 p. (in Russian).

Youngs D.L., Williams R.J. Turbulent Mixing in Spherical Implosions. Int. J. Numer. Methods Fluids. 2008. Vol. 56, no. 8. P. 1597–1603. DOI: 10.1002/fld.1594.

Glazyrin I.V., Mikhaylov N.A. The Torsion Method for Contact Bounds for Modeling of Three-dimensional Multi-component Compressible Flows in Eulerian Variables. Zababakhin Scientific Readings: Collection of Abstracts XIII International Conference, Snezhinsk, 20–24 March 2017. Snezhinsk: Publishing of RFNC VNIITF, 2017. P. 326. (in Russian).

Chevalier C., Pellegrini F. PT-Scotch: A Tool for Efficient Parallel Graph Ordering. Parallel Computing. 2008. Vol. 34, no. 6. P. 318–331. DOI: 10.1016/j.parco.2007.12.001.

Karypis G. METIS and ParMETIS. Encyclopedia of Parallel Computing. Springer US, 2011. P. 1117–1124. DOI: 10.1007/978-0-387-09766-4_500.

Toro E. Rieman Solvers and Numerical Methods for Fluid Dynamics: a Practical Introduction. Berlin, Heidelberg: Springer Verlag, 2009. 721 p. DOI: 10.1007/b79761.

Darwish M., Moukalled F. TVD-schemes for Unstructured Grids. International Journal of Heat and Mass Transfer. 2003. Vol. 46, no. 8. P. 599–611. DOI: 10.1016/S0017-9310(02)00330-7.

Glazyrin I.V., Mikhailov N.A. Finite-Volume Scheme for Multicomponent Compressible Flow on Unstructed Meshes in the Focus 3D Code. JCMMP. 2021. Vol. 61, no. 6. P. 1019–1033. (in Russian) DOI: 10.31857/S0044466921060041.

Balashov N.M., Glazyrin I.V., Mikhaylov N.A. Two-dimensional Adaptive Mesh Refinement in Gas Dynamics Program. Parallel Computational Technologies – XIV International Conference, PCT’2020, Perm, 31 March – 2 April 2020. Short articles and posters’ description. Chelyabinsk: Publishing of the South Ural University, 2020. P. 325. (in Russian).

Jasak H., Tukovic Z. Automatic Mesh Motion for the Unstructed Finite Volume Method. Transactions of FAMENA. 2006. Vol. 30, no. 2. P. 1–20.

Colella P., Berger M. Local Adaptive Mesh Refinement for Shock Hydrodynamics. Journal of Computational Physics. 1989. Vol. 82, no. 1. P. 64–84. DOI: 10.1016/0021-9991(89)90035-1.

Glazyrin I.V., Glazyrina N.V., Mikhaylov N.A., Pisklova M.A. Using Dynamic Mesh Adaptation for Rayleigh-Taylor Instability Calculations. Zababakhin Scientific Readings: Collection of Materials XVI International Conference, 29 May – 2 June 2023. Snezhinsk: Publishing of RFNC VNIITF, 2023. P. 364. (in Russian).

Olenev N.N. Basics of MPI Parallel Programming. Moscow: Calculating center A.A. Dorodnicina, 2005. 79 p. (in Russian).

Joggerst C.C., Nelson A., Woodward P., et al. Cross-code Comparison of Mixing During the Implosion of Dense Cylindrical and Spherical Shells. Journal of Computational Physics. 2014. Vol. 82, no. 1. P. 154–173. DOI: 10.1016/j.jcp.2014.06.037.




DOI: http://dx.doi.org/10.14529/cmse250304