AstroPhi: программный комплекс для моделирования динамики астрофизических объектов на гибридных суперэвм, оснащенных ускорителями Intel Xeon Phi

Игорь Михайлович Куликов, Игорь Геннадьевич Черных, Борис Михайлович Глинский

Аннотация


В статье представлен новый сверхмасштабируемый программный комплекс AstroPhi для моделирования динамики астрофизических объектов на гибридных суперЭВМ, оснащенных ускорителями Intel Xeon Phi. Численный метод решения газодинамических уравнений основан на специально адаптированной для реализации на множестве ускорителей комбинации метода крупных частиц и метода Годунова. Для решения уравнения Пуассона используется быстрое преобразование Фурье. Программная реализация была отдельно протестирована на газодинамических задачах, на задаче решения уравнения Пуассона и на классических задачах гравитационной газовой динамики. Показано ускорение программного комплекса при использовании ускорителей Intel Xeon Phi, уточнено понятие масштабируемости при использовании ускорителей. Представлены результаты моделирования коллапса астрофизических объектов.

Ключевые слова


математическое моделирование; параллельные вычисления; ускорители Intel Xeon Phi; астрофизика

Полный текст:

PDF

Литература


Ardeljan, N.V. An Implicit Lagrangian Code for the Treatment of Nonstationary Problems in Rotating Astrophysical Bodies / N.V. Ardeljan, G.S. Bisnovatyi-Kogan, S.G. Moiseenko // Astronomy & Astrophysics. — 1996. — Vol. 115. — P. 573–594.

Tutukov, A. Gas Dynamics of a Central Collision of Two Galaxies: Merger, Disruption, Passage, and the Formation of a New Galaxy / A. Tutukov, G. Lazareva, I. Kulikov //

Astronomy Reports. — 2011. — Vol. 55, I. 9. — P. 770–783.

Gingold, R.A. Smoothed Particle Hydrodynamics: Theory and Application to Non-spherical Stars / R.A. Gingold, J.J. Monaghan // Monthly Notices of the Royal Astronomical Society. — 1977. — Vol. 181. — P. 375–389.

Luci, L.B. A Numerical Approach to the Testing of the Fission Hypothesis / L.B. Luci // The Astrophysical Journal. — 1977. — Vol. 82, № 12. — P. 1013–1024.

Collela, P. The Piecewise Parabolic Method (PPM) for Gas-dynamical Simulations / P. Collela, P.R. Woodward // Journal of Computational Physics. — 1984. — Vol. 54. —

P. 174–201.

Norman, M. The Impact of AMR in Numerical Astrophysics and Cosmology / M. Norman // Lecture Notes in Computational Science and Engineering. — 2005. — Vol. 41. — P. 413–430.

Hockney, R.W. Computer Simulation Using Particles / R.W. Hockney, J.W. Eastwood — New York: McGraw-Hill, 1981. — 540 p.

Couchman, H. Hydra Code Release / H. Couchman, F. Pearce, P. Thomas. URL: http://arxiv.org/abs/astro-ph/9603116 (дата обращения: 25.07.2013).

Barnes, J. A Hierarchical O(N log N ) Force-calculation Algorithm / J. Barnes, P. Hut // Nature. — 1986. — Vol. 324. — P. 446–449.

Dubinski, J. GOTPM: A Parallel Hybrid Particle-Mesh Treecode / J. Dubinski, J. Kim, C. Park, R. Humble // New Astronomy. — 2004. — Vol. 9. — P. 111–126.

Fedorenko, R. A Relaxation Method for Solving Elliptic Difference Equations / R. Fedorenko // U.S.S.R. Computational Mathematics and Mathematical Physics. — 1961. — Vol. 1. — P. 1092–1096.

Godunov, S.K. A Difference Scheme for Numerical Solution of Discontinuous Solution of Hydrodynamic Equations / S.K. Godunov // Matematicheskii Sbornik. — 1959. — Vol. 47. — P. 271–306.

Kulikovskii, A.G. Mathematical Aspects of Numerical Solution of Hyperbolic Systems / A. Kulikovskii, N. Pogorelov, A. Semenov. — Moscow:Fizmatlit, 2001. — 608 p.

Toro, E.F. Riemann Solvers and Numerical Methods for Fluid Dynamics / E. Toro. — Heidelberg:Springer-Verlag, 1999. — 686 p.

Courant, R. On the Solution of Nonlinear Hyperbolic Differential Equations by Finite Difference / R. Courant, E. Isaacson, M. Rees // Communications on Pure and Applied Mathematics. — 1952. — Vol. 5, № 3. — P. 243–255.

Roe, P. Approximate Riemann Solvers, Parameter Vectors, and Difference Schemes / P. Roe // Journal of Computational Physics. — 1997. — Vol. 135, I. 2. — P. 250–258.

Engquist, B. One-sided Difference Approximations for Nonlinear Conservation Laws / B. Engquist, S.J. Osher // Mathematics of Computation. — 1981. — Vol. 36, № 154.— P. 321–351.

Harten, A. On Upstream Differencing and Godunov-type Schemes for Hyperbolic Conservation Laws / A. Harten, P.D. Lax, B. Van Leer // Society for Industrial and Applied Mathematics Review. — 1983. — Vol. 25, № 1. — P. 35–61.

Einfeld, B. On Godunov-type Methods for Gas Dynamics / B. Einfeld // Society for Industrial and Applied Mathematics Journal on Numerical Analysis. — 1988. — Vol. 25, № 2. — P. 294–318.

Batten, P. On the Choice of Savespeeds for the HLLC Riemann Solver / P. Batten, N. Clarke, C. Lambert, D.M. Causon // Society for Industrial and Applied Mathematics Journal on Computing. — 1997. — Vol. 18, № 6. — P. 1553–1570.

Van Leer, B. Towards the Ultimate Conservative Difference Scheme. V - A Second-order Sequel to Godunov’s Method / B. Van Leer // Journal of Computational Physics. — 1979. — Vol. 32. — P. 101–136.

Wadsley, J.W. Gasoline: a Flexible, Parallel Implementation of TreeSPH / J.W. Wadsley, J. Stadel, T. Quinn // New Astronomy. — 2004. — Vol. 9, I. 2. — P. 137–158.

Matthias, S. GRAPESPH: Cosmological Smoothed Particle Hydrodynamics Simulations with the Special-purpose Hardware GRAPE / S. Matthias // Monthly Notices of the Royal Astronomical Society. — 1996. — Vol. 278, I. 4. — P. 1005–1017.

Springel, V. The Cosmological Simulation Code GADGET-2 / V. Springel // Monthly Notices of the Royal Astronomical Society. — 2005. — Vol. 364, I. 4. — P. 1105–1134.

Jin, S. The Relaxation Schemes for Systems of Conservation Laws in Arbitrary Space Dimensions / S. Jin, Z. Xin // Communications on Pure and Applied Mathematics. — 1995. — Vol. 48. — P. 235–276.

Godunov, S.K. Experimental Analysis of Convergence of the Numerical Solution to a Generalized Solution in Fluid Dynamics / S.K. Godunov, Yu.D. Manuzina, M.A. Nazareva // Computational Mathematics and Mathematical Physics. — 2011. — Vol. 51. — P. 88–95.

Ziegler, U. Self-gravitational Adaptive Mesh Magnetohydrodynamics with the NIRVANA Code / U. Ziegler // Astronomy & Astrophysics. — 2005. — Vol. 435. — P. 385–395.

Mignone, A. The Piecewise Parabolic Method for Multidimensional Relativistic Fluid Dynamics / A. Mignone, T. Plewa, G. Bodo // The Astrophysical Journal. — 2005. — Vol. 160. — P. 199–219.

Hayes, J. Simulating Radiating and Magnetized Flows in Multiple Dimensions with ZEUS MP / J. Hayes, et al. // The Astrophysical Journal Supplement Series. — 2006. — Vol. 165. — P. 188–228.

Teyssier, R. Cosmological Hydrodynamics with Adaptive Mesh Refinement. A New High Resolution Code Called RAMSES / R. Teyssier // Astronomy & Astrophysics. — 2002. — Vol. 385. — P. 337–364.

Kravtsov, A. Constrained Simulations of the Real Universe. II. Observational Signatures of Intergalactic Gas in the Local Supercluster Region / A. Kravtsov, A. Klypin, Y. Hoffman // The Astrophysical Journal. — 2002. — Vol. 571. — P. 563–575.

Stone, J. Athena: A New Code for Astrophysical MHD / J. Stone, et al. // The Astrophysical Journal Supplement Series. — 2008. — Vol. 178. — P. 137–177.

Brandenburg, A. Hydromagnetic Turbulence in Computer Simulations / A. Brandenburg, W. Dobler // Computer Physics Communications. — 2002. — Vol. 147. — P. 471–475.

Schive, H. GAMER: a GPU-accelerated Adaptive-Mesh-Refinement Code for Astrophysics / H. Schive, Y. Tsai, T. Chiueh // The Astrophysical Journal. — 2010. — Vol. 186. — P. 457–484.

Murphy, J. BETHE-Hydro: An Arbitrary Lagrangian-Eulerian Multidimensional Hydrodynamics Code for Astrophysical Simulations / J. Murphy, A. Burrows // The Astrophysical Journal Supplement Series. — 2008. — Vol. 179. — P. 209–241.

Springel, V. E Pur Si Muove: Galilean-invariant Cosmological Hydrodynamical Simulations on a Moving Mesh / V. Springel // Monthly Notices of the Royal Astronomical Society. — 2010. — Vol. 401. — P. 791–851.

Bruenn, S. 2D and 3D Core-collapse Supernovae Simulation Results Obtained with the CHIMERA Code / S. Bruenn, et al. // Journal of Physics. — 2009. — Vol. 180. — P. 1–5.

Vshivkov, V. Hydrodynamical Code for Numerical Simulation of the Gas Components of Colliding Galaxies / V. Vshivkov, G. Lazareva, A. Snytnikov, I. Kulikov, A. Tutukov // The Astrophysical Journal Supplement Series. — 2011. — Vol. 194, I. 47. — P. 1–12.

Gonzalez, M. HERACLES: a Three-dimensional Radiation Hydrodynamics Code / M. Gonzalez, E. Audit, P. Huynh // Astronomy & Astrophysics. — 2007. — Vol. 464. — P. 429–435.

Krumholz, M.R. Radiation-hydrodynamic Simulations of the Formation of Orion-like Star Clusters. I. Implications for the Origin of the Initial Mass Function / M.R. Krumholz, R.I. Klein, C.F. McKee, J. Bolstad // The Astrophysical Journal. — 2007. — Vol. 667, I. 74. — P. 1–16.

Mignone A. PLUTO: A Numerical Code for Computational Astrophysics / A. Mignone, et

al. // The Astrophysical Journal Supplement Series. — 2007. — Vol. 170. — P. 228–242.

Almgren A. CASTRO: A New Compressible Astrophysical Solver. I. Hydrodynamics and Self-gravity / A. Almgren, et al. // The Astrophysical Journal. — 2010. — Vol. 715. — P. 1221–1238.

Feng Y. Terapixel Imaging of Cosmological Simulations / Y. Feng, et al. // The Astrophysical Journal Supplement Series. — 2011. — Vol. 197, I. 18. — P. 1–8.

Enzo-P: Petascale Enzo and the Cello Project / URL:

http://mngrid.ucsd.edu/projects/cello/ (дата обращения: 25.07.2013).

PetaART: Toward Petascale Cosmological Simulations Using the Adaptive Refinement Tree (ART) Code / URL: http://www.cs.iit.edu/zlan/petaart.html (дата обращения: 25.07.2013).

Ferrari, A. A New Parallel SPH Method for 3D Free Surface Flows / A. Ferrari, et al. // High performance computing on vector systems 2009. — 2010. — Part 4. — P. 179–188.

Van Straalen, B. Scalability Challenges for Massively Parallel AMR Applications / B. Van Straalen, J. Shalf, T. Ligocki, N. Keen, W. Yang // In IPDPS ’09: Proceedings of the 2009 IEEE International Symposium on Parallel & Distributed Processing, Washington, DC, USA. — P. 1-–12.

Vshivkov, V. A Operator Approach for Numerical Simulation of Self-gravitation Gasdynamic Problem / V. Vshivkov, G. Lazareva, I. Kulikov // Computational Technologies. — 2006. — Vol. 11, № 3. — P. 27–35.

Vshivkov, V. A Modified Fluids-in-cell Method for Problems of Gravitational Gas Dynamics / V. Vshivkov, G. Lazareva, I. Kulikov // Optoelectronics, Instrumentation and Data Processing. — 2007. — Vol. 43, I. 6. — P. 530–537.

Vshivkov, V. Computational Methods for Ill-posed Problems of Gravitational Gasodynamics / V. Vshivkov, G. Lazareva, A. Snytnikov, I. Kulikov, A. Tutukov // Journal of Inverse and Ill-posed Problems. — 2011. — Vol. 19, I. 1. — P. 151–166.

Aksenov, A.V. Symmetries and Relations Between Solutions of a Class of Euler-Poisson Darboux Equations / A.V. Aksenov // Reports of RAS. — 2001. — Vol. 381, I. 2. — P. 176–179.

Vshivkov, V. Supercomputer Simulation of an Astrophysical Object Collapse by the Fluids in-Cell Method / V. Vshivkov, G. Lazareva, A. Snytnikov, I. Kulikov // Lecture Notes in Computational Science. — 2009. — Vol. 5698. — P.414–422.

Petrov, M.I. Simulation of the Gravitational Collapse and Fragmentation of Rotating Molecular Clouds / M.I. Petrov, P.P. Berczik // Astronomische Nachrichten. — 2005. — Vol. 326. — P. 505–513.




DOI: http://dx.doi.org/10.14529/cmse130405