Numerical Hydrodynamics Simulation of Astrophysical Flows at Intel Xeon Phi Supercomputers

Authors

  • Igor' M. Kulikov Institute of Computational Mathematics and Mathematical Geophysics SB RAS
  • Igor' G. Chernykh Institute of Computational Mathematics and Mathematical Geophysics SB RAS
  • Eduard V. Vorobyov Department of Astrophysics, University of Vienna, Research Institute of Physics of Southern Federal University
  • Alexey V. Snytnikov Institute of Computational Mathematics and Mathematical Geophysics SB RAS
  • Dmitry V. Weins Institute of Computational Mathematics and Mathematical Geophysics SB RAS
  • Alexander A. Moskovsky ZAO RSC Technologies
  • Alexey B. Shmelev ZAO RSC Technologies
  • Victor A. Protasov Novosibirsk State Technical University
  • Alexander A. Serenko Novosibirsk State Technical University
  • Vladislav E. Nenashev Novosibirsk State Technical University
  • Vitaly A. Vshivkov Institute of Computational Mathematics and Mathematical Geophysics SB RAS
  • Alexey S. Rodionov Institute of Computational Mathematics and Mathematical Geophysics SB RAS
  • Boris M. Glinsky Institute of Computational Mathematics and Mathematical Geophysics SB RAS
  • Alexander V. Tutukov Institute of Astronomy RAS

DOI:

https://doi.org/10.14529/cmse160406

Keywords:

high performance computing, numerical astrophysics, Intel Xeon Phi accelerators

Abstract

In this paper we propose a research of AstroPhi code for numerical simulation of astrophysical flows at
Intel Xeon Phi supercomputers. The co-design of a computational astrophysics model are described. The parallel implementation and scalability tests of the AstroPhi code are presented. The results of simulation of interaction between intergalactic wind and a disk galaxy are provided. For AstroPhi code a 134x speed-up with one Intel Xeon Phi accelerator and 75% weak scaling efficiency on 224x Intel Xeon Phi accelerators was obtained. We got peak of performance on a 7168 X 1024 X 1024 mesh size by means 53760 RSC PetaStream threads.

Author Biographies

Igor' M. Kulikov, Institute of Computational Mathematics and Mathematical Geophysics SB RAS

Candidate of Physico-Mathematical Sciences, Laboratory of Parallel Algorithms for Solving Large Problems

Igor' G. Chernykh, Institute of Computational Mathematics and Mathematical Geophysics SB RAS

Candidate of Physico-Mathematical Sciences, Siberian Supercomputer Center

Eduard V. Vorobyov, Department of Astrophysics, University of Vienna, Research Institute of Physics of Southern Federal University

Candidate of Physico-Mathematical Sciences, Laboratory of Space Research

Alexey V. Snytnikov, Institute of Computational Mathematics and Mathematical Geophysics SB RAS

Candidate of Physico-Mathematical Sciences, Laboratory of Parallel Algorithms for Solving Large Problems

Dmitry V. Weins, Institute of Computational Mathematics and Mathematical Geophysics SB RAS

Siberian Supercomputer Center

Alexander A. Moskovsky, ZAO RSC Technologies

Candidate of Chemical Sciences

Vitaly A. Vshivkov, Institute of Computational Mathematics and Mathematical Geophysics SB RAS

Doctor of Science (Phys.&Math.), Professor, Laboratory of Parallel Algorithms for Solving Large Problems

Alexey S. Rodionov, Institute of Computational Mathematics and Mathematical Geophysics SB RAS

Doctor of Science (Engineering), Professor, Laboratory of Dynamic Processes Simulation in Information Networks

Boris M. Glinsky, Institute of Computational Mathematics and Mathematical Geophysics SB RAS

Doctor of Science (Engineering), Professor, Siberian Supercomputer Center

Alexander V. Tutukov, Institute of Astronomy RAS

Doctor of Science (Phys.&Math.), Professor, Department of Stellar Physics and Evolution

References

Tutukov A., Lazareva G., Kulikov I. Gas Dynamics of a Central Collision of Two Galaxies: Merger, Disruption, Passage, and the Formation of a New Galaxy / A. Tutukov // Astronomy Reports. 2011. Vol. 55, No. 9. P. 770-783.

Mitchell N., Vorobyov E., Hensler G. Collisionless Stellar Hydrodynamics as an Efficient Alternative to N-body Methods / N. Mitchell // Monthly Notices of the Royal Astronomical Society. 2013. V. 428, No. 3. P. 2674-2687.

Ardeljan N.V., Bisnovatyi-Kogan G.S., Kosmachevskii G.S., Moiseenko S.G. An implicit Lagrangian code for the treatment of nonstationary problems in rotating astrophysical bodies / N.V. Ardeljan // Astronomy and Astrophysics Supplement Series. 1996. Vol. 115. P. 573-594.

Khoperskov S.A, Vasiliev E.O., Sobolev A.M., Khoperskov A.V. The simulation of molecular clouds formation in the Milky Way / S.A. Khoperskov // Monthly Notices of the Royal Astronomical Society. 2013. Vol. 428. P. 2311-2320.

Fletcher A., Beck R., Shukurov A., Berkhuijsen E., Horellou C. Magnetic fields and spiral arms in the galaxy M51 / A. Fletcher // Monthly Notices of the Royal Astronomical Society. 2014. Vol. 412. P. 2396-2416.

Kulikov I. GPUPEGAS: A New GPU-accelerated Hydrodynamic Code for Numerical Simulations of Interacting Galaxies / I. Kulikov // The Astrophysical Journal Supplement Series. 2014. Vol. 214, Id. 12.

Kulikov I.M., Chernykh I.G., Snytnikov A.V., Glinskiy B.M., Tutukov A.V. AstroPhi: A code for complex simulation of dynamics of astrophysical objects using hybrid supercomputers / I.M. Kulikov // Computer Physics Communications. 2015. Vol. 186. P. 71-80.

Glinskiy B., Kulikov I., Snytnikov A., Romanenko A., Chernykh I., Vshivkov V. Co-design of Parallel Numerical Methods for Plasma Physics and Astrophysics / B. Glinskiy // Supercomputing frontiers and innovations. 2015. Vol. 1, No. 3. P. 88-98.

Vorobyov E., Recchi S., Hensler G. Stellar hydrodynamical modeling of dwarf galaxies: simulation methodology, tests, and first results / E. Vorobyov // Astronomy & Astrophysics. 2015. Vol. 579, Id. A9.

Kulikov I., Chernykh I. Glinskiy B., Weins D., Shmelev A. Astrophysics simulation on RSC massively parallel architecture / I. Kulikov // Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015. 2015. P. 1131-1134.

Vshivkov V., Lazareva G., Snytnikov A., Kulikov I. Supercomputer Simulation of an Astrophysical Object Collapse by the Fluids-in-Cell Method / V. Vshivkov // Lecture Notes of Computer Science. 2009. Vol. 5698. P. 414-422.

Kulikov I., Chernykh I., Katysheva E., Protasov A., Serenko A. The numerical simulation of interacting galaxies by means of hybrid supercomputers / I. Kulikov // Bulletin NCC: Numerical analysis. 2015. Vol. 17. P. 17-33.

Popov M., Ustyugov S. Piecewise parabolic method on local stencil for gasdynamic simulations / M. Popov // Computational Mathematics and Mathematical Physics. 2007. Vol. 47, No. 12. P. 1970-1989.

Popov M., Ustyugov S. Piecewise parabolic method on a local stencil for ideal magnetohydrodynamics / M. Popov // Computational Mathematics and Mathematical Physics. 2008. Vol. 48, No. 3. P. 477-499.

Vshivkov V., Lazareva G., Snytnikov A., Kulikov I., Tutukov A. Hydrodynamical code for numerical simulation of the gas components of colliding galaxies / V. Vshivkov // The Astrophysical Journal Supplement Series. 2011. Vol. 194, Id. 47.

Godunov S., Kulikov I. Computation of Discontinuous Solutions of Fluid Dynamics Equations with Entropy Nondecrease Guarantee / S. Godunov // Computational Mathematics and Mathematical Physics. 2014. Vol. 54. P. 1012-1024.

Vshivkov V., Lazareva G., Snytnikov A., Kulikov I., Tutukov A. Computational methods for ill-posed problems of gravitational gasodynamics / V. Vshivkov // Journal of Inverse and Ill-posed Problems. Vol. 19, No. 1. P. 151-166.

Kulikov I., Vorobyov E. Using the PPML approach for constructing a low-dissipation, operator-splitting scheme for numerical simulations of hydrodynamic flows / I. Kulikov // The Journal of Computational Physics. (submitted, 2016)

Kulikov I., Chernykh I., Snytnikov A., Protasov V., Tutukov A., Glinsky B. Numerical Modelling of Astrophysical Flow on Hybrid Architecture Supercomputers / I. Kulikov // In Parallel Programming: Practical Aspects, Models and Current Limitations (ed. M. Tarkov). 2015. P. 71-116.

Frigo M., Johnson S. The Design and Implementation of FFTW3 / M. Frigo // Proceedings of the IEEE. 2005. Vol. 93, No. 2. P. 216-231.

Kalinkin A., Laevsky Y., Gololobov S. 2D Fast Poisson Solver for High-Performance Computing / A. Kalinkin // Lecture Notes in Computer Science. 2009. Vol. 5698. P. 112-120.

Schive H., Tsai Y., Chiueh T. GAMER: a GPU-accelerated Adaptive-Mesh-Refinement Code for Astrophysics / H. Schive // The Astrophysical Journal. 2010. Vol. 186. P. 457-484.

Podkorytov D., Rodionov A., Sokolova O., Yurgenson A. Using Agent-Oriented Simulation System AGNES for Evaluation of Sensor Networks / D. Podkorytov // Lecture Notes of Computer Science. 2010. Vol. 6235. P. 247-250.

Jaffe Y.L., Smith R., Candlish G., Poggianti B.M., Sheen Y.-K., Verheijen M.A.W. BUDHIES II: A phase-space view of HI gas stripping and star-formation quenching in cluster galaxies / Y. Jaffe // Monthly Notices of the Royal Astronomical Society. 2015. Vol. 448. P. 1715-1728.

Vollmer B., Cayatte V., Balkowski C., Duschl W.J. Ram pressure stripping and galaxy orbits: The case of the Virgo cluster / B. Vollmer // The Astrophysical Journal. 2001. Vol. 561. P. 708-726.

Cayatte V., Kotanyi C., Balkowski C., van Gorkom J.H. A very large array survey of neutral hydrogen in Virgo Cluster spirals. 3: Surface density profiles of the gas / V. Cayatte // The Astronomical Journal. 1994. Vol. 107, No. 3. P. 1003-1017.

Куликов И.М., Черных И.Г., Глинский Б.М. AstroPhi: программный комплекс для моделирования динамики астрофизических объектов на гибридных суперэвм, оснащенных ускорителями Intel Xeon Phi / И.М. Куликов // Вестник Южно-Уральского государственного университета. Серия: Вычислительная математика и информатика. 2013. Т. 2, № 4. С. 57-79.

Downloads

Published

2016-11-18

Issue

Vol. 5 No. 4 (2016)

Section

Supercomputer Modeling

License

Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.