GAMER Code Development – NCSA Gravity Group

GAMER is a GPU-accelerated Adaptive-MEsh-Refinement (AMR) code for astrophysics. It adopts a hybrid OpenMP/MPI/GPU parallelism model to utilize both CPU and GPU computing power and further takes advantage of the simultaneity between CPU computation, GPU computation, and CPU-GPU communication. GAMER has been demonstrated to achieve high parallel efficiency for both weak and strong scaling on Blue Waters using up to 4,096 GPUs and 65,536 CPU cores. It thus provides a unique numerical tool to study various astrophysical phenomena requiring resolutions that are not realistically attainable by other CPU-based AMR codes.

We have applied GAMER to several cutting-edge astrophysical simulations. For example, the left figure shows a merging galaxy clusters with a spatial resolution almost an order of magnitude higher than the previous work. This will allow astrophysicists, for the first time, to resolve the turbulence cascade in the intracluster medium on scales comparable to Chandra observations. The right figure shows an isolated disk galaxy simulation aiming for producing a dynamically evolving interstellar medium, undergoing repeated cycles of collapse, star formation, feedback, rarefaction, and re-collapse which have not been fully resolved previously in a global galactic scale simulation.

Project Members: Hsi-Yu Schive, Matthew Turk, Nathan Goldbaum

Collaborators: John ZuHone (Harvard-Smithsonian Center for Astrophysics)

Publications:

Chan, J. H. H., Schive, H.-Y., Woo, T.-P., & Chiueh, T. (2018). How do stars affect $\psi$DM halos? Monthly Notices of the Royal Astronomical Society, 478(2), 2686–2699. https://doi.org/10.1093/mnras/sty900

Chen, S.-R., Schive, H.-Y., & Chiueh, T. (2017). Jeans Analysis for Dwarf Spheroidal Galaxies in Wave Dark Matter. Monthly Notices of the Royal Astronomical Society, 468(2), 1338–1348. https://doi.org/10.1093/mnras/stx449

De Martino, I., Broadhurst, T., Tye, S.-H. H., Chiueh, T., Schive, H.-Y., & Lazkoz, R. (2017). Recognising Axionic Dark Matter by Compton and de-Broglie Scale Modulation of Pulsar Timing. Physical Review Letters, 119(22). https://doi.org/10.1103/PhysRevLett.119.221103

Leung, E., Broadhurst, T., Lim, J., Diego, J. M., Chiueh, T., Schive, H.-Y., & Windhorst, R. (2018). Magnification Bias of Distant Galaxies in the Hubble Frontier Fields: Testing Wave vs. Particle Dark Matter Predictions. ArXiv:1806.07905 [Astro-Ph]. http://arxiv.org/abs/1806.07905

Lin, S.-C., Schive, H.-Y., Wong, S.-K., & Chiueh, T. (2018). Self-consistent construction of virialized wave dark matter halos. Physical Review D, 97(10). https://doi.org/10.1103/PhysRevD.97.103523

Molnar, S. M., Schive, H.-Y., Birkinshaw, M., Chiueh, T., Musoke, G., & Young, A. J. (2017). Hydrodynamical Simulations of Colliding Jets: Modeling 3C 75. The Astrophysical Journal, 835(1), 57. https://doi.org/10.3847/1538-4357/835/1/57

Schive, H.-Y., & Chiueh, T. (2018). Halo Abundance and Assembly History with Extreme-Axion Wave Dark Matter at $z\ge 4$. Monthly Notices of the Royal Astronomical Society: Letters, 473(1), L36–L40. https://doi.org/10.1093/mnrasl/slx159

Schive, H.-Y., ZuHone, J. A., Goldbaum, N. J., Turk, M. J., Gaspari, M., & Cheng, C.-Y. (2017). GAMER-2: a GPU-accelerated adaptive mesh refinement code -- accuracy, performance, and scalability. ArXiv:1712.07070 [Astro-Ph]. http://arxiv.org/abs/1712.07070

Zhang, U.-H., Schive, H.-Y., & Chiueh, T. (2018). Magnetohydrodynamics with GAMER. The Astrophysical Journal Supplement Series, 236(2), 50. https://doi.org/10.3847/1538-4365/aac49e