SC20 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Scaling the Hartree-Fock Matrix Build on Summit

Authors: Giuseppe M. J. Barca (Australian National University); David Poole, Jorge Galvez Vallejo, and Melisa Alkan (Iowa State University); Colleen Bertoni (Argonne National Laboratory (ANL)); Alistair P. Rendell (Flinders University, Australia); and Mark S. Gordon (Iowa State University)

Abstract: Usage of Graphics Processing Units (GPU) has become strategic for simulating the chemistry of large molecular systems, with many top supercomputers utilizing GPUs as their main source of computational horsepower. In this paper, a new fragmentation-based Hartree-Fock matrix build algorithm designed for scaling on many-GPU architectures is presented. The new algorithm uses a novel dynamic load balancing scheme based on a binned shell-pair container to distribute batches of significant shell quartets with the same code path to different GPUs. This maximizes computational throughput and load balancing, and eliminates GPU thread divergence due to integral screening. Additionally, the code uses a novel Fock digestion algorithm to contract electron repulsion integrals into the Fock matrix, which exploits all forms of permutational symmetry and eliminates thread-synchronization requirements. The implementation demonstrates excellent scalability on the Summit computer, achieving good strong scaling performance up to 4096 nodes, and linear weak scaling up to 612 nodes.

Back to Technical Papers Archive Listing