MoHA: A Composable System for Efficient In-Situ Analytics on Heterogeneous HPC Systems

Authors: Haoyuan Xing (Ohio State University), Gagan Agrawal (Augusta University), and Rajiv Ramnath (Ohio State University)

Abstract: Heterogeneous, dense computing architectures consisting of several accelerators, such as GPUs, attached to general-purpose CPUs are now integral to high-performance computing (HPC) systems. These architectures, however, pose severe memory and I/O constraints to computations involving in-situ analytics. This paper introduces MoHA, a framework for in-situ analytics that is designed to efficiently use the limited resources available on heterogeneous platforms. MoHA achieves this efficiency through the extensive use of bitmaps as a compressed or summary representation of simulation outputs. Our specific contributions in this paper include the design of bitmap generation and storage methods suitable for GPUs, the design and efficient implementation of a set of key operators for MoHA and demonstrations of how several real queries on real datasets can be implemented using these operators. We demonstrate that MoHA reduces I/O transfer as well as overall processing time when compared to a baseline that does not use compressed representations.




Back to Technical Papers Archive Listing