MoHA: A Composable System for Efficient In-Situ Analytics on Heterogeneous HPC Systems
SessionData Analysis and Reduction
Event Type
Paper
Data Analytics, Compression, and Management
Performance/Productivity Measurement and Evaluation
Resource Management and Scheduling
TP
TimeThursday, 19 November 202010am - 10:30am EDT
LocationTrack 4
DescriptionHeterogeneous, dense computing architectures consisting of several accelerators, such as GPUs, attached to general-purpose CPUs are now integral to high-performance computing (HPC) systems. These architectures, however, pose severe memory and I/O constraints to computations involving in-situ analytics. This paper introduces MoHA, a framework for in-situ analytics that is designed to efficiently use the limited resources available on heterogeneous platforms. MoHA achieves this efficiency through the extensive use of bitmaps as a compressed or summary representation of simulation outputs. Our specific contributions in this paper include the design of bitmap generation and storage methods suitable for GPUs, the design and efficient implementation of a set of key operators for MoHA and demonstrations of how several real queries on real datasets can be implemented using these operators. We demonstrate that MoHA reduces I/O transfer as well as overall processing time when compared to a baseline that does not use compressed representations.
Download PDF