Continuous Regression Testing of the Sustained Petascale Blue Waters Infrastructure

Authors: Galen W. Arnold, Gregory H. Bauer, Brett Bode, Timothy A. Bouvet, and Celso L. Mendes (University of Illinois, National Center for Supercomputing Applications (NCSA))

Abstract: Regression testing is an important activity that must be carefully conducted to ensure the health, stability and effectiveness of any computational system during its operation. Regression testing is traditionally performed when major system updates or reconfigurations occur, either in hardware or in software. However, to be more effective, testing must be done on a continuous basis, such that any deviation from expected behavior can be detected as early as possible and properly corrected. Here, we describe our approach to continuously test the behavior of the entire Blue Waters infrastructure, including the computational system and various other sub-systems. Our regression testing scheme is based on the Jenkins framework, and includes a broad range of tests, from low-level system aspects to full application performance. By relying on Jenkins, our test executions can be fully automated, and test results remain stored and readily available for human visualization or historical analyses.

Extended Abstract: pdf
Presentation: pdf



Back to the Visualization & Data Analytics Showcase Archive Listing