Continuous Regression Testing of the Sustained Petascale Blue Waters Infrastructure
SessionManaging HPC Systems
Event Type
State of the Practice Talk
Best Practices
System Management
TP
TimeTuesday, 17 November 202011am - 11:30am EDT
LocationTrack 6
DescriptionRegression testing is an important activity that must be carefully conducted to ensure the health, stability and effectiveness of any computational system during its operation. Regression testing is traditionally performed when major system updates or reconfigurations occur, either in hardware or in software. However, to be more effective, testing must be done on a continuous basis, such that any deviation from expected behavior can be detected as early as possible and properly corrected. Here, we describe our approach to continuously test the behavior of the entire Blue Waters infrastructure, including the computational system and various other sub-systems. Our regression testing scheme is based on the Jenkins framework, and includes a broad range of tests, from low-level system aspects to full application performance. By relying on Jenkins, our test executions can be fully automated, and test results remain stored and readily available for human visualization or historical analyses.
Authors
