Speaker
Description
One of the main obstacles to the propagation of ASCR-funded high-performance computing (HPC) libraries (e.g, MPICH, OpenMPI, Kokkos, Legion, RAJA) is the challenge posed by performance optimization of application codes that run on heterogeneous architectures at scale. A visual, interactive and intuitive tool to guide users through the execution of the application and highlight areas of interest, thereby helping to save both developer and compute time, as well as electricity, is thus of utmost importance not only to DOE but also to the commercial “tech” sector at-large.
We proposed to develop the “WorkVisualizer,” a browser-based application integrating informative visualization to coarsen up a level of abstraction over the fine granularity of trace-based profiling (e.g. like the Projections tool) and support users who run at large scale. At this stage, we concretized the design and built the WorkVisualizer on three pillars:
(a) Collection: leverages Caliper (Lawrence Livermore National Laboratory) via a custom configuration to collect program data without requiring changes to source code for MPI+Kokkos apps.
(b) Analysis: calculates high-level summary information and cross-rank time segmented information to determine how the application can be optimized.
(c) Visualization: provides a variety of interactive visualizations that offer actionable insights into the structure and execution patterns of the application.
In particular, we have developed and made public an open-source proof-of-concept of the proposed functionality tested on small-scale, CPU-only data up to a few hundred ranks.
Still under active development, the WorkVisualizer, by facilitating the performance optimization of high-performance libraries on heterogeneous computing platform, the WorkVisualizer could lead to faster advancements in key scientific and engineering domains.
The goal of this presentations is thus to two-fold: firstly, to illustrate the current state of the WorkVisualizer and the capabilities it already demonstrates; secondly, to discuss considered further developments and receive feedback from the audience in this regard.