Workload characterization and performance assessment of Yellowstone using XDMoD and Exploratory Data Analysis (EDA) [presentation]
Yang, Y., Engel, T., Strande, S., Hart, D. L.. (2014). Workload characterization and performance assessment of Yellowstone using XDMoD and Exploratory Data Analysis (EDA) [presentation].
| Title | Workload characterization and performance assessment of Yellowstone using XDMoD and Exploratory Data Analysis (EDA) [presentation] |
|---|---|
| Genre | Conference Material |
| Author(s) | Ying Yang, Thomas Engel, Shawn Strande, David L. Hart |
| Abstract | Open XDMoD is an open source tool designed to audit and facilitate the utilization of supercomputers by providing a wide range of metrics on resources, including resource utilization, resource performance, and impact on scholarship and research. The framework includes a computationally lightweight application kernel auditing system that utilizes performance kernels chosen from both low-level benchmarks and actual scientific and engineering applications to measure overall system performance from the user's perspective. We shred and ingest the workload and performance monitoring data of Yellowstone into XDMoD and create superMoD to monitor Yellowstone. We developed two new metrics that are important to monitor Yellowstone performance and contribute back to the open source. We have also conducted exploratory data analysis with ingested data using R. Methods such as Kernel density estimation, regression, K-nearest neighbor, clustering, Bayesian network and other data mining methods has been utilized to visualize and explore patterns in the data. |
| Publication Title | |
| Publication Date | Aug 1, 2014 |
| Publisher's Version of Record | |
| OpenSky Citable URL | https://n2t.org/ark:/85065/d7z60qq0 |
| OpenSky Listing | View on OpenSky |
| CISL Affiliations | CISLAODEPT, OSD, HSS |