OPTIMA

Optimizing Industrial Applications for Heterogeneous HPC systems

by

  • TYPE OF PUBLICATION: Publication in Conference Proceedings
  • AUTHORS: Panagiotis Mpakos, Dimitrios Galanopoulos, Petros Anastasiadis, Nikela Papadopoulou, Nectarios Koziris, Georgios Goumas
  • PUBLISHER: IEEE International Parallel & Distributed Processing Symposium (IPDPS 2023)
  • YEAR OF PUBLICATION: 2023
  • DOI: https://doi.org/10.48550/arXiv.2302.04225

ABSTRACT: The SpMV kernel is characterized by high performance variation per input matrix and computing platform. While GPUs were considered State-of-the-Art for SpMV, with the emergence of advanced multicore CPUs and low-power FPGA accelerators, we need to revisit its performance and energy efIciency. This paper provides a high-level SpMV performance analysis based on structural features of matrices related to common bottlenecks of memory-bandwidth intensity, low ILP, load imbalance and memory latency overheads. Towards this, we create a wide articial matrix dataset that spans these features and study the performance of different storage formats in nine modern HPC platforms; five CPUs, three GPUs and an FPGA. After validating our proposed methodology using real-world matrices, we analyze our extensive experimental results and draw key insights on the competitiveness of different target architectures for SpMV and the impact of each feature/bottleneck on its performance.