GPU-aware MPI on RDMA-enabled clusters: Design, implementation and evaluation
Designing high-performance and scalable applications on GPU clusters requires tackling
several challenges. The key challenge is the separate host memory and device memory …
several challenges. The key challenge is the separate host memory and device memory …
Multi-GPU Communication Schemes for Iterative Solvers: When CPUs Are Not in Charge
I Ismayilov, J Baydamirli, D Sağbili, M Wahib… - Proceedings of the 37th …, 2023 - dl.acm.org
This paper proposes a fully autonomous execution model for multi-GPU applications that
completely excludes the involvement of the CPU beyond the initial kernel launch. In a typical …
completely excludes the involvement of the CPU beyond the initial kernel launch. In a typical …
XcalableACC: Extension of XcalableMP PGAS language using OpenACC for accelerator clusters
M Nakao, H Murai, T Shimosaka… - 2014 First Workshop …, 2014 - ieeexplore.ieee.org
The present paper introduces the XcalableACC (XACC) programming model, which is a
hybrid model of the XcalableMP (XMP) Partitioned Global Address Space (PGAS) language …
hybrid model of the XcalableMP (XMP) Partitioned Global Address Space (PGAS) language …
Gpu-centric communication on nvidia gpu clusters with infiniband: A case study with openshmem
GPUs have become an essential component for building compute clusters with high
compute density and high performance per watt. As such clusters scale to have 1000s of …
compute density and high performance per watt. As such clusters scale to have 1000s of …
InfiniBand Verbs on GPU: a case study of controlling an InfiniBand network device from the GPU
Due to their massive parallelism and high performance per Watt, GPUs have gained high
popularity in high-performance computing and are a strong candidate for future exascale …
popularity in high-performance computing and are a strong candidate for future exascale …
Exploiting GPUDirect RDMA in designing high performance OpenSHMEM for NVIDIA GPU clusters
GPUDirect RDMA (GDR) brings the high-performance communication capabilities of RDMA
networks like InfiniBand (IB) to GPUs (referred to as" Device"). It enables IB network …
networks like InfiniBand (IB) to GPUs (referred to as" Device"). It enables IB network …
Gpu-aware non-contiguous data movement in open mpi
Due to better parallel density and power efficiency, GPUs have become more popular for
use in scientific applica-tions. Many of these applications are based on the ubiquitous …
use in scientific applica-tions. Many of these applications are based on the ubiquitous …
MPI-ACC: accelerator-aware MPI for scientific applications
Data movement in high-performance computing systems accelerated by graphics
processing units (GPUs) remains a challenging problem. Data communication in popular …
processing units (GPUs) remains a challenging problem. Data communication in popular …
A novel approach for big data processing using message passing interface based on memory mapping
SA Dheyab, MN Abdullah, BF Abed - Journal of Big Data, 2019 - Springer
The analysis and processing of big data are one of the most important challenges that
researchers are working on to find the best approaches to handle it with high performance …
researchers are working on to find the best approaches to handle it with high performance …
Energy-efficient collective reduce and allreduce operations on distributed GPUs
GPUs gain high popularity in High Performance Computing, due to their massive parallelism
and high performance per Watt. Despite their popularity, data transfer between multiple …
and high performance per Watt. Despite their popularity, data transfer between multiple …