Large Language Models (LLMs) have presented impressive performance across several
transformative tasks. However, it is non-trivial to efficiently utilize large-scale cluster …

Optimizing communication performance is imperative for large-scale computing because
communication overheads limit the strong scalability of parallel applications. Today's …

Deep neural networks (DNNs) have gained tremendous attractions as compelling solutions
for applications such as image classification, object detection, speech recognition, and so …

PCIe (Peripheral Component Interconnect express) protocol is the de facto protocol to
bridge CPU and peripheral devices like GPU, NIC, and SSD drive. There is an increasing …

Neuromorphic systems-on-chip (NSoCs) integrate CPU cores and neuromorphic hardware
accelerators on the same chip. These platforms can execute spiking deep convolutional …

Intra-host networking was considered robust in the RDMA (Remote Direct Memory Access)
network and received little attention. However, as the RNIC (RDMA NIC) line rate increases …

Applications often communicate data that is non-contiguous in the send-or the receive-
buffer, eg, when exchanging a column of a matrix stored in row-major order. While non …

Public cloud infrastructures allow for easy, on-demand access to FPGA resources. However,
the low-level, direct access to the FPGA hardware exposes the infrastructure providers to …

While heterogeneous architectures are increasing popular with High Performance
Computing systems, their effectiveness depends on how efficient the scheduler is at …

Abstract Reverse Time Migration (RTM) is an important scientific application for oil and gas
exploration. The 3D RTM simulation generates terabytes of intermediate data that does not …