Experience from an operational Map-Reduce cluster reveals that outliers significantly
prolong job completion. e causes for outliers include run-time contention for processor …

MapReduce is a widely used parallel computing framework for large scale data processing.
The two major performance metrics in MapReduce are job execution time and cluster …

This article summarizes our recent work and developments on SMPI, a flexible simulator of
MPI applications. In this tool, we took a particular care to ensure our simulator could be used …

The IBM Blue Gene/P (BG/P) system is a massively parallel supercomputer succeeding
BG/L, and it is based on orders of magnitude in system size and significant power …

The fast Fourier transform (FFT) is an efficient implementation of the discrete Fourier
transform (DFT). The FFT is widely used in numerous applications in engineering, science …

Message passing is a very popular style of parallel programming, used in a wide variety of
applications and supported by many APIs, such as BSD sockets, MPI and PVM. Its …

Many scientific applications operate in a bulk-synchronous mode of iterative communication
and computation steps. Even though the communication steps happen at the same logical …

Process arrival pattern, which denotes the timing when different processes arrive at an MPI
collective operation, can have a significant impact on the performance of the operation. In …

The Message Passing Interface (MPI) defines the semantics of data communication
operations, while the implementing libraries provide several parameterized algorithms for …

High-performance computing (HPC) systems keep growing in scale and heterogeneity to
satisfy the increasing computational need, and this brings new challenges to the design of …