Improving collective I/O performance using threads

PM Dickens, R Thakur - … and 10th Symposium on Parallel and …, 1999 - ieeexplore.ieee.org
Massively parallel computers are increasingly being used to solve large, I/O intensive
applications in many different fields. For such applications, the I/O requirements quite often …

Making resonance a common case: A high-performance implementation of collective i/o on parallel file systems

X Zhang, S Jiang, K Davis - 2009 IEEE International …, 2009 - ieeexplore.ieee.org
Collective I/O is a widely used technique to improve I/O performance in parallel computing. It
can be implemented as a client-based or as a server-based scheme. The client-based …

MTIO. A multi-threaded parallel I/O system

S More, A Choudhary, I Foster… - … 11th International Parallel …, 1997 - ieeexplore.ieee.org
Presents the design and evaluation of MTIO (Multi-Threaded Input/Output), a multi-threaded
runtime library for parallel I/O. We extend the multi-threading concept to separate the …

Evaluation of collective I/O implementations on parallel architectures

PM Dickens, R Thakur - Journal of Parallel and Distributed Computing, 2001 - Elsevier
In this paper, we evaluate the impact on performance of various implementation techniques
for collective I/O operations, and we do so across four important parallel architectures. We …

View-based collective i/o for mpi-io

JG Blas, F Isaila, DE Singh… - 2008 Eighth IEEE …, 2008 - ieeexplore.ieee.org
This paper presents the design and implementation of a new file system independent
collective I/O optimization based on file views: view-based collective I/O. View-based …

Pipelining and overlapping for MPI collective operations

J Worringen - 28th Annual IEEE International Conference on …, 2003 - ieeexplore.ieee.org
Collective operations are an important aspect of the currently most important message-
passing programming model MPI (message passing interface). Many MPI applications make …

Hierarchical i/o scheduling for collective i/o

J Liu, Y Chen, Y Zhuang - 2013 13th IEEE/ACM International …, 2013 - ieeexplore.ieee.org
The non-contiguous access pattern of many scientific applications results in a large number
of I/O requests, which can seriously limit the data-access performance. Collective I/O has …

Iteration based collective I/O strategy for parallel I/O systems

Z Wang, X Shi, H Jin, S Wu… - 2014 14th IEEE/ACM …, 2014 - ieeexplore.ieee.org
MPI collective I/O is a widely used I/O method that helps data-intensive scientific applications
gain better I/O performance. However, it has been observed that existing collective I/O …

A transparent collective I/O implementation

Y Yu, J Wu, Z Lan, DH Rudd… - 2013 IEEE 27th …, 2013 - ieeexplore.ieee.org
I/O performance is vital for most HPC applications especially those that generate a vast
amount of data with the growth of scale. Many studies have shown that scientific applications …

Parcoll: Partitioned collective i/o on the cray xt

W Yu, J Vetter - 2008 37th International Conference on Parallel …, 2008 - ieeexplore.ieee.org
Collective I/O orchestrates I/O from parallel processes by aggregating fine-grained requests
into large ones. However, its performance is typically a fraction of the potential I/O bandwidth …