A multi-level approach for understanding I/O activity in HPC applications

H Luu, B Behzad, R Aydt… - 2013 IEEE International …, 2013 - ieeexplore.ieee.org
I/O has become one of the determining factors of HPC application performance.
Understanding an application's I/O activity requires a multi-level view of the I/O function flow …

A visual network analysis method for large-scale parallel i/o systems

C Sigovan, C Muelder, KL Ma, J Cope… - 2013 IEEE 27th …, 2013 - ieeexplore.ieee.org
Parallel applications rely on I/O to load data, store end results, and protect partial results
from being lost to system failure. Parallel I/O performance thus has a direct and significant …

Automatic generation of i/o kernels for hpc applications

B Behzad, HV Dang, F Hariri… - 2014 9th Parallel Data …, 2014 - ieeexplore.ieee.org
The study of the I/O performance of a parallel application can be facilitated by the use of an
I/O kernel--a program that generates the same I/O calls as the original application, but can …

[PDF][PDF] Iominer: Large-scale analytics framework for gaining knowledge from i/o logs

T Wang, S Snyder, G Lockwood, P Carns… - 2018 IEEE International …, 2018 - sdm.lbl.gov
Modern HPC systems are collecting large amounts of I/O performance data. The massive
volume and heterogeneity of this data, however, have made timely performance of in-depth …

High performance i/o

A Jackson, F Reid, J Hein, A Soba… - 2011 19th International …, 2011 - ieeexplore.ieee.org
Parallelisation, serial optimisation, compiler tuning, and many more techniques are used to
optimise and improve the performance scaling of parallel programs. One area which is …

Extending i/o through high performance data services

H Abbasi, J Lofstead, F Zheng… - 2009 IEEE …, 2009 - ieeexplore.ieee.org
The complexity of HPC systems has increased the burden on the developer as applications
scale to hundreds of thousands of processing cores. Moreover, additional efforts are …

A comprehensive i/o knowledge cycle for modular and automated hpc workload analysis

Z Zhu, S Neuwirth, T Lippert - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
On the way to the exascale era, millions of parallel processing elements are required.
Accordingly, one major chal-lenge is the ever-widening gap between computational power …

Modular hpc i/o characterization with darshan

S Snyder, P Carns, K Harms, R Ross… - 2016 5th workshop …, 2016 - ieeexplore.ieee.org
Contemporary high-performance computing (HPC) applications encompass a broad range
of distinct I/O strategies and are often executed on a number of different compute platforms …

Towards hpc i/o performance prediction through large-scale log analysis

S Kim, A Sim, K Wu, S Byna, Y Son, H Eom - Proceedings of the 29th …, 2020 - dl.acm.org
Large-scale high performance computing (HPC) systems typically consist of many
thousands of CPUs and storage units, while used by hundreds to thousands of users at the …

Characterizing and predicting the I/O performance of HPC applications using a parameterized synthetic benchmark

H Shan, K Antypas, J Shalf - SC'08: Proceedings of the 2008 …, 2008 - ieeexplore.ieee.org
The unprecedented parallelism of new supercomputing platforms poses tremendous
challenges to achieving scalable performance for I/O intensive applications. Performance …