ExaHDF5: Delivering efficient parallel I/O on exascale computing systems

S Byna, MS Breitenfeld, B Dong, Q Koziol… - Journal of Computer …, 2020 - Springer
Scientific applications at exascale generate and analyze massive amounts of data. A critical
requirement of these applications is the capability to access and manage this data efficiently …

DAOS for extreme-scale systems in scientific applications

MS Breitenfeld, N Fortner, J Henderson… - arXiv preprint arXiv …, 2017 - arxiv.org
Exascale I/O initiatives will require new and fully integrated I/O models which are capable of
providing straightforward functionality, fault tolerance and efficiency. One solution is the …

Accelerating hdf5 i/o for exascale using daos

J Soumagne, J Henderson, M Chaarawi… - … on Parallel and …, 2021 - ieeexplore.ieee.org
The Hierarchical Data Format 5 (HDF5) has long been defined as one of the most prominent
data models, binary file formats and I/O libraries for storing and managing scientific data …

Towards exascale distributed data management

G Aloisio, S Fiore - The International Journal of High …, 2009 - journals.sagepub.com
“Exascale eScience infrastructures” will face important and critical challenges, both from
computational and data perspectives. Increasingly complex and parallel scientific codes will …

[图书][B] Parallel I/O for high performance computing

JM May - 2001 - books.google.com
" I enjoyed reading this book immensely. The author was uncommonly careful in his
explanations. I'd recommend this book to anyone writing scientific application codes."-Peter …

[PDF][PDF] Distributed file systems for exascale computing

D Zhao, I Raicu - … Computing, Networking, Storage and Analysis (SC' …, 2012 - 216.47.155.57
Exascale computing, ie 1018 FLOPS, is predicted to emerge by 2019 with current trends.
Millions of nodes and billions of threads of execution, producing similarly large concurrent …

Towards exploring data-intensive scientific applications at extreme scales through systems and simulations

D Zhao, N Liu, D Kimpe, R Ross… - IEEE Transactions on …, 2015 - ieeexplore.ieee.org
The state-of-the-art storage architecture of high-performance computing systems was
designed decades ago, and with today's scale and level of concurrency, it is showing …

Six degrees of scientific data: Reading patterns for extreme scale science io

J Lofstead, M Polte, G Gibson, S Klasky… - Proceedings of the 20th …, 2011 - dl.acm.org
Petascale science simulations generate 10s of TBs of application data per day, much of it
devoted to their checkpoint/restart fault tolerance mechanisms. Previous work demonstrated …

HDF5 Cache VOL: Efficient and scalable parallel I/O through caching data on node-local storage

H Zheng, V Vishwanath, Q Koziol… - 2022 22nd IEEE …, 2022 - ieeexplore.ieee.org
Modern-era high performance computing (HPC) systems are providing multiple levels of
memory and storage layers to bridge the performance gap between fast memory and slow …

[图书][B] High performance parallel I/O

Q Koziol - 2014 - books.google.com
Gain Critical Insight into the Parallel I/O Ecosystem Parallel I/O is an integral component of
modern high performance computing (HPC), especially in storing and processing very large …