I/o access patterns in hpc applications: A 360-degree survey

JL Bez, S Byna, S Ibrahim - ACM Computing Surveys, 2023 - dl.acm.org
The high-performance computing I/O stack has been complex due to multiple software
layers, the inter-dependencies among these layers, and the different performance tuning …

Multifacets of lossy compression for scientific data in the Joint-Laboratory of Extreme Scale Computing

F Cappello, S Di, R Underwood, D Tao… - Future Generation …, 2024 - Elsevier
Abstract The Joint Laboratory on Extreme-Scale Computing (JLESC) was initiated at the
same time lossy compression for scientific data became an important topic for the scientific …

Concealing compression-accelerated i/o for hpc applications through in situ task scheduling

S Jin, S Di, F Vivien, D Wang, Y Robert, D Tao… - Proceedings of the …, 2024 - dl.acm.org
Lossy compression and asynchronous I/O are two of the most effective solutions for reducing
storage overhead and enhancing I/O performance in large-scale high-performance …

Improving prediction-based lossy compression dramatically via ratio-quality modeling

S Jin, S Di, J Tian, S Byna, D Tao… - 2022 IEEE 38th …, 2022 - ieeexplore.ieee.org
Error-bounded lossy compression is one of the most effective techniques for reducing
scientific data sizes. However, the traditional trial-and-error approach used to configure …

Cross-facility science with the Superfacility Project at LBNL

B Enders, D Bard, C Snavely, L Gerhardt… - 2020 IEEE/ACM 2nd …, 2020 - ieeexplore.ieee.org
As data sets from DOE user science facilities grow in both size and complexity there is an
urgent need for new capabilities to transfer, analyze and manage the data underlying …

Accelerating parallel write via deeply integrating predictive lossy compression with HDF5

S Jin, D Tao, H Tang, S Di, S Byna… - … Conference for High …, 2022 - ieeexplore.ieee.org
Lossy compression is one of the most efficient solutions to reduce storage overhead and
improve I/O performance for HPC applications. However, existing parallel I/O libraries …

Transparent asynchronous parallel I/O using background threads

H Tang, Q Koziol, J Ravi, S Byna - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Moving toward exascale computing, the size of data stored and accessed by applications is
ever increasing. However, traditional disk-based storage has not seen improvements that …

Regional-scale fault-to-structure earthquake simulations with the EQSIM framework: Workflow maturation and computational performance on GPU-accelerated …

D McCallen, A Pitarka, H Tang… - Earthquake …, 2024 - journals.sagepub.com
Continuous advancements in scientific and engineering understanding of earthquake
phenomena, combined with the associated development of representative physics-based …

Nvme-oaf: Towards adaptive nvme-of for io-intensive workloads on hpc cloud

A Kashyap, X Lu - Proceedings of the 31st International Symposium on …, 2022 - dl.acm.org
Applications running inside containers or virtual machines, traditionally use TCP/IP for
communication in HPC clouds and data centers. The TCP/IP path usually becomes a major …

Applications of physics-informed scientific machine learning in subsurface science: A survey

AY Sun, H Yoon, CY Shih, Z Zhong - Knowledge Guided Machine …, 2022 - taylorfrancis.com
Fast advances in machine learning (ML) algorithms and novel sensing technologies in
recent years have presented new opportunities for the subsurface research community to …