End-to-end I/O monitoring on leading supercomputers

B Yang, W Xue, T Zhang, S Liu, X Ma, X Wang… - ACM Transactions on …, 2023 - dl.acm.org
This paper offers a solution to overcome the complexities of production system I/O
performance monitoring. We present Beacon, an end-to-end I/O resource monitoring and …

Understanding hpc application i/o behavior using system level statistics

AK Paul, O Faaland, A Moody… - 2020 IEEE 27th …, 2020 - ieeexplore.ieee.org
The processor performance of high performance computing (HPC) systems is increasing at
a much higher rate than storage performance. This imbalance leads to I/O performance …

[PDF][PDF] Iominer: Large-scale analytics framework for gaining knowledge from i/o logs

T Wang, S Snyder, G Lockwood, P Carns… - 2018 IEEE International …, 2018 - sdm.lbl.gov
Modern HPC systems are collecting large amounts of I/O performance data. The massive
volume and heterogeneity of this data, however, have made timely performance of in-depth …

An end-to-end and adaptive i/o optimization tool for modern hpc storage systems

B Yang, Y Zou, W Liu, W Xue - 2022 IEEE International Parallel …, 2022 - ieeexplore.ieee.org
Real-world large-scale applications expose more and more pressures to storage services of
modern supercomputers. Supercomputers have been introducing new storage devices and …

SciSpace: A scientific collaboration workspace for geo-distributed HPC data centers

A Khan, T Kim, H Byun, Y Kim - Future Generation Computer Systems, 2019 - Elsevier
Future terabit networks are committed to dramatically improving big data motion between
geographically dispersed HPC data centers. The scientific community takes advantage of …

Gufi: fast, secure file system metadata search for both privileged and unprivileged users

D Manno, J Lee, P Challa, Q Zheng… - … Conference for High …, 2022 - ieeexplore.ieee.org
Modern High-Performance Computing (HPC) data centers routinely store massive data sets
resulting in millions of directories and billions of files. To efficiently search and sift through …

A Multiverse Graph to Help Scientific Reasoning from Web Usage: Interpretable Patterns of Assessor Shifts in GRAPHYP

R Fabre, O Azeroual, J Schöpfel, P Bellot, D Egret - Future internet, 2023 - mdpi.com
The digital support for scientific reasoning presents contrasting results. Bibliometric services
are improving, but not academic assessment; no service for scholars relies on logs of web …

Tarazu: An Adaptive End-to-end I/O Load-balancing Framework for Large-scale Parallel File Systems

AK Paul, S Neuwirth, B Wadhwa, F Wang… - ACM Transactions on …, 2024 - dl.acm.org
The imbalanced I/O load on large parallel file systems affects the parallel I/O performance of
high-performance computing (HPC) applications. One of the main reasons for I/O …

How to enable index scheme for reducing the writing cost of DNA storage on insertion and deletion

YS Lin, YP Liang, TY Chen, YH Chang… - ACM Transactions on …, 2022 - dl.acm.org
Recently, the requirement of storing digital data has been growing rapidly; however, the
conventional storage medium cannot satisfy these huge demands. Fortunately, thanks to …

Understanding Data Movement Patterns in HPC: A NERSC Case Study

A Giannakou, D Hazen, B Enders… - … Conference for High …, 2024 - ieeexplore.ieee.org
Scientific experiments are producing unprecedented volumes of data with real-time High
Performance Computing (HPC) needs. Understanding and ensuring efficient data …