[HTML][HTML] Adios 2: The adaptable input output system. a framework for high-performance data management

WF Godoy, N Podhorszki, R Wang, C Atkins… - SoftwareX, 2020 - Elsevier
We present ADIOS 2, the latest version of the Adaptable Input Output (I/O) System. ADIOS 2
addresses scientific data management needs ranging from scalable I/O in supercomputers …

On the role of burst buffers in leadership-class storage systems

N Liu, J Cope, P Carns, C Carothers… - 2012 IEEE 28th …, 2012 - ieeexplore.ieee.org
The largest-scale high-performance (HPC) systems are stretching parallel file systems to
their limits in terms of aggregate bandwidth and numbers of clients. To further sustain the …

Understanding and improving computational science storage access through continuous characterization

P Carns, K Harms, W Allcock, C Bacon, S Lang… - ACM Transactions on …, 2011 - dl.acm.org
Computational science applications are driving a demand for increasingly powerful storage
systems. While many techniques are available for capturing the I/O behavior of individual …

IndexFS: Scaling file system metadata performance with stateless caching and bulk insertion

K Ren, Q Zheng, S Patil… - SC'14: Proceedings of the …, 2014 - ieeexplore.ieee.org
The growing size of modern storage systems is expected to exceed billions of objects,
making metadata scalability critical to overall performance. Many existing distributed file …

Slow and steady feature analysis: higher order temporal coherence in video

D Jayaraman, K Grauman - Proceedings of the IEEE …, 2016 - openaccess.thecvf.com
How can unlabeled video augment visual learning? Existing methods perform" slow" feature
analysis, encouraging temporal coherence, where the image representations of temporally …

CALCioM: Mitigating I/O interference in HPC systems through cross-application coordination

M Dorier, G Antoniu, R Ross, D Kimpe… - 2014 IEEE 28th …, 2014 - ieeexplore.ieee.org
Unmatched computation and storage performance in new HPC systems have led to a
plethora of I/O optimizations ranging from application-side collective I/O to network and disk …

Taming parallel I/O complexity with auto-tuning

B Behzad, HVT Luu, J Huchette, S Byna… - Proceedings of the …, 2013 - dl.acm.org
We present an auto-tuning system for optimizing I/O performance of HDF5 applications and
demonstrate its value across platforms, applications, and at scale. The system uses a …

Scheduling the I/O of HPC applications under congestion

A Gainaru, G Aupy, A Benoit, F Cappello… - 2015 IEEE …, 2015 - ieeexplore.ieee.org
A significant percentage of the computing capacity of large-scale platforms is wasted
because of interferences incurred by multiple applications that access a shared parallel file …

Modular hpc i/o characterization with darshan

S Snyder, P Carns, K Harms, R Ross… - 2016 5th workshop …, 2016 - ieeexplore.ieee.org
Contemporary high-performance computing (HPC) applications encompass a broad range
of distinct I/O strategies and are often executed on a number of different compute platforms …

Characterizing output bottlenecks in a supercomputer

B Xie, J Chase, D Dillow, O Drokin… - SC'12: Proceedings …, 2012 - ieeexplore.ieee.org
Supercomputer I/O loads are often dominated by writes. HPC (High Performance
Computing) file systems are designed to absorb these bursty outputs at high bandwidth …