In Situ Methods, Infrastructures, and Applications on High Performance Computing Platforms

AC Bauer, H Abbasi, J Ahrens, H Childs… - Computer Graphics …, 2016 - Wiley Online Library
The considerable interest in the high performance computing (HPC) community regarding
analyzing and visualization data without first writing to disk, ie, in situ processing, is due to …

Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks

Q Liu, J Logan, Y Tian, H Abbasi… - Concurrency and …, 2014 - Wiley Online Library
Applications running on leadership platforms are more and more bottlenecked by storage
input/output (I/O). In an effort to combat the increasing disparity between I/O throughput and …

Extreme scale multi-physics simulations of the tsunamigenic 2004 sumatra megathrust earthquake

C Uphoff, S Rettenberger, M Bader… - Proceedings of the …, 2017 - dl.acm.org
We present a high-resolution simulation of the 2004 Sumatra-Andaman earthquake,
including non-linear frictional failure on a megathrustsplay fault system. Our method exploits …

DAOS and friends: a proposal for an exascale storage system

J Lofstead, I Jimenez, C Maltzahn… - SC'16: Proceedings …, 2016 - ieeexplore.ieee.org
The DOE Extreme-Scale Technology Acceleration Fast Forward Storage and IO Stack
project is going to have significant impact on storage systems design within and beyond the …

Mercury: Enabling remote procedure call for high-performance computing

J Soumagne, D Kimpe, J Zounmevo… - 2013 IEEE …, 2013 - ieeexplore.ieee.org
Remote procedure call (RPC) is a technique that has been largely adopted by distributed
services. This technique, now more and more used in the context of high-performance …

Large-scale compute-intensive analysis via a combined in-situ and co-scheduling workflow approach

C Sewell, K Heitmann, H Finkel, G Zagaris… - Proceedings of the …, 2015 - dl.acm.org
Large-scale simulations can produce hundreds of terabytes to petabytes of data,
complicating and limiting the efficiency of workflows. Traditionally, outputs are stored on the …

Insights for exascale IO APIs from building a petascale IO API

J Lofstead, R Ross - Proceedings of the International Conference on …, 2013 - dl.acm.org
Near the dawn of the petascale era, IO libraries had reached a stability in their function and
data layout with only incremental changes being incorporated. The shift in technology …

Faodel: Data management for next-generation application workflows

C Ulmer, S Mukherjee, G Templet, S Levy… - Proceedings of the 9th …, 2018 - dl.acm.org
Composition of computational science applications, whether into ad hoc pipelines for
analysis of simulation data or into well-defined and repeatable workflows, is becoming …

Methodology for the rapid development of scalable HPC data services

M Dorier, P Carns, K Harms, R Latham… - 2018 IEEE/ACM 3rd …, 2018 - ieeexplore.ieee.org
Growing evidence in the scientific computing community indicates that parallel file systems
are not sufficient for all HPC storage workloads. This realization has motivated extensive …

Hades: A context-aware active storage framework for accelerating large-scale data analysis

J Cernuda, L Logan, A Gainaru… - 2024 IEEE 24th …, 2024 - ieeexplore.ieee.org
Modern simulation workflows generate and analyze massive amounts of data using I/O
libraries like Adios2 and NetCDF. Although extensive work has optimized the I/O processes …