Identifying challenges and opportunities of in-memory computing on large HPC systems

D Huang, Z Qin, Q Liu, N Podhorszki… - Journal of Parallel and …, 2022 - Elsevier
With the increasing fidelity and resolution enabled by high-performance computing systems,
simulation-based scientific discovery is able to model and understand microscopic physical …

In Situ Visualization for Computational Science

H Childs, J Bennett, C Garth… - … Computer Graphics and …, 2019 - ieeexplore.ieee.org
In situ visualization is an increasingly important approach for computational science, as it
can address limitations on leading edge high-performance computers and also can provide …

Canopus: A paradigm shift towards elastic extreme-scale data analytics on hpc storage

T Lu, E Suchyta, D Pugmire, J Choi… - 2017 IEEE …, 2017 - ieeexplore.ieee.org
Scientific simulations on high performance computing (HPC) platforms generate large
quantities of data. To bridge the widening gap between compute and I/O, and enable data to …

EMPRESS: Accelerating Scientific Discovery through Descriptive Metadata Management

M Lawson, W Gropp, J Lofstead - ACM Transactions on Storage, 2022 - dl.acm.org
High-performance computing scientists are producing unprecedented volumes of data that
take a long time to load for analysis. However, many analyses only require loading in the …

Adaptive Synchronization and Pacing Control for Visual Interactive Simulation

Z Meng, M Gao, M Grossi, A Siguenza-Torres… - ACM Transactions on …, 2024 - dl.acm.org
Parallel and distributed computing enable the execution of large and complex simulations.
Yet, the usual separation of (headless) simulation execution and (subsequent, offline) output …

Harnessing data movement in virtual clusters for in-situ execution

D Huang, Q Liu, S Klasky, J Wang… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
As a result of increasing data volume and velocity, Big Data science at exascale has shifted
towards the in-situ paradigm, where large scale simulations run concurrently alongside data …

Interactive visualization of high-dimensional petascale ocean data

DA Ellsworth, CE Henze… - 2017 IEEE 7th Symposium …, 2017 - ieeexplore.ieee.org
We describe an application for interactive visualization of 5 petabytes of time-varying
multivariate data from a high-resolution global ocean circulation model. The input data are …

Manala: a flexible flow control library for asynchronous task communication

M Dreher, K Sasikumar… - 2017 IEEE …, 2017 - ieeexplore.ieee.org
Tasks coupled in an in situ workflow may not process data at the same speed, potentially
causing overflows in the communication channel between them. To prevent this problem …

Coss: Proposing a contract-based storage system for hpc

M Dorier, M Dreher, T Peterka, R Ross - … on parallel data storage & data …, 2017 - dl.acm.org
Data management is a critical component of high-performance computing, with storage as a
cornerstone. Yet the traditional model of parallel file systems fails to meet users' needs, in …

When parallel performance measurement and analysis meets in situ analytics and visualization

AD Malony, M Larsen, K Huck, C Wood… - Parallel Computing …, 2020 - ebooks.iospress.nl
Large scale parallel applications have evolved beyond the tipping point where there are
compelling reasons to analyze, visualize and otherwise process output data from scientific …