ArrayUDF: User-defined scientific data analysis on arrays

B Dong, K Wu, S Byna, J Liu, W Zhao… - Proceedings of the 26th …, 2017 - dl.acm.org
User-Defined Functions (UDF) allow application programmers to specify analysis operations
on data, while leaving the data management tasks to the system. This general approach …

Accelerating hdf5 i/o for exascale using daos

J Soumagne, J Henderson, M Chaarawi… - … on Parallel and …, 2021 - ieeexplore.ieee.org
The Hierarchical Data Format 5 (HDF5) has long been defined as one of the most prominent
data models, binary file formats and I/O libraries for storing and managing scientific data …

Hcompress: Hierarchical data compression for multi-tiered storage environments

H Devarajan, A Kougkas, L Logan… - 2020 IEEE International …, 2020 - ieeexplore.ieee.org
Modern scientific applications read and write massive amounts of data through simulations,
observations, and analysis. These applications spend the majority of their runtime in …

LabStor: A modular and extensible platform for developing high-performance, customized I/O stacks in userspace

L Logan, JC Garcia, J Lofstead, XH Sun… - … Conference for High …, 2022 - ieeexplore.ieee.org
Traditionally, I/O systems have been developed within the confines of a centralized OS
kernel. This led to monolithic and rigid storage systems that are limited by low development …

High-performance computation of distributed-memory parallel 3d voronoi and delaunay tessellation

T Peterka, D Morozov, C Phillips - SC'14: Proceedings of the …, 2014 - ieeexplore.ieee.org
Computing a Voronoi or Delaunay tessellation from a set of points is a core part of the
analysis of many simulated and measured datasets: N-body simulations, molecular …

MOSIQS: Persistent memory object storage with metadata indexing and querying for scientific computing

A Khan, H Sim, SS Vazhkudai, Y Kim - IEEE Access, 2021 - ieeexplore.ieee.org
Scientific applications often require high-bandwidth shared storage to perform joint
simulations and collaborative data analytics. Shared memory pools provide a chance to …

Evaluation of hpc application i/o on object storage systems

J Liu, Q Koziol, GF Butler, N Fortner… - 2018 IEEE/ACM 3rd …, 2018 - ieeexplore.ieee.org
POSIX-based parallel file systems provide strong consistency semantics, which many
modern HPC applications do not need and do not want. Object store technologies avoid …

Astrophysical explosions revisited: Collisionless coupling of debris to magnetized plasma

A Le, D Winske, A Stanier, W Daughton… - Journal of …, 2021 - Wiley Online Library
The coupling between a rapidly expanding cloud of ionized debris and an ambient
magnetized plasma is revisited with a hybrid (kinetic ion/fluid electron) simulation code that …

Parallel membership queries on very large scientific data sets using bitmap indexes

B Yildiz, K Wu, S Byna… - … and Computation: Practice …, 2019 - Wiley Online Library
Many scientific applications produce very large amounts of data as advances in hardware
fuel computing and experimental facilities. Managing and analyzing massive quantities of …

Persistent memory object storage and indexing for scientific computing

A Khan, H Sim, SS Vazhkudai, J Ma… - 2020 IEEE/ACM …, 2020 - ieeexplore.ieee.org
This paper presents Mosiqs, a persistent memory object storage framework with metadata
indexing and querying for scientific computing. We design Mosiqs based on the key idea …