Use cases of lossy compression for floating-point data in scientific data sets

F Cappello, S Di, S Li, X Liang… - … Journal of High …, 2019 - journals.sagepub.com
Architectural and technological trends of systems used for scientific computing call for a
significant reduction of scientific data sets that are composed mainly of floating-point data …

Multifacets of lossy compression for scientific data in the Joint-Laboratory of Extreme Scale Computing

F Cappello, M Acosta, E Agullo, H Anzt… - Future Generation …, 2025 - Elsevier
Abstract The Joint Laboratory on Extreme-Scale Computing (JLESC) was initiated at the
same time lossy compression for scientific data became an important topic for the scientific …

Error-controlled lossy compression optimized for high compression ratios of scientific datasets

X Liang, S Di, D Tao, S Li, S Li, H Guo… - … Conference on Big …, 2018 - ieeexplore.ieee.org
Today's scientific simulations require a significant reduction of the data size because of
extremely large volumes of data they produce and the limitation of storage bandwidth and …

Dynamic quality metric oriented error bounded lossy compression for scientific datasets

J Liu, S Di, K Zhao, X Liang, Z Chen… - … Conference for High …, 2022 - ieeexplore.ieee.org
With ever-increasing execution scale of the high performance computing (HPC)
applications, vast amount of data are being produced by scientific research every day. Error …

Requirements for a global data infrastructure in support of CMIP6

V Balaji, KE Taylor, M Juckes… - Geoscientific Model …, 2018 - gmd.copernicus.org
The World Climate Research Programme (WCRP)'s Working Group on Climate Modelling
(WGCM) Infrastructure Panel (WIP) was formed in 2014 in response to the explosive growth …

Error analysis of zfp compression for floating-point data

J Diffenderfer, AL Fox, JA Hittinger, G Sanders… - SIAM Journal on …, 2019 - SIAM
Compression of floating-point data will play an important role in high-performance
computing as data bandwidth and storage become dominant costs. Lossy compression of …

cuSZp: An Ultra-fast GPU Error-bounded Lossy Compression Framework with Optimized End-to-End Performance

Y Huang, S Di, X Yu, G Li, F Cappello - Proceedings of the International …, 2023 - dl.acm.org
Modern scientific applications and supercomputing systems are generating large amounts of
data in various fields, leading to critical challenges in data storage footprints and …

Z-checker: A framework for assessing lossy compression of scientific data

D Tao, S Di, H Guo, Z Chen… - … International Journal of …, 2019 - journals.sagepub.com
Because of the vast volume of data being produced by today's scientific simulations and
experiments, lossy data compressor allowing user-controlled loss of accuracy during the …

[PDF][PDF] Error distributions of lossy floating-point compressors

P Lindstrom - 2017 - osti.gov
With ever increasing volumes of data being generated in scientific simulations, experiments,
and observations, storage and bandwidth concerns are mounting. As a means of data …

Understanding GPU-based lossy compression for extreme-scale cosmological simulations

S Jin, P Grosset, CM Biwer, J Pulido… - 2020 IEEE …, 2020 - ieeexplore.ieee.org
To help understand our universe better, researchers and scientists currently run extreme-
scale cosmology simulations on leadership supercomputers. However, such simulations can …