SZ3: A modular framework for composing prediction-based error-bounded lossy compressors

X Liang, K Zhao, S Di, S Li… - … Transactions on Big …, 2022 - ieeexplore.ieee.org
Today's scientific simulations require a significant reduction of data volume because of
extremely large amounts of data they produce and the limited I/O bandwidth and storage …

Significantly improving lossy compression for HPC datasets with second-order prediction and parameter optimization

K Zhao, S Di, X Liang, S Li, D Tao, Z Chen… - Proceedings of the 29th …, 2020 - dl.acm.org
Today's extreme-scale high-performance computing (HPC) applications are producing
volumes of data too large to save or transfer because of limited storage space and I/O …

Dynamic quality metric oriented error bounded lossy compression for scientific datasets

J Liu, S Di, K Zhao, X Liang, Z Chen… - … Conference for High …, 2022 - ieeexplore.ieee.org
With ever-increasing execution scale of the high performance computing (HPC)
applications, vast amount of data are being produced by scientific research every day. Error …

cuSZp: An Ultra-fast GPU Error-bounded Lossy Compression Framework with Optimized End-to-End Performance

Y Huang, S Di, X Yu, G Li, F Cappello - Proceedings of the International …, 2023 - dl.acm.org
Modern scientific applications and supercomputing systems are generating large amounts of
data in various fields, leading to critical challenges in data storage footprints and …

Ultrafast error-bounded lossy compression for scientific datasets

X Yu, S Di, K Zhao, J Tian, D Tao, X Liang… - Proceedings of the 31st …, 2022 - dl.acm.org
Today's scientific high-performance computing applications and advanced instruments are
producing vast volumes of data across a wide range of domains, which impose a serious …

Improved near-lossless technique using the Huffman coding for enhancing the quality of image compression

M Otair, L Abualigah, MK Qawaqzeh - Multimedia Tools and Applications, 2022 - Springer
Digital data compression aims to reduce the size of digital files in line with technological
development. However, most data is distinguished by its large size, which requires a large …

Toward quantity-of-interest preserving lossy compression for scientific data

P Jiao, S Di, H Guo, K Zhao, J Tian, D Tao… - Proceedings of the …, 2022 - dl.acm.org
Today's scientific simulations and instruments are producing a large amount of data, leading
to difficulties in storing, transmitting, and analyzing these data. While error-controlled lossy …

Black-box statistical prediction of lossy compression ratios for scientific data

R Underwood, J Bessac, D Krasowska… - … Journal of High …, 2023 - journals.sagepub.com
Lossy compressors are increasingly adopted in scientific research, tackling volumes of data
from experiments or parallel numerical simulations and facilitating data storage and …

Optzconfig: Efficient parallel optimization of lossy compression configuration

R Underwood, JC Calhoun, S Di… - … on Parallel and …, 2022 - ieeexplore.ieee.org
Lossless compressors have very low compression ratios that do not meet the needs of
today's large-scale scientific applications that produce vast volumes of data. Error-bounded …

Toward feature-preserving vector field compression

X Liang, S Di, F Cappello, M Raj, C Liu… - … on Visualization and …, 2022 - ieeexplore.ieee.org
The objective of this work is to develop error-bounded lossy compression methods to
preserve topological features in 2D and 3D vector fields. Specifically, we explore the …