Towards end-to-end sdc detection for hpc applications equipped with lossy compression

S Li, S Di, K Zhao, X Liang, Z Chen… - … Conference on Cluster …, 2020 - ieeexplore.ieee.org
Data reduction techniques have been widely demanded and used by large-scale high
performance computing (HPC) applications because of vast volumes of data to be produced …

Lcfi: A fault injection tool for studying lossy compression error propagation in hpc programs

B Shan, A Shamji, J Tian, G Li… - 2020 IEEE International …, 2020 - ieeexplore.ieee.org
Error-bounded lossy compression is becoming more and more important to today's extreme-
scale HPC applications because of the ever-increasing volume of data generated because it …

SDC resilient error-bounded lossy compressor

S Li, S Di, K Zhao, X Liang, Z Chen… - arXiv preprint arXiv …, 2020 - arxiv.org
Lossy compression is one of the most important strategies to resolve the big science data
issue, however, little work was done to make it resilient against silent data corruptions …

Improving performance of data dumping with lossy compression for scientific simulation

X Liang, S Di, D Tao, S Li, B Nicolae… - 2019 IEEE …, 2019 - ieeexplore.ieee.org
Because of the ever-increasing data being produced by today's high performance
computing (HPC) scientific simulations, I/O performance is becoming a significant bottleneck …

Exploring data corruption inside sz

R Shan, JC Calhoun - … Conference on Big Data (Big Data), 2022 - ieeexplore.ieee.org
Due to the increasing scale of scientific research, scientists need to collect massive amounts
of data to solve complex scientific problems. The exponential growth of data poses …

Fixed-psnr lossy compression for scientific data

D Tao, S Di, X Liang, Z Chen… - 2018 IEEE International …, 2018 - ieeexplore.ieee.org
Error-controlled lossy compression has been studied for years because of extremely large
volumes of data being produced by today's scientific simulations. None of existing lossy …

Understanding and modeling lossy compression schemes on HPC scientific data

T Lu, Q Liu, X He, H Luo, E Suchyta… - 2018 IEEE …, 2018 - ieeexplore.ieee.org
Scientific simulations generate large amounts of floating-point data, which are often not very
compressible using the traditional reduction schemes, such as deduplication or lossless …

Accelerating lossy compression on hpc datasets via partitioning computation for parallel processing

X Zou, T Lu, S Di, D Tao, W Xia, X Wang… - 2019 IEEE 21st …, 2019 - ieeexplore.ieee.org
Recently, increasing attention has been paid to data reduction in the high-performance
computing (HPC) environment where a large volume of data are produced continually …

SDRBench: Scientific data reduction benchmark for lossy compressors

K Zhao, S Di, X Lian, S Li, D Tao… - … conference on big …, 2020 - ieeexplore.ieee.org
Efficient error-controlled lossy compressors are becoming critical to the success of today's
large-scale scientific applications because of the ever-increasing volume of data produced …

cuz-checker: A gpu-based ultra-fast assessment system for lossy compressions

X Yu, S Di, AM Gok, D Tao… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
Lossy compression is becoming an indispensable technique for the success of today's
extreme-scale high-performance computing projects that produce vast volumes of data …