Remote sensing big data computing: Challenges and opportunities

Y Ma, H Wu, L Wang, B Huang, R Ranjan… - Future Generation …, 2015 - Elsevier
As we have entered an era of high resolution earth observation, the RS data are undergoing
an explosive growth. The proliferation of data also give rise to the increasing complexity of …

Use cases of lossy compression for floating-point data in scientific data sets

F Cappello, S Di, S Li, X Liang… - … Journal of High …, 2019 - journals.sagepub.com
Architectural and technological trends of systems used for scientific computing call for a
significant reduction of scientific data sets that are composed mainly of floating-point data …

Optimizing error-bounded lossy compression for scientific data by dynamic spline interpolation

K Zhao, S Di, M Dmitriev, TLD Tonellot… - 2021 IEEE 37th …, 2021 - ieeexplore.ieee.org
Today's scientific simulations are producing vast volumes of data that cannot be stored and
transferred efficiently because of limited storage capacity, parallel I/O bandwidth, and …

PKDGRAV3: beyond trillion particle cosmological simulations for the next era of galaxy surveys

D Potter, J Stadel, R Teyssier - Computational Astrophysics and …, 2017 - Springer
We report on the successful completion of a 2 trillion particle cosmological simulation to z= 0
z=0 run on the Piz Daint supercomputer (CSCS, Switzerland), using 4000+ GPU nodes for a …

Counterfactual explanations for multivariate time series

E Ates, B Aksar, VJ Leung… - … conference on applied …, 2021 - ieeexplore.ieee.org
Multivariate time series are used in many science and engineering domains, including
health-care, astronomy, and high-performance computing. A recent trend is to use machine …

Cusz: An efficient gpu-based error-bounded lossy compression framework for scientific data

J Tian, S Di, K Zhao, C Rivera, MH Fulp… - Proceedings of the …, 2020 - dl.acm.org
Error-bounded lossy compression is a state-of-the-art data reduction technique for HPC
applications because it not only significantly reduces storage overhead but also can retain …

SDRBench: Scientific data reduction benchmark for lossy compressors

K Zhao, S Di, X Lian, S Li, D Tao… - … conference on big …, 2020 - ieeexplore.ieee.org
Efficient error-controlled lossy compressors are becoming critical to the success of today's
large-scale scientific applications because of the ever-increasing volume of data produced …

Adaptive techniques for clustered N-body cosmological simulations

H Menon, L Wesolowski, G Zheng, P Jetley… - Computational …, 2015 - Springer
ChaNGa is an N-body cosmology simulation application implemented using Charm++. In
this paper, we present the parallel design of ChaNGa and address many challenges arising …

Significantly improving lossy compression for HPC datasets with second-order prediction and parameter optimization

K Zhao, S Di, X Liang, S Li, D Tao, Z Chen… - Proceedings of the 29th …, 2020 - dl.acm.org
Today's extreme-scale high-performance computing (HPC) applications are producing
volumes of data too large to save or transfer because of limited storage space and I/O …

Veloc: Towards high performance adaptive asynchronous checkpointing at large scale

B Nicolae, A Moody, E Gonsiorowski… - 2019 IEEE …, 2019 - ieeexplore.ieee.org
Global checkpointing to external storage (eg, a parallel file system) is a common I/O pattern
of many HPC applications. However, given the limited I/O throughput of external storage …