A fragmentation-aware redundancy elimination scheme for inline backup systems

Y Zhang, W Zhu, D Feng, W Huang, N Jiang… - Future Generation …, 2024 - Elsevier
Data deduplication is a widely employed technique in backup systems to enhance storage
efficiency by eliminating duplicate chunks. Delta compression is a technique that …

Reducing chunk fragmentation for in-line delta compressed and deduplicated backup systems

Y Zhang, D Feng, Y Hua, Y Hu, W Xia… - … , and Storage (NAS), 2017 - ieeexplore.ieee.org
Chunk-level deduplication, while robust in removing duplicate chunks, introduces chunk
fragmentation which decreases restore performance. Rewriting algorithms are proposed to …

Improving restore performance for in-line backup system combining deduplication and delta compression

Y Zhang, Y Yuan, D Feng, C Wang… - … on Parallel and …, 2020 - ieeexplore.ieee.org
Data deduplication, though being efficient in removing duplicate chunks, introduces chunk
fragmentation which decreases restore performance. Rewriting algorithms are proposed to …

Ensuring high reliability and performance with low space overhead for deduplicated and delta‐compressed storage systems

C Zuo, F Wang, M Zheng, Y Hu… - … : Practice and Experience, 2022 - Wiley Online Library
Data deduplication is a widely used technique to remove duplicate data to reduce the
storage overhead. However, deduplication typically cannot eliminate the redundancy among …

Applying Delta Compression to Packed Datasets for Efficient Data Reduction

Y Zhang, H Jiang, C Wang, W Huang… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
Backup systems often adopt deduplication techniques for data reduction. Real-world backup
products often group files into larger units (called packed files) before deduplicating them …

DASM: A dynamic adaptive forward assembly area method to accelerate restore speed for deduplication-based backup systems

C Tan, L Li, C Wu, J Li - Network and Parallel Computing: 13th IFIP WG …, 2016 - Springer
Data deduplication yields an important role in modern backup systems for its demonstrated
ability to improve storage efficiency. However, in deduplication-based backup systems, the …

{LoopDelta}: Embedding Locality-aware Opportunistic Delta Compression in Inline Deduplication for Highly Efficient Data Reduction

Y Zhang, H Jiang, D Feng, N Jiang, T Qiu… - 2023 USENIX Annual …, 2023 - usenix.org
As a complement to data deduplication, delta compression further reduces the data volume
by compressing non-duplicate data chunks relative to their similar chunks (base chunks) …

Improving restore speed for backup systems that use inline {Chunk-Based} deduplication

M Lillibridge, K Eshghi, D Bhagwat - 11th USENIX Conference on File …, 2013 - usenix.org
Slow restoration due to chunk fragmentation is a serious problem facing inline chunk-based
data deduplication systems: restore speeds for the most recent backup can drop orders of …

Improving restore performance in deduplication-based backup systems via a fine-grained defragmentation approach

Y Tan, B Wang, J Wen, Z Yan, H Jiang… - IEEE Transactions on …, 2018 - ieeexplore.ieee.org
In deduplication-based backup systems, the removal of redundant data transforms the
otherwise logically adjacent data chunks into physically scattered chunks on the disks. This …

Efficient hybrid inline and out-of-line deduplication for backup storage

YK Li, M Xu, CH Ng, PPC Lee - ACM Transactions on Storage (TOS), 2014 - dl.acm.org
Backup storage systems often remove redundancy across backups via inline deduplication,
which works by referring duplicate chunks of the latest backup to those of existing backups …