In storage systems, delta compression is often used as a complementary data reduction
technique for data deduplication because it is able to eliminate redundancy among the non …

Data deduplication is an effective way of improving storage space utilization. The data
generated by deduplication is persistently stored in data chunks or data containers (a …

In this paper, we present a learning based data deduplication algorithm, called LIPA, which
uses the reinforcement learning framework to build an adaptive indexing structure. It is …

With the rapid increase in the amount of data produced and the development of new types of
storage devices, storage tiering continues to be a popular way to achieve a good tradeoff …

Data deduplication has been widely utilized in large-scale storage systems, particularly
backup systems. Data deduplication systems typically divide data streams into chunks and …

Deduplication is one of the most effective and efficient techniques to save memory space. It
is widely used in data centers and cloud storage systems. Multi-stream concurrency is …

Efficient set representation and membership testing are important in various big data
applications. The state-of-the-art Cuckoo filter design shows great advantages in both query …

Lossless data reduction techniques, particularly compression and deduplication, have
emerged as effective approaches to tackling the combined challenge of explosive growth in …

This article presents the Quotient Hash Table (QHT) a new data structure for duplicate
detection in unbounded streams. QHTs stem from a corrected analysis of streaming quotient …

The majority of growth in the industry is driven by massive data processing which in turn is
driving a tremendous need for high performance storage. To satisfy the lower latency …