FIFO queues are all you need for cache eviction

J Yang, Y Zhang, Z Qiu, Y Yue, R Vinayak - Proceedings of the 29th …, 2023 - dl.acm.org
As a cache eviction algorithm, FIFO has a lot of attractive properties, such as simplicity,
speed, scalability, and flash-friendliness. The most prominent criticism of FIFO is its low …

{SIEVE} is Simpler than {LRU}: an Efficient {Turn-Key} Eviction Algorithm for Web Caches

Y Zhang, J Yang, Y Yue, Y Vigfusson… - 21st USENIX Symposium …, 2024 - usenix.org
Caching is an indispensable technique for low-cost and fast data serving. The eviction
algorithm, at the heart of a cache, has been primarily designed to maximize efficiency …

{GL-Cache}: Group-level learning for efficient and high-performance caching

J Yang, Z Mao, Y Yue, KV Rashmi - 21st USENIX Conference on File …, 2023 - usenix.org
Web applications rely heavily on software caches to achieve low-latency, high-throughput
services. To adapt to changing workloads, three types of learned caches (learned evictions) …

LeaFTL: A learning-based flash translation layer for solid-state drives

J Sun, S Li, Y Sun, C Sun, D Vucinic… - Proceedings of the 28th …, 2023 - dl.acm.org
In modern solid-state drives (SSDs), the indexing of flash pages is a critical component in
their storage controllers. It not only affects the data access performance, but also determines …

FIFO can be Better than LRU: the Power of Lazy Promotion and Quick Demotion

J Yang, Z Qiu, Y Zhang, Y Yue, KV Rashmi - … of the 19th Workshop on Hot …, 2023 - dl.acm.org
LRU has been the basis of cache eviction algorithms for decades, with a plethora of
innovations on improving LRU's miss ratio and throughput. While it is well-known that FIFO …

{HALP}: Heuristic aided learned preference eviction policy for {YouTube} content delivery network

Z Song, K Chen, Ν Sarda, D Altınbüken… - … USENIX Symposium on …, 2023 - usenix.org
Video streaming services are among the largest web applications in production, and a large
source of downstream internet traffic. A large-scale video streaming service at Google …

Ditto: An elastic and adaptive memory-disaggregated caching system

J Shen, P Zuo, X Luo, Y Su, J Gu, H Feng… - Proceedings of the 29th …, 2023 - dl.acm.org
In-memory caching systems are fundamental building blocks in cloud services. However,
due to the coupled CPU and memory on monolithic servers, existing caching systems …

Baleen:{ML} Admission & Prefetching for Flash Caches

DLK Wong, H Wu, C Molder, S Gunasekar… - … USENIX Conference on …, 2024 - usenix.org
Flash caches are used to reduce peak backend load for throughput-constrained data center
services, reducing the total number of backend servers required. Bulk storage systems are a …

Seer: Enabling {Future-Aware} Online Caching in Networked Systems

J Lei, V Shrivastav - 21st USENIX Symposium on Networked Systems …, 2024 - usenix.org
State-intensive network and distributed applications rely heavily on online caching heuristics
for high performance. However, there remains a fundamental performance gap between …

Optimistic no-regret algorithms for discrete caching

N Mhaisen, A Sinha, G Paschos, G Iosifidis - Proceedings of the ACM on …, 2022 - dl.acm.org
We take a systematic look at the problem of storing whole files in a cache with limited
capacity in the context of optimistic learning, where the caching policy has access to a …