Designing a cost-effective cache replacement policy using machine learning

S Sethumurugan, J Yin, J Sartori - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
Extensive research has been carried out to improve cache replacement policies, yet
designing an efficient cache replacement policy that incurs low hardware overhead remains …

An end-to-end automatic cache replacement policy using deep reinforcement learning

Y Zhou, F Wang, Z Shi, D Feng - Proceedings of the International …, 2022 - ojs.aaai.org
In the past few decades, much research has been conducted on the design of cache
replacement policies. Prior work frequently relies on manually-engineered heuristics to …

Applying deep learning to the cache replacement problem

Z Shi, X Huang, A Jain, C Lin - Proceedings of the 52nd Annual IEEE …, 2019 - dl.acm.org
Despite its success in many areas, deep learning is a poor fit for use in hardware predictors
because these models are impractically large and slow, but this paper shows how we can …

Cache replacement policy based on expected hit count

A Vakil-Ghahani, S Mahdizadeh-Shahri… - IEEE computer …, 2017 - ieeexplore.ieee.org
Memory-intensive workloads operate on massive amounts of data that cannot be captured
by last-level caches (LLCs) of modern processors. Consequently, processors encounter …

Effective mimicry of belady's min policy

I Shah, A Jain, C Lin - 2022 IEEE International Symposium on …, 2022 - ieeexplore.ieee.org
The past decade has seen the rise of highly successful cache replacement policies that are
based on binary prediction. For example, the Hawkeye policy learns whether lines loaded …

Back to the future: Leveraging Belady's algorithm for improved cache replacement

A Jain, C Lin - ACM SIGARCH Computer Architecture News, 2016 - dl.acm.org
Belady's algorithm is optimal but infeasible because it requires knowledge of the future. This
paper explains how a cache replacement algorithm can nonetheless learn from Belady's …

Insertion and promotion for tree-based pseudolru last-level caches

DA Jiménez - Proceedings of the 46th Annual IEEE/ACM …, 2013 - dl.acm.org
Last-level caches mitigate the high latency of main memory. A good cache replacement
policy enables high performance for memory intensive programs. To be useful to industry, a …

LACS: A locality-aware cost-sensitive cache replacement algorithm

M Kharbutli, R Sheikh - IEEE Transactions on Computers, 2013 - ieeexplore.ieee.org
The design of an effective last-level cache (LLC) in general—and an effective cache
replacement/partitioning algorithm in particular—is critical to the overall system …

An imitation learning approach for cache replacement

E Liu, M Hashemi, K Swersky… - International …, 2020 - proceedings.mlr.press
Program execution speed critically depends on increasing cache hits, as cache hits are
orders of magnitude faster than misses. To increase cache hits, we focus on the problem of …

Performance evaluation of cache replacement policies for the SPEC CPU2000 benchmark suite

H Al-Zoubi, A Milenkovic, M Milenkovic - Proceedings of the 42nd annual …, 2004 - dl.acm.org
Replacement policy, one of the key factors determining the effectiveness of a cache,
becomes even more important with latest technological trends toward highly associative …