CacheQuery: learning replacement policies from hardware caches

P Vila, P Ganty, M Guarnieri, B Köpf - Proceedings of the 41st ACM …, 2020 - dl.acm.org
We show how to infer deterministic cache replacement policies using off-the-shelf automata
learning and program synthesis techniques. For this, we construct and chain two …

An imitation learning approach for cache replacement

E Liu, M Hashemi, K Swersky… - International …, 2020 - proceedings.mlr.press
Program execution speed critically depends on increasing cache hits, as cache hits are
orders of magnitude faster than misses. To increase cache hits, we focus on the problem of …

Whirlpool: Improving dynamic cache management with static data classification

A Mukkara, N Beckmann, D Sanchez - ACM SIGARCH Computer …, 2016 - dl.acm.org
Cache hierarchies are increasingly non-uniform and difficult to manage. Several techniques,
such as scratchpads or reuse hints, use static information about how programs access data …

Back to the future: Leveraging Belady's algorithm for improved cache replacement

A Jain, C Lin - ACM SIGARCH Computer Architecture News, 2016 - dl.acm.org
Belady's algorithm is optimal but infeasible because it requires knowledge of the future. This
paper explains how a cache replacement algorithm can nonetheless learn from Belady's …

Software-assisted cache replacement mechanisms for embedded systems

P Jain, S Devadas, D Engels… - IEEE/ACM International …, 2001 - ieeexplore.ieee.org
We address the problem of improving cache predictability and performance in embedded
systems through the use of software-assisted replacement mechanisms. These mechanisms …

Applying deep learning to the cache replacement problem

Z Shi, X Huang, A Jain, C Lin - Proceedings of the 52nd Annual IEEE …, 2019 - dl.acm.org
Despite its success in many areas, deep learning is a poor fit for use in hardware predictors
because these models are impractically large and slow, but this paper shows how we can …

Effective mimicry of belady's min policy

I Shah, A Jain, C Lin - 2022 IEEE International Symposium on …, 2022 - ieeexplore.ieee.org
The past decade has seen the rise of highly successful cache replacement policies that are
based on binary prediction. For example, the Hawkeye policy learns whether lines loaded …

Sensitivity of cache replacement policies

J Reineke, D Grund - ACM Transactions on Embedded Computing …, 2013 - dl.acm.org
The sensitivity of a cache replacement policy expresses to what extent the execution history
may influence the number of cache hits and misses during program execution. We present …

An analytical model for cache replacement policy performance

F Guo, Y Solihin - Proceedings of the joint international conference on …, 2006 - dl.acm.org
Due to the increasing gap between CPU and memory speed, cache performance plays an
increasingly critical role in determining the overall performance of microprocessor systems …

Phase guided profiling for fast cache modeling

A Sembrant, D Black-Schaffer… - Proceedings of the Tenth …, 2012 - dl.acm.org
Statistical cache models are powerful tools for understanding application behavior as a
function of cache allocation. However, previous techniques have modeled only the average …