Pythia: A customizable hardware prefetching framework using online reinforcement learning

R Bera, K Kanellopoulos, A Nori, T Shahroodi… - MICRO-54: 54th Annual …, 2021 - dl.acm.org
Past research has proposed numerous hardware prefetching techniques, most of which rely
on exploiting one specific type of program context information (eg, program counter …

A hierarchical neural model of data prefetching

Z Shi, A Jain, K Swersky, M Hashemi… - Proceedings of the 26th …, 2021 - dl.acm.org
This paper presents Voyager, a novel neural network for data prefetching. Unlike previous
neural models for prefetching, which are limited to learning delta correlations, our model can …

Bingo spatial data prefetcher

M Bakhshalipour, M Shakerinava… - … Symposium on High …, 2019 - ieeexplore.ieee.org
Applications extensively use data objects with a regular and fixed layout, which leads to the
recurrence of access patterns over memory regions. Spatial data prefetching techniques …

Fine-grained address segmentation for attention-based variable-degree prefetching

P Zhang, A Srivastava, AV Nori, R Kannan… - Proceedings of the 19th …, 2022 - dl.acm.org
Machine learning algorithms have shown potential to improve prefetching performance by
accurately predicting future memory accesses. Existing approaches are based on the …

Improving phase change memory performance with data content aware access

S Song, A Das, O Mutlu, N Kandasamy - Proceedings of the 2020 ACM …, 2020 - dl.acm.org
Phase change memory (PCM) is a scalable non-volatile memory technology that has low
access latency (like DRAM) and high capacity (like Flash). Writing to PCM incurs …

Predicting memory accesses: the road to compact ml-driven prefetcher

A Srivastava, A Lazaris, B Brooks, R Kannan… - Proceedings of the …, 2019 - dl.acm.org
With the advent of fast processors, TPUs, accelerators, and heterogeneous architectures,
computation is no longer the only bottleneck. In fact for many applications, speed of …

Enabling Large Dynamic Neural Network Training with Learning-based Memory Management

J Ren, D Xu, S Yang, J Zhao, Z Li… - … Symposium on High …, 2024 - ieeexplore.ieee.org
Dynamic neural network (DyNN) enables high computational efficiency and strong
representation capability. However, training DyNN can face a memory capacity problem …

Raop: Recurrent neural network augmented offset prefetcher

P Zhang, A Srivastava, B Brooks, R Kannan… - Proceedings of the …, 2020 - dl.acm.org
The rapid development of Big Data coupled with slowing down of Moore's law has made the
memory performance a bottleneck in the von Neumann architecture. Machine learning has …

Intelligent architectures for intelligent computing systems

O Mutlu - 2021 Design, Automation & Test in Europe …, 2021 - ieeexplore.ieee.org
Computing is bottlenecked by data. Large amounts of application data overwhelm storage
capability, communication capability, and computation capability of the modern machines …

A New Formulation of Neural Data Prefetching

Q Duong, A Jain, C Lin - 2024 ACM/IEEE 51st Annual …, 2024 - ieeexplore.ieee.org
Temporal data prefetchers have the potential to produce significant performance gains by
prefetching irregular data streams. Recent work has introduced a neural model for temporal …