Survey on memory management techniques in heterogeneous computing systems

A Hazarika, S Poddar… - IET Computers & Digital …, 2020 - Wiley Online Library
… In this paper, we have analysed three promising memory managementmemory management
techniques especially help to reduce unnecessary data movement and increase memory

Efficient memory management for large language model serving with pagedattention

W Kwon, Z Li, S Zhuang, Y Sheng, L Zheng… - Proceedings of the 29th …, 2023 - dl.acm.org
… In summary, GPU workers do not need to synchronize on memory management as they only
need to receive all the memory management information at the beginning of each decoding …

[PDF][PDF] Abstractions for Portable Data Management in Heterogeneous Memory Systems

CM Foyer - 2021 - research-information.bris.ac.uk
… and memory management in systems with heterogeneous … Along with the different approaches
to memory management, this … approach for our objective of abstraction and portability. …

On cache limits for dataflow applications and related efficient memory management strategies

A Ghasemi, R Cataldo, JP Diguet… - Workshop on Design and …, 2021 - dl.acm.org
… This paper presents two efficient memory management … , to address the memory aspects
of the dataflow model: copy-on… Sniper: exploring the level of abstraction for scalable and …

Capuchin: Tensor-based gpu memory management for deep learning

X Peng, X Shi, H Dai, H Jin, W Ma, Q Xiong… - Proceedings of the …, 2020 - dl.acm.org
… GPU memory management based on computation graph and characteristics of diferent
layers. However, a layer of neural networks is a high-level computation abstraction composed of …

Self-aware memory management for emerging energy-efficient architectures

B Maity, B Donyanavard, N Dutt - 2020 11th International Green …, 2020 - ieeexplore.ieee.org
models, and perform actions based on the decision. The model here is a generic abstraction
… Examples are: (a) descriptive model that captures system performance-related parameters, (…

Characterization of Android memory references and implication to hybrid memory management

S Lee, H Bahn - IEEE Access, 2021 - ieeexplore.ieee.org
ABSTRACT In this article, we analyze Android applications’ … Based on these observations,
we present a new smartphone memory management scheme for DRAM-NVM hybrid memory. …

Estimating GPU memory consumption of deep learning models

Y Gao, Y Liu, H Zhang, Z Li, Y Zhu, H Lin… - Proceedings of the 28th …, 2020 - dl.acm.org
… The above abstraction and formalization are general to different frameworks and DL models
in estimating GPU memory consumption. Users can … Memory management for tensorflow. …

[图书][B] The garbage collection handbook: the art of automatic memory management

R Jones, A Hosking, E Moss - 2023 - books.google.com
Memory Management, captured the state of the field in 2012. Modern technology developments
have made memory management … by automatic memory management researchers and …

High Performance Application-oriented Memory Management on Multicore Systems

AS Baroughi, M Naderi - 2020 6th Iranian Conference on …, 2020 - ieeexplore.ieee.org
… Hence, we did not modify the power model in the framework. A 32-core processor based on
a Gainestown variant of x86 Nehalem micro-architecture at 2.66 GHz was set. Some specific …