Dynamic GPU energy optimization for machine learning training workloads

F Wang, W Zhang, S Lai, M Hao… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
GPUs are widely used to accelerate the training of machine learning workloads. As modern
machine learning models become increasingly larger, they require a longer time to train …

Dynamic GPU power capping with online performance tracing for energy efficient GPU computing using DEPO tool

A Krzywaniak, P Czarnul, J Proficz - Future Generation Computer Systems, 2023 - Elsevier
GPU accelerators have become essential to the recent advance in computational power of
high-performance computing (HPC) systems. Current HPC systems' reaching an …

[PDF][PDF] Statistical power consumption analysis and modeling for GPU-based computing

X Ma, M Dong, L Zhong, Z Deng - Proceeding of ACM SOSP Workshop on …, 2009 - yecl.org
In recent years, more and more transistors have been integrated within the GPU, which has
resulted in steadily rising power consumption requirements. In this paper we present a …

Going green: optimizing GPUs for energy efficiency through model-steered auto-tuning

R Schoonhoven, B Veenboer… - 2022 IEEE/ACM …, 2022 - ieeexplore.ieee.org
Graphics Processing Units (GPUs) have revolutionized the computing landscape over the
past decade. However, the growing energy demands of data centres and computing …

EAIS: Energy-aware adaptive scheduling for CNN inference on high-performance GPUs

C Yao, W Liu, W Tang, S Hu - Future Generation Computer Systems, 2022 - Elsevier
Recently, a large number of convolutional neural network (CNN) inference services have
emerged on high-performance Graphic Processing Units (GPUs). However, GPUs are high …

GPU energy consumption optimization with a global-based neural network method

Y Huang, B Guo, Y Shen - IEEE Access, 2019 - ieeexplore.ieee.org
With the widespread use of smart technologies, graphics processing unit (GPU) power-
optimization issues are becoming increasingly important. Many researchers have tried to …

AccelWattch: A power modeling framework for modern GPUs

V Kandiah, S Peverelle, M Khairy, J Pan… - MICRO-54: 54th Annual …, 2021 - dl.acm.org
Graphics Processing Units (GPUs) are rapidly dominating the accelerator space, as
illustrated by their wide-spread adoption in the data analytics and machine learning markets …

Know Your Enemy To Save Cloud Energy: Energy-Performance Characterization of Machine Learning Serving

J Yu, J Kim, E Seo - 2023 IEEE International Symposium on …, 2023 - ieeexplore.ieee.org
The proportion of machine learning (ML) inference in modern cloud workloads is rapidly
increasing, and graphic processing units (GPUs) are the most preferred computational …

An automated and portable method for selecting an optimal GPU frequency

G Ali, M Side, S Bhalachandra, NJ Wright… - Future Generation …, 2023 - Elsevier
Power consumption poses a significant challenge in current and emerging graphics
processing unit (GPU) enabled high-performance computing systems. In modern GPUs …

Gpu-nest: Characterizing energy efficiency of multi-gpu inference servers

A Jahanshahi, HZ Sabzi, C Lau… - IEEE Computer …, 2020 - ieeexplore.ieee.org
Cloud inference systems have recently emerged as a solution to the ever-increasing
integration of AI-powered applications into the smart devices around us. The wide adoption …