When climate meets machine learning: Edge to cloud ML energy efficiency

D Marculescu - 2021 IEEE/ACM International Symposium on …, 2021 - ieeexplore.ieee.org
A large portion of current cloud and edge workloads feature Machine Learning (ML) tasks,
thereby requiring a deep understanding of their energy efficiency. While the holy grail for …

Computing Within Limits: An Empirical Study of Energy Consumption in ML Training and Inference

I Mavromatis, K Katsaros, A Khan - arXiv preprint arXiv:2406.14328, 2024 - arxiv.org
Machine learning (ML) has seen tremendous advancements, but its environmental footprint
remains a concern. Acknowledging the growing environmental impact of ML this paper …

Mlperf inference benchmark

VJ Reddi, C Cheng, D Kanter, P Mattson… - 2020 ACM/IEEE 47th …, 2020 - ieeexplore.ieee.org
Machine-learning (ML) hardware and software system demand is burgeoning. Driven by ML
applications, the number of different ML inference systems has exploded. Over 100 …

Co-designing hardware and models for efficient on-device ML inference

M Mattina - 2021 IEEE/ACM International Symposium on Low …, 2021 - ieeexplore.ieee.org
Deep learning inference at the edge continues to deliver state of the art results on real-world
applications involving images, video, speech, and human activity. The workhorse behind …

Hardware-aware machine learning: Modeling and optimization

D Marculescu, D Stamoulis… - 2018 IEEE/ACM …, 2018 - ieeexplore.ieee.org
Recent breakthroughs in Machine Learning (ML) applications, and especially in Deep
Learning (DL), have made DL models a key component in almost every modern computing …

Power Profiler: Monitoring Energy Consumption of ML Algorithms on Android Mobile Devices

K Boubouh, R Basmadjian - Companion Proceedings of the 14th ACM …, 2023 - dl.acm.org
Energy efficiency is a critical concern for machine learning (ML) algorithms deployed in data
centers. Recently, many works in the literature have focused on running ML algorithms on …

[PDF][PDF] Unveiling Energy Efficiency in Deep Learning: Measurement, Prediction, and Scoring across Edge Devices

XTAMD Chen, KHOAH Wang, J Xie - 2023 - academia.edu
Today, deep learning optimization is primarily driven by research focused on achieving high
inference accuracy and reducing latency. However, the energy efficiency aspect is often …

Runtime deep model multiplexing for reduced latency and energy consumption inference

AE Eshratifar, M Pedram - 2020 IEEE 38th International …, 2020 - ieeexplore.ieee.org
We propose a learning algorithm to design a lightweight neural multiplexer that given the
input and computational resource requirements, calls the model that will consume the …

Towards Implementing Energy-aware Data-driven Intelligence for Smart Health Applications on Mobile Platforms

GD Samaraweera, H Nguyen, H Zanddizari… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent breakthrough technological progressions of powerful mobile computing resources
such as low-cost mobile GPUs along with cutting-edge, open-source software architectures …

Unveiling energy efficiency in deep learning: Measurement, prediction, and scoring across edge devices

X Tu, A Mallik, D Chen, K Han, O Altintas… - 2023 IEEE/ACM …, 2023 - ieeexplore.ieee.org
Today, deep learning optimization is primarily driven by research focused on achieving high
inference accuracy and reducing latency. However, the energy efficiency aspect is often …