Reaching for the sky: Maximizing deep learning inference throughput on edge devices with ai multi-tenancy

J Hao, P Subedi, L Ramaswamy, IK Kim - ACM Transactions on Internet …, 2023 - dl.acm.org
The wide adoption of smart devices and Internet-of-Things (IoT) sensors has led to massive
growth in data generation at the edge of the Internet over the past decade. Intelligent real …

DVFO: Learning-Based DVFS for Energy-Efficient Edge-Cloud Collaborative Inference

Z Zhang, Y Zhao, H Li, C Lin… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Due to limited resources on edge and different characteristics of deep neural network (DNN)
models, it is a big challenge to optimize DNN inference performance in terms of energy …

Joint multiuser DNN partitioning and computational resource allocation for collaborative edge intelligence

X Tang, X Chen, L Zeng, S Yu… - IEEE Internet of Things …, 2020 - ieeexplore.ieee.org
Mobile-edge computing (MEC) has emerged as a promising supporting architecture
providing a variety of resources to the network edge, thus acting as an enabler for edge …

Advancing Mobility Enhanced Edge Intelligence for 6G Networks

MK Vanteru - 2024 IEEE International Conference on Big Data …, 2024 - ieeexplore.ieee.org
Edge intelligence emerges as a novel paradigm facilitating real-time training and inference
at the wireless edge, empowering critical applications. This necessitates the dense …

Dynamic hierarchical neural network offloading in IoT edge networks

W Seifeddine, C Adjih, N Achir - 2021 10th IFIP International …, 2021 - ieeexplore.ieee.org
In recent developments in machine learning, a trend has emerged where larger models
achieve better performance. At the same time, deploying these models in real-life scenarios …

Enable Intelligence on Billion Devices with Deep Learning

A Li - 2022 - search.proquest.com
With the proliferation of edge computing and Internet of Things (IoT), billions of edge devices
(eg, smartphone, AR/VR headset, autonomous car, etc) are deployed in our daily life and …

Deep reinforcement learning based energy-efficient task offloading for secondary mobile edge systems

X Zhang, A Pal, S Debroy - 2020 IEEE 45th LCN Symposium …, 2020 - ieeexplore.ieee.org
In order to support last-mile wireless connectivity of computation-intensive applications,
edge systems can benefit from secondary (ie, opportunistic) utilization of licensed spectrum …

TreeNet: A hierarchical deep learning model to facilitate edge intelligence for resource-constrained devices

D Lu, Y Zhai, J Wu, J Shen - 2021 IEEE/ACM 21st International …, 2021 - ieeexplore.ieee.org
Deep learning has achieved remarkable successes in various areas such as computer
vision and natural language processing. Many sophisticated models have been proposed to …

Distilled split deep neural networks for edge-assisted real-time systems

Y Matsubara, S Baidya, D Callegaro… - Proceedings of the …, 2019 - dl.acm.org
Offloading the execution of complex Deep Neural Networks (DNNs) models to compute-
capable devices at the network edge, that is, edge servers, can significantly reduce capture …

Task-oriented integrated sensing, computation and communication for wireless edge AI

H Xing, G Zhu, D Liu, H Wen, K Huang, K Wu - IEEE Network, 2023 - ieeexplore.ieee.org
With the advent of emerging IoT applications, such as autonomous driving, digital-twin,
metaverse, etc., featuring massive data sensing, analyzing, inference, and critical latency in …