Horizontally distributed inference of deep neural networks for AI-enabled IoT

I Rodriguez-Conde, C Campos, F Fdez-Riverola - Sensors, 2023 - mdpi.com
Motivated by the pervasiveness of artificial intelligence (AI) and the Internet of Things (IoT) in
the current “smart everything” scenario, this article provides a comprehensive overview of …

Edge computing technology enablers: A systematic lecture study

S Douch, MR Abid, K Zine-Dine, D Bouzidi… - IEEE …, 2022 - ieeexplore.ieee.org
With the increasing stringent QoS constraints (eg, latency, bandwidth, jitter) imposed by
novel applications (eg, e-Health, autonomous vehicles, smart cities, etc.), as well as the …

Distributed assignment with load balancing for dnn inference at the edge

Y Xu, T Mohammed, M Di Francesco… - IEEE Internet of …, 2022 - ieeexplore.ieee.org
Inference carried out on pretrained deep neural networks (DNNs) is particularly effective as
it does not require retraining and entails no loss in accuracy. Unfortunately, resource …

OfpCNN: On-Demand Fine-Grained Partitioning for CNN Inference Acceleration in Heterogeneous Devices

L Yang, C Zheng, X Shen, G Xie - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Collaborative inference is a promising method for balancing the limited computational power
of Internet of Things (IoT) devices with the huge computational demands of convolutional …

Stain: Stealthy avenues of attacks on horizontally collaborated convolutional neural network inference and their mitigation

AA Adeyemo, JJ Sanderson, TA Odetola… - IEEE …, 2023 - ieeexplore.ieee.org
With significant potential improvement in device-to-device (D2D) communication due to
improved wireless link capacity (eg, 5G and NextG systems), a collaboration of multiple …

Embedded Distributed Inference of Deep Neural Networks: A Systematic Review

FN Peccia, O Bringmann - arXiv preprint arXiv:2405.03360, 2024 - arxiv.org
Embedded distributed inference of Neural Networks has emerged as a promising approach
for deploying machine-learning models on resource-constrained devices in an efficient and …

A survey on deep neural network partition over cloud, edge and end devices

D Xu, X He, T Su, Z Wang - arXiv preprint arXiv:2304.10020, 2023 - arxiv.org
Deep neural network (DNN) partition is a research problem that involves splitting a DNN into
multiple parts and offloading them to specific locations. Because of the recent advancement …

A Relay-Assisted Communication Scheme for Collaborative On-Device CNN Execution Considering Hybrid Parallelism

E Kilcioglu, I Stupia, L Vandendorpe - IEEE Access, 2023 - ieeexplore.ieee.org
Deep learning (DL) has gained increasing prominence in latency-critical artificial
intelligence (AI) applications. Due to the intensive computational requirements of these …

Joint architecture design and workload partitioning for dnn inference on industrial iot clusters

W Fang, W Xu, C Yu, NN Xiong - ACM Transactions on Internet …, 2023 - dl.acm.org
The advent of Deep Neural Networks (DNNs) has empowered numerous computer-vision
applications. Due to the high computational intensity of DNN models, as well as the resource …

JMDC: A joint model and data compression system for deep neural networks collaborative computing in edge-cloud networks

Y Ding, W Fang, M Liu, M Wang, Y Cheng… - Journal of Parallel and …, 2023 - Elsevier
Abstract Deep Neural Networks (DNNs) have shown exceptional promise in providing
Artificial Intelligence (AI) to many computer vision applications. Nevertheless, complex …