A distributed deep learning system with controlled intermediate representation

Y Xiao, Y Wang, Z Huang, F Shen… - 2023 IEEE Smart World …, 2023 - ieeexplore.ieee.org
The front deployed deep learning system is a promising technology for the next generation
of industrial applications, which can extract essential information from high dimension …

AFSD: Adaptive Feature Space Distillation for Distributed Deep Learning

S Khaleghian, H Ullah, EB Johnsen, A Andersen… - IEEE …, 2022 - ieeexplore.ieee.org
We propose a novel and adaptive feature space distillation method (AFSD) to reduce the
communication overhead among distributed computers. The proposed method improves the …

Fully distributed deep learning inference on resource-constrained edge devices

R Stahl, Z Zhao, D Mueller-Gritschneder… - … , and Simulation: 19th …, 2019 - Springer
Performing inference tasks of deep learning applications on IoT edge devices ensures
privacy of input data and can result in shorter latency when compared to a cloud solution. As …

AutoDDL: Automatic Distributed Deep Learning With Near-Optimal Bandwidth Cost

J Chen, S Li, R Guo, J Yuan… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Recent advances in deep learning are driven by the growing scale of computation, data, and
models. However, efficiently training large-scale models on distributed systems requires an …

NAIR: An Efficient Distributed Deep Learning Architecture for Resource Constrained IoT System

Y Xiao, D Zhang, Y Wang, X Dai… - IEEE Internet of …, 2024 - ieeexplore.ieee.org
The distributed deep learning architecture can support the front-deployment of deep
learning systems in resource constrained Internet of Things devices and is attracting …

Split-et-impera: a framework for the design of distributed deep learning applications

L Capogrosso, F Cunico, M Lora… - … on Design and …, 2023 - ieeexplore.ieee.org
Many recent pattern recognition applications rely on complex distributed architectures in
which sensing and computational nodes interact together through a communication network …

Partitioning dnns for optimizing distributed inference performance on cooperative edge devices: A genetic algorithm approach

J Na, H Zhang, J Lian, B Zhang - Applied Sciences, 2022 - mdpi.com
To fully unleash the potential of edge devices, it is popular to cut a neural network into
multiple pieces and distribute them among available edge devices to perform inference …

Trends on Distributed Frameworks for Deep Learning

SY Ahn, YM Park, EJ Lim, W Choi - Electronics and …, 2016 - koreascience.kr
최근 알파고를 통해 인공지능 기술이 전 세계인의 이목을 집중시켰던 반면, 인공지능
연구자들은 인공지능 부활에 결정적 역할을 한 딥러닝 기술에 주목하고 있다. 딥러닝은 다계층 …

Eddl: A distributed deep learning system for resource-limited edge computing environment

P Hao, Y Zhang - 2021 IEEE/ACM Symposium on Edge …, 2021 - ieeexplore.ieee.org
This paper investigates the problem of performing distributed deep learning (DDL) to train
machine learning (ML) models at the edge with resource-constrained embedded devices …

Inverse-GMM: A Latency Distribution Shaping Method for Industrial Cooperative Deep Learning Systems

F Qin, Y Xiao, X Sun, X Dai, W Zhang… - IEEE Journal on …, 2023 - ieeexplore.ieee.org
The front deployed deep learning is a promising technology of the next generation industrial
applications, which can extract essential information from high dimension sensors. However …