Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey

F Liang, Z Zhang, H Lu, V Leung, Y Guo… - arXiv preprint arXiv …, 2024 - arxiv.org
With the rapid growth in the volume of data sets, models, and devices in the domain of deep
learning, there is increasing attention on large-scale distributed deep learning. In contrast to …

Communication optimization algorithms for distributed deep learning systems: A survey

E Yu, D Dong, X Liao - IEEE Transactions on Parallel and …, 2023 - ieeexplore.ieee.org
Deep learning's widespread adoption in various fields has made distributed training across
multiple computing nodes essential. However, frequent communication between nodes can …

Next Generation of Multi-Agent Driven Smart City Applications and Research Paradigms

A Arora, A Jain, D Yadav, V Hassija… - IEEE Open Journal …, 2023 - ieeexplore.ieee.org
Smart cities have seen a growing interest among governments, researchers, and industries.
Smart cities use digital technologies to enhance the quality of life for residents while …

A systematic survey into compression algorithms for three-dimensional content

I Bozhilov, R Petkova, K Tonchev, A Manolova - IEEE Access, 2024 - ieeexplore.ieee.org
This systematic review investigates compression algorithms for three-dimensional content,
focusing on recent advancements. It categorizes the methodologies into traditional, learning …

Dual-input ultralight multi-head self-attention learning network for hyperspectral image classification

X Li, M Xu, S Liu, H Sheng, J Wan - International Journal of …, 2024 - Taylor & Francis
In the hyperspectral image (HSI) classification tasks, various deep learning models have
achieved remarkable success. However, most deep learning models are compute-intensive …

FedUVeQCS: Universal Vector Quantized Compressive Sensing for Communication-Efficient Federated Learning

Z Liu, H Wang, X Li - IEEE Internet of Things Journal, 2024 - ieeexplore.ieee.org
Traditional machine learning involves collecting data from clients to a central server, where
data may not be willingly shared by the clients. In contrast, federated learning (FL) trains a …

Communication-Efficient Distributed Deep Learning via Federated Dynamic Averaging

M Theologitis, G Frangias, G Anestis… - arXiv preprint arXiv …, 2024 - arxiv.org
Driven by the ever-growing volume and decentralized nature of data, coupled with the
escalating size of modern models, distributed deep learning (DDL) has been entrenched as …

Enhancing the Computing Efficiency Through Data Compression for Machine Learning

K Elavarasi, K Vishnupriya - 2024 Second International …, 2024 - ieeexplore.ieee.org
As machine learning data sizes continue to rise, this work offers a unique solution to improve
computing efficiency by means of data compression. This starts by going over the problem's …

[引用][C] Squeezing Efficiency: Exploring Activation and Gradient Compression in Deep Learning

K Kumar, H Arsalan