[HTML][HTML] Intelligent traffic management in next-generation networks

O Aouedi, K Piamrat, B Parrein - Future internet, 2022 - mdpi.com
The recent development of smart devices has lead to an explosion in data generation and
heterogeneity. Hence, current networks should evolve to become more intelligent, efficient …

Deep learning workload scheduling in gpu datacenters: Taxonomy, challenges and vision

W Gao, Q Hu, Z Ye, P Sun, X Wang, Y Luo… - arXiv preprint arXiv …, 2022 - arxiv.org
Deep learning (DL) shows its prosperity in a wide variety of fields. The development of a DL
model is a time-consuming and resource-intensive procedure. Hence, dedicated GPU …

A comprehensive survey on training acceleration for large machine learning models in IoT

H Wang, Z Qu, Q Zhou, H Zhang, B Luo… - IEEE Internet of …, 2021 - ieeexplore.ieee.org
The ever-growing artificial intelligence (AI) applications have greatly reshaped our world in
many areas, eg, smart home, computer vision, natural language processing, etc. Behind …

[HTML][HTML] Dynamic and adaptive fault-tolerant asynchronous federated learning using volunteer edge devices

JÁ Morell, E Alba - Future Generation Computer Systems, 2022 - Elsevier
The number of devices, from smartphones to IoT hardware, interconnected via the Internet is
growing all the time. These devices produce a large amount of data that cannot be analyzed …

Communication optimization strategies for distributed deep neural network training: A survey

S Ouyang, D Dong, Y Xu, L Xiao - Journal of Parallel and Distributed …, 2021 - Elsevier
Recent trends in high-performance computing and deep learning have led to the
proliferation of studies on large-scale deep neural network training. However, the frequent …

SPACX: Silicon photonics-based scalable chiplet accelerator for DNN inference

Y Li, A Louri, A Karanth - 2022 IEEE International Symposium …, 2022 - ieeexplore.ieee.org
In pursuit of higher inference accuracy, deep neural network (DNN) models have
significantly increased in complexity and size. To overcome the consequent computational …

[HTML][HTML] From distributed machine to distributed deep learning: a comprehensive survey

M Dehghani, Z Yazdanparast - Journal of Big Data, 2023 - Springer
Artificial intelligence has made remarkable progress in handling complex tasks, thanks to
advances in hardware acceleration and machine learning algorithms. However, to acquire …

A survey on auto-parallelism of large-scale deep learning training

P Liang, Y Tang, X Zhang, Y Bai, T Su… - … on Parallel and …, 2023 - ieeexplore.ieee.org
Deep learning (DL) has gained great success in recent years, leading to state-of-the-art
performance in research community and industrial fields like computer vision and natural …

Characterizing deep learning training workloads on alibaba-pai

M Wang, C Meng, G Long, C Wu… - 2019 IEEE …, 2019 - ieeexplore.ieee.org
Modern deep learning models have been exploited in various domains, including computer
vision (CV), natural language processing (NLP), search and recommendation. In practical AI …

Joint optimization of energy consumption and completion time in federated learning

X Zhou, J Zhao, H Han, C Guet - 2022 IEEE 42nd International …, 2022 - ieeexplore.ieee.org
Federated Learning (FL) is an intriguing distributed machine learning approach due to its
privacy-preserving characteristics. To balance the trade-off between energy and execution …