Hybrid federated and centralized learning

AM Elbir, S Coleri, KV Mishra - 2021 29th European Signal …, 2021 - ieeexplore.ieee.org
Many of the machine learning tasks are focused on centralized learning (CL), which requires
the transmission of local datasets from the clients to a parameter server (PS) leading to a …

Distributed quantum learning with co-management in a multi-tenant quantum system

A D'Onofrio, A Hossain, L Santana… - … Conference on Big …, 2023 - ieeexplore.ieee.org
The rapid advancement of quantum computing has pushed classical designs into the
quantum domain, breaking physical boundaries for computing-intensive and data-hungry …

Optimising communication overhead in federated learning using NSGA-II

JÁ Morell, ZA Dahi, F Chicano, G Luque… - … Conference on the …, 2022 - Springer
Federated learning is a training paradigm according to which a server-based model is
cooperatively trained using local models running on edge devices and ensuring data …

Taking ROCKET on an efficiency mission: Multivariate time series classification with LightWaveS

L Pantiskas, K Verstoep… - … Computing in Sensor …, 2022 - ieeexplore.ieee.org
Nowadays, with the rising number of sensor signals in sectors such as healthcare and
industry, the problem of multivariate time series classification (MTSC) is getting increasingly …

[HTML][HTML] An invitation to distributed quantum neural networks

L Pira, C Ferrie - Quantum Machine Intelligence, 2023 - Springer
Deep neural networks have established themselves as one of the most promising machine
learning techniques. Training such models at large scales is often parallelized, giving rise to …

Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey

F Liang, Z Zhang, H Lu, V Leung, Y Guo… - arXiv preprint arXiv …, 2024 - arxiv.org
With the rapid growth in the volume of data sets, models, and devices in the domain of deep
learning, there is increasing attention on large-scale distributed deep learning. In contrast to …

[HTML][HTML] Truncating a densely connected convolutional neural network with partial layer freezing and feature fusion for diagnosing COVID-19 from chest X-rays

FJP Montalbo - MethodsX, 2021 - Elsevier
Deep learning and computer vision revolutionized a new method to automate medical
image diagnosis. However, to achieve reliable and state-of-the-art performance, vision …

Shortcut-connected Expert Parallelism for Accelerating Mixture-of-Experts

W Cai, J Jiang, L Qin, J Cui, S Kim, J Huang - arXiv preprint arXiv …, 2024 - arxiv.org
Expert parallelism has been introduced as a strategy to distribute the computational
workload of sparsely-gated mixture-of-experts (MoE) models across multiple computing …

Elasticdl: A kubernetes-native deep learning framework with fault-tolerance and elastic scheduling

J Zhou, K Zhang, F Zhu, Q Shi, W Fang… - Proceedings of the …, 2023 - dl.acm.org
The power of artificial intelligence (AI) models originates with sophisticated model
architecture as well as the sheer size of the model. These large-scale AI models impose new …

A scalable system-on-chip acceleration for deep neural networks

F Shehzad, M Rashid, MH Sinky, SS Alotaibi… - IEEE …, 2021 - ieeexplore.ieee.org
The size of neural networks in deep learning techniques is increasing and varies
significantly according to the requirements of real-life applications. The increasing network …