LayerPipe: Accelerating deep neural network training by intra-layer and inter-layer gradient pipelining and multiprocessor scheduling

NK Unnikrishnan, KK Parhi - 2021 IEEE/ACM International …, 2021 - ieeexplore.ieee.org
The time required for training the neural networks increases with size, complexity, and
depth. Training model parameters by backpropagation inherently creates feedback loops …

Latency-driven model placement for efficient edge intelligence service

P Lin, Z Shi, Z Xiao, C Chen, K Li - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Deep learning services based on cloud computing have deficiencies in latency, privacy, etc.
To meet the requirements of low latency, researchers have begun to consider the …

[PDF][PDF] A Novel Mixed Precision Distributed TPU GAN for Accelerated Learning Curve.

A Ravikumar, H Sriraman - Comput. Syst. Sci. Eng., 2023 - researchgate.net
Deep neural networks are gaining importance and popularity in applications and services.
Due to the enormous number of learnable parameters and datasets, the training of neural …

[HTML][HTML] Lightweight and Elegant Data Reduction Strategies for Training Acceleration of Convolutional Neural Networks

A Demidovskij, A Tugaryov, A Trutnev, M Kazyulina… - Mathematics, 2023 - mdpi.com
Due to industrial demands to handle increasing amounts of training data, lower the cost of
computing one model at a time, and lessen the ecological effects of intensive computing …

Ai technical considerations: Data storage, cloud usage and ai pipeline

PM van Ooijen, E Darzidehkalani, A Dekker - arXiv preprint arXiv …, 2022 - arxiv.org
Artificial intelligence (AI), especially deep learning, requires vast amounts of data for
training, testing, and validation. Collecting these data and the corresponding annotations …

A Fusion Pretrained Approach for Identifying the Cause of Sarcasm Remarks

Q Li, DJ Xu, H Qian, L Wang… - INFORMS Journal on …, 2024 - pubsonline.informs.org
Sarcastic remarks often appear in social media and e-commerce platforms to express almost
exclusively negative emotions and opinions on certain instances, such as dissatisfaction …

[HTML][HTML] Geometric deep lean learning: Evaluation using a twitter social network

J Villalba-Diez, M Molina, D Schmidt - Applied Sciences, 2021 - mdpi.com
The goal of this work is to evaluate a deep learning algorithm that has been designed to
predict the topological evolution of dynamic complex non-Euclidean graphs in discrete–time …

A novel device placement approach based on position-aware subgraph neural networks

M Han, Y Zeng, J Zhang, Y Ren, M Xue, M Zhou - Neurocomputing, 2024 - Elsevier
Coping with the growing demand for data and parameters in complex neural network (NN)
models of contemporary times typically involves distributing them across multiple devices …

A Family of Hybrid Federated and CentralizedLearning Architectures in Machine Learning

AM Elbir, S Coleri, AK Papazafeiropoulos… - IEEE Transactions on …, 2022 - orbilu.uni.lu
Many of the machine learning tasks focus on cen-tralized learning (CL), which requires the
transmission of localdatasets from the clients to a parameter server (PS) entailing …

InferFair: Towards QoS-aware scheduling for performance isolation guarantee in heterogeneous model serving systems

Y Peng, H Peng - Future Generation Computer Systems, 2024 - Elsevier
With the popularity of Deep Neural Network (DNN) models in diverse fields, DNN inference
services have been widely deployed on cloud for resource-limited devices to support …