Attention-aware Semantic Communications for Collaborative Inference

J Im, N Kwon, T Park, J Woo, J Lee, Y Kim - arXiv preprint arXiv …, 2024 - arxiv.org
We propose a communication-efficient collaborative inference framework in the domain of
edge inference, focusing on the efficient use of vision transformer (ViTs) models. The …

DeViT: Decomposing vision transformers for collaborative inference in edge devices

G Xu, Z Hao, Y Luo, H Hu, J An… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Recent years have witnessed the great success of vision transformer (ViT), which has
achieved state-of-the-art performance on multiple computer vision benchmarks. However …

Factionformer: Context-driven collaborative vision transformer models for edge intelligence

ST Nimi, MA Arefeen, MYS Uddin… - … on Smart Computing …, 2023 - ieeexplore.ieee.org
Edge Intelligence has received attention in the recent times for its potential towards
improving responsiveness, reducing the cost of data transmission, enhancing security and …

Context-Driven Device-Edge Collaborative Vision Transformer Models for Edge AI

ST Nimi, MA Arefeen, MYS Uddin, B Debnath… - Available at SSRN … - papers.ssrn.com
Many applications require real-time processing and response times that arenot achievable
with cloud-based processing. Towards this end, Edge intelligence improves …

CiNet: Redesigning Deep Neural Networks for Efficient Mobile-Cloud Collaborative Inference

X Dai, X Kong, T Guo, Y Huang - Proceedings of the 2021 SIAM International …, 2021 - SIAM
Deep neural networks are increasingly used in end devices such as mobile phones to
support novel features, eg, image classification. Traditional paradigms to support mobile …

MDP: Model Decomposition and Parallelization of Vision Transformer for Distributed Edge Inference

W Wang, Y Zhang, Y Jin, H Tian… - 2023 19th International …, 2023 - ieeexplore.ieee.org
Distributed edge inference emerges to be a promising paradigm to speed up inference.
Previous works make physical partitions on CNNs to realize it, but there are the following …

Towards Improving Ensemble-based Collaborative Inference at the Edge

S Kumazawa, J Yu, K Kawamura, T Van Chu… - IEEE …, 2024 - ieeexplore.ieee.org
Ensemble-based collaborative inference systems, Edge Ensembles, are deep learning edge
inference systems that enhance accuracy by aggregating predictions from models deployed …

Energy-efficient model compression and splitting for collaborative inference over time-varying channels

M Krouka, A Elgabli, CB Issaid… - 2021 IEEE 32nd Annual …, 2021 - ieeexplore.ieee.org
Today's intelligent applications can achieve high performance accuracy using machine
learning (ML) techniques, such as deep neural networks (DNNs). Traditionally, in a remote …

DFTS2: Simulating deep feature transmission over packet loss channels

A Dhondea, RA Cohen, IV Bajić - arXiv preprint arXiv:2112.00794, 2021 - arxiv.org
In edge-cloud collaborative intelligence (CI), an unreliable transmission channel exists in
the information path of the AI model performing the inference. It is important to be able to …

Communication-Efficient Collaborative Perception via Information Filling with Codebook

Y Hu, J Peng, S Liu, J Ge, S Liu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Collaborative perception empowers each agent to improve its perceptual ability through the
exchange of perceptual messages with other agents. It inherently results in a fundamental …