Towards memory-efficient inference in edge video analytics

A Padmanabhan, AP Iyer… - Proceedings of the 3rd …, 2021 - dl.acm.org
Video analytics pipelines incorporate on-premise edge servers to lower analysis latency,
ensure privacy, and reduce bandwidth requirements. However, compared to the cloud, edge …

Gemel: Model Merging for {Memory-Efficient},{Real-Time} Video Analytics at the Edge

A Padmanabhan, N Agarwal, A Iyer… - … USENIX Symposium on …, 2023 - usenix.org
Video analytics pipelines have steadily shifted to edge deployments to reduce bandwidth
overheads and privacy violations, but in doing so, face an ever-growing resource tension …

Ravas: Interference-aware model selection and resource allocation for live edge video analytics

A Rahmanian, A Ali-Eldin, SK Tesfatsion… - 2023 IEEE/ACM …, 2023 - ieeexplore.ieee.org
Numerous edge applications that rely on video analytics demand precise, low-latency
processing of multiple video streams from cameras. When these cameras are mobile, such …

Ekya: Continuous learning of video analytics models on edge compute servers

R Bhardwaj, Z Xia, G Ananthanarayanan… - … USENIX Symposium on …, 2022 - usenix.org
Video analytics applications use edge compute servers for processing videos. Compressed
models that are deployed on the edge servers for inference suffer from data drift where the …

EAVA: Adaptive and Fast Edge-assisted Video Analytics On Mobile Device

Y Su, C Cao, J Li, Y Li - 2023 IEEE 29th International …, 2023 - ieeexplore.ieee.org
Mobile video analytics applications, such as smart driving, VR/AR, and video surveillance,
have become increasingly popular due to the proliferation of mobile devices. These …

React: streaming video analytics on the edge with asynchronous cloud support

A Ghosh, S Iyengar, S Lee, A Rathore… - Proceedings of the 8th …, 2023 - dl.acm.org
Emerging Internet of Things (IoT) and mobile computing applications are expected to
support latency-sensitive deep neural network (DNN) workloads. To realize this vision, the …

Performance characterization of video analytics workloads in heterogeneous edge infrastructures

D Rivas, F Guim, J Polo… - … and Computation: Practice …, 2023 - Wiley Online Library
Powered by deep learning, video analytic applications process millions of camera feeds in
real‐time to extract meaningful information from their surroundings. And this number grows …

Arena: A Patch-of-Interest ViT Inference Acceleration System for Edge-Assisted Video Analytics

H Peng, W Feng, H Li, Y Zhan, Q Zhou… - arXiv preprint arXiv …, 2024 - arxiv.org
The advent of edge computing has made real-time intelligent video analytics feasible.
Previous works, based on traditional model architecture (eg, CNN, RNN, etc.), employ …

Towards performance clarity of edge video analytics

Z Xiao, Z Xia, H Zheng, BY Zhao… - 2021 IEEE/ACM …, 2021 - ieeexplore.ieee.org
Edge video analytics is becoming the solution to many safety and management tasks. Its
wide deployment, however, must first address the tension between inference accuracy and …

PacketGame: Multi-Stream Packet Gating for Concurrent Video Inference at Scale

M Yuan, L Zhang, X You, XY Li - Proceedings of the ACM SIGCOMM …, 2023 - dl.acm.org
The resource efficiency of video analytics workloads is critical for large-scale deployments
on edge nodes and cloud clusters. Recent advanced systems have benefited from …