Deep neural network–based enhancement for image and video streaming systems: A survey and future directions

R Lee, SI Venieris, ND Lane - ACM Computing Surveys (CSUR), 2021 - dl.acm.org
Internet-enabled smartphones and ultra-wide displays are transforming a variety of visual
apps spanning from on-demand movies and 360° videos to video-conferencing and live …

Server-driven video streaming for deep learning inference

K Du, A Pervaiz, X Yuan, A Chowdhery… - Proceedings of the …, 2020 - dl.acm.org
Video streaming is crucial for AI applications that gather videos from sources to servers for
inference by deep neural nets (DNNs). Unlike traditional video streaming that optimizes …

Reducto: On-camera filtering for resource-efficient real-time video analytics

Y Li, A Padmanabhan, P Zhao, Y Wang… - Proceedings of the …, 2020 - dl.acm.org
To cope with the high resource (network and compute) demands of real-time video analytics
pipelines, recent systems have relied on frame filtering. However, filtering has typically been …

Tabi: An efficient multi-level inference system for large language models

Y Wang, K Chen, H Tan, K Guo - Proceedings of the Eighteenth …, 2023 - dl.acm.org
Today's trend of building ever larger language models (LLMs), while pushing the
performance of natural language processing, adds significant latency to the inference stage …

Neural-enhanced live streaming: Improving live video ingest via online learning

J Kim, Y Jung, H Yeo, J Ye, D Han - … of the Annual conference of the …, 2020 - dl.acm.org
Live video accounts for a significant volume of today's Internet video. Despite a large
number of efforts to enhance user quality of experience (QoE) both at the ingest and …

Machine learning for computer systems and networking: A survey

ME Kanakis, R Khalili, L Wang - ACM Computing Surveys, 2022 - dl.acm.org
Machine learning (ML) has become the de-facto approach for various scientific domains
such as computer vision and natural language processing. Despite recent breakthroughs …

Neuroscaler: Neural video enhancement at scale

H Yeo, H Lim, J Kim, Y Jung, J Ye, D Han - Proceedings of the ACM …, 2022 - dl.acm.org
High-definition live streaming has experienced tremendous growth. However, the video
quality of live video is often limited by the streamer's uplink bandwidth. Recently, neural …

Enabling edge-cloud video analytics for robotics applications

Y Wang, W Wang, D Liu, X Jin, J Jiang… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Emerging deep learning-based video analytics tasks demand computation-intensive neural
networks and powerful computing resources on the cloud to achieve high accuracy. Due to …

Gemel: Model Merging for {Memory-Efficient},{Real-Time} Video Analytics at the Edge

A Padmanabhan, N Agarwal, A Iyer… - … USENIX Symposium on …, 2023 - usenix.org
Video analytics pipelines have steadily shifted to edge deployments to reduce bandwidth
overheads and privacy violations, but in doing so, face an ever-growing resource tension …

Casva: Configuration-adaptive streaming for live video analytics

M Zhang, F Wang, J Liu - IEEE INFOCOM 2022-IEEE …, 2022 - ieeexplore.ieee.org
The advent of high-accuracy and resource-intensive deep neural networks (DNNs) has
fulled the development of live video analytics, where camera videos need to be streamed …