Server-driven video streaming for deep learning inference

K Du, A Pervaiz, X Yuan, A Chowdhery… - Proceedings of the …, 2020 - dl.acm.org
Video streaming is crucial for AI applications that gather videos from sources to servers for
inference by deep neural nets (DNNs). Unlike traditional video streaming that optimizes …

Scrooge: A cost-effective deep learning inference system

Y Hu, R Ghosh, R Govindan - Proceedings of the ACM Symposium on …, 2021 - dl.acm.org
Advances in deep learning (DL) have prompted the development of cloud-hosted DL-based
media applications that process video and audio streams in real-time. Such applications …

Casva: Configuration-adaptive streaming for live video analytics

M Zhang, F Wang, J Liu - IEEE INFOCOM 2022-IEEE …, 2022 - ieeexplore.ieee.org
The advent of high-accuracy and resource-intensive deep neural networks (DNNs) has
fulled the development of live video analytics, where camera videos need to be streamed …

Neural-enhanced live streaming: Improving live video ingest via online learning

J Kim, Y Jung, H Yeo, J Ye, D Han - … of the Annual conference of the …, 2020 - dl.acm.org
Live video accounts for a significant volume of today's Internet video. Despite a large
number of efforts to enhance user quality of experience (QoE) both at the ingest and …

Swift: Adaptive video streaming with layered neural codecs

M Dasari, K Kahatapitiya, SR Das… - … USENIX Symposium on …, 2022 - usenix.org
Layered video coding compresses video segments into layers (additional code bits).
Decoding with each additional layer improves video quality incrementally. This approach …

Online model distillation for efficient video inference

RT Mullapudi, S Chen, K Zhang… - Proceedings of the …, 2019 - openaccess.thecvf.com
High-quality computer vision models typically address the problem of understanding the
general distribution of real-world images. However, most cameras observe only a very small …

{RECL}: Responsive {Resource-Efficient} continuous learning for video analytics

M Khani, G Ananthanarayanan, K Hsieh… - … USENIX Symposium on …, 2023 - usenix.org
Continuous learning has recently shown promising results for video analytics by adapting a
lightweight" expert" DNN model for each specific video scene to cope with the data drift in …

Distream: scaling live video analytics with workload-adaptive distributed edge intelligence

X Zeng, B Fang, H Shen, M Zhang - Proceedings of the 18th Conference …, 2020 - dl.acm.org
Video cameras have been deployed at scale today. Driven by the breakthrough in deep
learning (DL), organizations that have deployed these cameras start to use DL-based …

Neural adaptive video streaming with pensieve

H Mao, R Netravali, M Alizadeh - Proceedings of the conference of the …, 2017 - dl.acm.org
Client-side video players employ adaptive bitrate (ABR) algorithms to optimize user quality
of experience (QoE). Despite the abundance of recently proposed schemes, state-of-the-art …

Deltacnn: End-to-end cnn inference of sparse frame differences in videos

M Parger, C Tang, CD Twigg… - Proceedings of the …, 2022 - openaccess.thecvf.com
Convolutional neural network inference on video data requires powerful hardware for real-
time processing. Given the inherent coherence across consecutive frames, large parts of a …