Mimic the raw domain: Accelerating action recognition in the compressed domain

B Battash, H Barad, H Tang… - Proceedings of the …, 2020 - openaccess.thecvf.com
Video understanding usually requires expensive computation that prohibits its deployment,
yet videos contain significant spatiotemporal redundancy that can be exploited. In particular …

No frame left behind: Full video action recognition

X Liu, SL Pintea, FK Nejadasl, O Booij… - Proceedings of the …, 2021 - openaccess.thecvf.com
Not all video frames are equally informative for recognizing an action. It is computationally
infeasible to train deep networks on all video frames when actions develop over hundreds of …

Compressed video action recognition with refined motion vector

H Cao, S Yu, J Feng - arXiv preprint arXiv:1910.02533, 2019 - arxiv.org
Although CNN has reached satisfactory performance in image-related tasks, using CNN to
process videos is much more challenging due to the enormous size of raw video streams. In …

Lightweight action recognition in compressed videos

Y Huo, X Xu, Y Lu, Y Niu, M Ding, Z Lu, T Xiang… - Computer Vision–ECCV …, 2020 - Springer
Most existing action recognition models are large convolutional neural networks that work
only with raw RGB frames as input. However, practical applications require lightweight …

Dmc-net: Generating discriminative motion cues for fast compressed video action recognition

Z Shou, X Lin, Y Kalantidis… - Proceedings of the …, 2019 - openaccess.thecvf.com
Motion has shown to be useful for video understanding, where motion is typically
represented by optical flow. However, computing flow from video frames is very …

MV2Flow: Learning motion representation for fast compressed video action recognition

H Hu, W Zhou, X Li, N Yan, H Li - ACM Transactions on Multimedia …, 2020 - dl.acm.org
In video action recognition, motion is a very crucial clue, which is usually represented by
optical flow. However, optical flow is computationally expensive to obtain, which becomes …

Sample less, learn more: Efficient action recognition via frame feature restoration

H Cheng, Y Guo, L Nie, Z Cheng… - Proceedings of the 31st …, 2023 - dl.acm.org
Training an effective video action recognition model poses significant computational
challenges, particularly under limited resource budgets. Current methods primarily aim to …

Slowfast networks for video recognition

C Feichtenhofer, H Fan, J Malik… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
We present SlowFast networks for video recognition. Our model involves (i) a Slow pathway,
operating at low frame rate, to capture spatial semantics, and (ii) a Fast pathway, operating …

Dynamic inference: A new approach toward efficient video action recognition

W Wu, D He, X Tan, S Chen… - Proceedings of the …, 2020 - openaccess.thecvf.com
Though action recognition in videos has achieved great success recently, it remains a
challenging task due to the massive computational cost. Designing lightweight networks is a …

Mgsampler: An explainable sampling strategy for video action recognition

Y Zhi, Z Tong, L Wang, G Wu - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Frame sampling is a fundamental problem in video action recognition due to the essential
redundancy in time and limited computation resources. The existing sampling strategy often …