Humans in 4D: Reconstructing and tracking humans with transformers

S Goel, G Pavlakos, J Rajasegaran… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present an approach to reconstruct humans and track them over time. At the core of our
approach, we propose a fully" transformerized" version of a network for human mesh …

On the benefits of 3d pose and tracking for human action recognition

J Rajasegaran, G Pavlakos… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work we study the benefits of using tracking and 3D poses for action recognition. To
achieve this, we take the Lagrangian view on analysing actions over a trajectory of human …

Pose-appearance relational modeling for video action recognition

M Cui, W Wang, K Zhang, Z Sun… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Recent studies of video action recognition can be classified into two categories: the
appearance-based methods and the pose-based methods. The appearance-based methods …

Skeleton-based multifeatures and multistream network for real-time action recognition

Z Deng, Q Gao, Z Ju, X Yu - IEEE Sensors Journal, 2023 - ieeexplore.ieee.org
Action recognition is a hot topic in the field of computer vision. It has been widely used in
human–computer/robot interaction, abnormal behavior monitoring, and medical assistive …

Steps: Self-supervised key step extraction and localization from unlabeled procedural videos

A Shah, B Lundell, H Sawhney… - Proceedings of the …, 2023 - openaccess.thecvf.com
We address the problem of extracting key steps from unlabeled procedural videos,
motivated by the potential of Augmented Reality (AR) headsets to revolutionize job training …

Human activity recognition using cascaded dual attention cnn and bi-directional gru framework

H Ullah, A Munir - Journal of Imaging, 2023 - mdpi.com
Vision-based human activity recognition (HAR) has emerged as one of the essential
research areas in video analytics. Over the last decade, numerous advanced deep learning …

Human pose-based estimation, tracking and action recognition with deep learning: A survey

L Zhou, X Meng, Z Liu, M Wu, Z Gao… - arXiv preprint arXiv …, 2023 - arxiv.org
Human pose analysis has garnered significant attention within both the research community
and practical applications, owing to its expanding array of uses, including gaming, video …

A semantic and motion-aware spatiotemporal transformer network for action detection

M Korban, P Youngs, ST Acton - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
This paper presents a novel spatiotemporal transformer network that introduces several
original components to detect actions in untrimmed videos. First, the multi-feature selective …

Enhancing Skeleton-Based Action Recognition in Real-World Scenarios Through Realistic Data Augmentation

M Cormier, Y Schmid, J Beyerer - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Skeleton-based action recognition is a prominent research area that provides a concise
representation of human motion. However, real-world scenarios pose challenges to the …

Deep learning-enabled multitask system for exercise recognition and counting

Q Yu, H Wang, F Laamarti, A El Saddik - Multimodal Technologies and …, 2021 - mdpi.com
Exercise is a prevailing topic in modern society as more people are pursuing a healthy
lifestyle. Physical activities provide significant benefits to human well-being from the inside …