Physdiff: Physics-guided human motion diffusion model

Y Yuan, J Song, U Iqbal, A Vahdat… - Proceedings of the …, 2023 - openaccess.thecvf.com
Denoising diffusion models hold great promise for generating diverse and realistic human
motions. However, existing motion diffusion models largely disregard the laws of physics in …

Ego-exo4d: Understanding skilled human activity from first-and third-person perspectives

K Grauman, A Westbury, L Torresani… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract We present Ego-Exo4D a diverse large-scale multimodal multiview video dataset
and benchmark challenge. Ego-Exo4D centers around simultaneously-captured egocentric …

Trace and pace: Controllable pedestrian animation via guided trajectory diffusion

D Rempe, Z Luo, X Bin Peng, Y Yuan… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce a method for generating realistic pedestrian trajectories and full-body
animations that can be controlled to meet user-defined goals. We draw on recent advances …

Questsim: Human motion tracking from sparse sensors with simulated avatars

A Winkler, J Won, Y Ye - SIGGRAPH Asia 2022 Conference Papers, 2022 - dl.acm.org
Real-time tracking of human body motion is crucial for interactive and immersive
experiences in AR/VR. However, very limited sensor data about the body is available from …

Ego-body pose estimation via ego-head pose estimation

J Li, K Liu, J Wu - Proceedings of the IEEE/CVF Conference …, 2023 - openaccess.thecvf.com
Estimating 3D human motion from an egocentric video sequence plays a critical role in
human behavior understanding and has various applications in VR/AR. However, naively …

Glamr: Global occlusion-aware human mesh recovery with dynamic cameras

Y Yuan, U Iqbal, P Molchanov… - Proceedings of the …, 2022 - openaccess.thecvf.com
We present an approach for 3D global human mesh recovery from monocular videos
recorded with dynamic cameras. Our approach is robust to severe and long-term occlusions …

Learning human dynamics in autonomous driving scenarios

J Wang, Y Yuan, Z Luo, K Xie, D Lin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Simulation has emerged as an indispensable tool for scaling and accelerating the
development of self-driving systems. A critical aspect of this is simulating realistic and …

Human-aware object placement for visual environment reconstruction

H Yi, CHP Huang, D Tzionas… - Proceedings of the …, 2022 - openaccess.thecvf.com
Humans are in constant contact with the world as they move through it and interact with it.
This contact is a vital source of information for understanding 3D humans, 3D scenes, and …

Scene-aware egocentric 3d human pose estimation

J Wang, D Luvizon, W Xu, L Liu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Egocentric 3D human pose estimation with a single head-mounted fisheye camera has
recently attracted attention due to its numerous applications in virtual and augmented reality …

Gimo: Gaze-informed human motion prediction in context

Y Zheng, Y Yang, K Mo, J Li, T Yu, Y Liu, CK Liu… - … on Computer Vision, 2022 - Springer
Predicting human motion is critical for assistive robots and AR/VR applications, where the
interaction with humans needs to be safe and comfortable. Meanwhile, an accurate …