Text-to-3d using gaussian splatting

Z Chen, F Wang, Y Wang, H Liu - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Automatic text-to-3D generation that combines Score Distillation Sampling (SDS) with the
optimization of volume rendering has achieved remarkable progress in synthesizing realistic …

Affordances from human videos as a versatile representation for robotics

S Bahl, R Mendonca, L Chen… - Proceedings of the …, 2023 - openaccess.thecvf.com
Building a robot that can understand and learn to interact by watching humans has inspired
several vision problems. However, despite some successful results on static datasets, it …

Anyteleop: A general vision-based dexterous robot arm-hand teleoperation system

Y Qin, W Yang, B Huang, K Van Wyk, H Su… - arXiv preprint arXiv …, 2023 - arxiv.org
Vision-based teleoperation offers the possibility to endow robots with human-level
intelligence to physically interact with the environment, while only requiring low-cost camera …

Rotating without seeing: Towards in-hand dexterity through touch

ZH Yin, B Huang, Y Qin, Q Chen, X Wang - arXiv preprint arXiv …, 2023 - arxiv.org
Tactile information plays a critical role in human dexterity. It reveals useful contact
information that may not be inferred directly from vision. In fact, humans can even perform in …

Robot synesthesia: In-hand manipulation with visuotactile sensing

Y Yuan, H Che, Y Qin, B Huang, ZH Yin… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Executing contact-rich manipulation tasks necessitates the fusion of tactile and visual
feedback. However, the distinct nature of these modalities poses significant challenges. In …

Taco: Benchmarking generalizable bimanual tool-action-object understanding

Y Liu, H Yang, X Si, L Liu, Z Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
Humans commonly work with multiple objects in daily life and can intuitively transfer
manipulation skills to novel objects by understanding object functional regularities. However …

Graspxl: Generating grasping motions for diverse objects at scale

H Zhang, S Christen, Z Fan, O Hilliges… - European Conference on …, 2024 - Springer
Human hands possess the dexterity to interact with diverse objects such as grasping specific
parts of the objects and/or approaching them from desired directions. More importantly …

Dexgraspnet: A large-scale robotic dexterous grasp dataset for general objects based on simulation

R Wang, J Zhang, J Chen, Y Xu, P Li… - … on Robotics and …, 2023 - ieeexplore.ieee.org
Robotic dexterous grasping is the first step to enable human-like dexterous object
manipulation and thus a crucial robotic technology. However, dexterous grasping is much …

ArtiGrasp: Physically plausible synthesis of bi-manual dexterous grasping and articulation

H Zhang, S Christen, Z Fan, L Zheng… - … Conference on 3D …, 2024 - ieeexplore.ieee.org
We present ArtiGrasp, a novel method to synthesize bimanual hand-object interactions that
include grasping and articulation. This task is challenging due to the diversity of the global …

Dexart: Benchmarking generalizable dexterous manipulation with articulated objects

C Bao, H Xu, Y Qin, X Wang - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
To enable general-purpose robots, we will require the robot to operate daily articulated
objects as humans do. Current robot manipulation has heavily relied on using a parallel …