General in-hand object rotation with vision and touch

H Qi, B Yi, S Suresh, M Lambeta, Y Ma… - … on Robot Learning, 2023 - proceedings.mlr.press
We introduce Rotateit, a system that enables fingertip-based object rotation along multiple
axes by leveraging multimodal sensory inputs. Our system is trained in simulation, where it …

Unidexgrasp: Universal robotic dexterous grasping via learning diverse proposal generation and goal-conditioned policy

Y Xu, W Wan, J Zhang, H Liu, Z Shan… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we tackle the problem of learning universal robotic dexterous grasping from a
point cloud observation under a table-top setting. The goal is to grasp and lift up objects in …

Unidexgrasp++: Improving dexterous grasping policy learning via geometry-aware curriculum and iterative generalist-specialist learning

W Wan, H Geng, Y Liu, Z Shan… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a novel, object-agnostic method for learning a universal policy for dexterous
object grasping from realistic point cloud observations and proprioceptive information under …

Anyteleop: A general vision-based dexterous robot arm-hand teleoperation system

Y Qin, W Yang, B Huang, K Van Wyk, H Su… - arXiv preprint arXiv …, 2023 - arxiv.org
Vision-based teleoperation offers the possibility to endow robots with human-level
intelligence to physically interact with the environment, while only requiring low-cost camera …

Rotating without seeing: Towards in-hand dexterity through touch

ZH Yin, B Huang, Y Qin, Q Chen, X Wang - arXiv preprint arXiv …, 2023 - arxiv.org
Tactile information plays a critical role in human dexterity. It reveals useful contact
information that may not be inferred directly from vision. In fact, humans can even perform in …

Robot synesthesia: In-hand manipulation with visuotactile sensing

Y Yuan, H Che, Y Qin, B Huang, ZH Yin… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Executing contact-rich manipulation tasks necessitates the fusion of tactile and visual
feedback. However, the distinct nature of these modalities poses significant challenges. In …

Bunny-visionpro: Real-time bimanual dexterous teleoperation for imitation learning

R Ding, Y Qin, J Zhu, C Jia, S Yang, R Yang… - arXiv preprint arXiv …, 2024 - arxiv.org
Teleoperation is a crucial tool for collecting human demonstrations, but controlling robots
with bimanual dexterous hands remains a challenge. Existing teleoperation systems …

Graspxl: Generating grasping motions for diverse objects at scale

H Zhang, S Christen, Z Fan, O Hilliges… - European Conference on …, 2025 - Springer
Human hands possess the dexterity to interact with diverse objects such as grasping specific
parts of the objects and/or approaching them from desired directions. More importantly …

ArtiGrasp: Physically plausible synthesis of bi-manual dexterous grasping and articulation

H Zhang, S Christen, Z Fan, L Zheng… - … Conference on 3D …, 2024 - ieeexplore.ieee.org
We present ArtiGrasp, a novel method to synthesize bimanual hand-object interactions that
include grasping and articulation. This task is challenging due to the diversity of the global …

Flow as the cross-domain manipulation interface

M Xu, Z Xu, Y Xu, C Chi, G Wetzstein, M Veloso… - arXiv preprint arXiv …, 2024 - arxiv.org
We present Im2Flow2Act, a scalable learning framework that enables robots to acquire real-
world manipulation skills without the need of real-world robot training data. The key idea …