Grasp multiple objects with one hand

Y Li, B Liu, Y Geng, P Li, Y Yang, Y Zhu… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
The intricate kinematics of the human hand enable simultaneous grasping and manipulation
of multiple objects, essential for tasks, such as object transfer and in-hand manipulation …

Humanoidbench: Simulated humanoid benchmark for whole-body locomotion and manipulation

C Sferrazza, DM Huang, X Lin, Y Lee… - arXiv preprint arXiv …, 2024 - arxiv.org
Humanoid robots hold great promise in assisting humans in diverse environments and
tasks, due to their flexibility and adaptability leveraging human-like morphology. However …

Virtual Instrument Performances (VIP): A Comprehensive Review

T Kyriakou, MÁ de la Campa Crespo… - Computer Graphics …, 2024 - Wiley Online Library
Driven by recent advancements in Extended Reality (XR), the hype around the Metaverse,
and real‐time computer graphics, the transformation of the performing arts, particularly in …

Learning Visuotactile Skills with Two Multifingered Hands

T Lin, Y Zhang, Q Li, H Qi, B Yi, S Levine… - arXiv preprint arXiv …, 2024 - arxiv.org
Aiming to replicate human-like dexterity, perceptual experiences, and motion patterns, we
explore learning from human demonstrations using a bimanual system with multifingered …

Twisting lids off with two hands

T Lin, ZH Yin, H Qi, P Abbeel, J Malik - arXiv preprint arXiv:2403.02338, 2024 - arxiv.org
Manipulating objects with two multi-fingered hands has been a long-standing challenge in
robotics, attributed to the contact-rich nature of many manipulation tasks and the complexity …

ViViDex: Learning Vision-based Dexterous Manipulation from Human Videos

Z Chen, S Chen, C Schmid, I Laptev - arXiv preprint arXiv:2404.15709, 2024 - arxiv.org
In this work, we aim to learn a unified vision-based policy for a multi-fingered robot hand to
manipulate different objects in diverse poses. Though prior work has demonstrated that …

Privileged Sensing Scaffolds Reinforcement Learning

ES Hu, J Springer, O Rybkin, D Jayaraman - arXiv preprint arXiv …, 2024 - arxiv.org
We need to look at our shoelaces as we first learn to tie them but having mastered this skill,
can do it from touch alone. We call this phenomenon" sensory scaffolding": observation …

Learning Playing Piano with Bionic-Constrained Diffusion Policy for Anthropomorphic Hand

Y Yang, Z Wang, D Xing, P Wang - Cyborg and Bionic Systems, 2024 - spj.science.org
Anthropomorphic hand manipulation is a quintessential example of embodied intelligence in
robotics, presenting a notable challenge due to its high degrees of freedom and complex …

BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmark

N Chernyadev, N Backshall, X Ma, Y Lu, Y Seo… - arXiv preprint arXiv …, 2024 - arxiv.org
We introduce BiGym, a new benchmark and learning environment for mobile bi-manual
demo-driven robotic manipulation. BiGym features 40 diverse tasks set in home …

SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation

J Zhang, C Bai, H He, W Xia, Z Wang, B Zhao… - arXiv preprint arXiv …, 2024 - arxiv.org
Acquiring a multi-task imitation policy in 3D manipulation poses challenges in terms of
scene understanding and action prediction. Current methods employ both 3D representation …