General in-hand object rotation with vision and touch

H Qi, B Yi, S Suresh, M Lambeta, Y Ma… - … on Robot Learning, 2023 - proceedings.mlr.press
We introduce Rotateit, a system that enables fingertip-based object rotation along multiple
axes by leveraging multimodal sensory inputs. Our system is trained in simulation, where it …

Sequential dexterity: Chaining dexterous policies for long-horizon manipulation

Y Chen, C Wang, L Fei-Fei, CK Liu - arXiv preprint arXiv:2309.00987, 2023 - arxiv.org
Many real-world manipulation tasks consist of a series of subtasks that are significantly
different from one another. Such long-horizon, complex tasks highlight the potential of …

The future lies in a pair of tactile hands

NF Lepora - Science Robotics, 2024 - science.org
The future lies in a pair of tactile hands | Science Robotics news careers commentary Journals
Science Science brought to you byGoogle Indexer Log in journal-menu-img science …

Dexcap: Scalable and portable mocap data collection system for dexterous manipulation

C Wang, H Shi, W Wang, R Zhang, L Fei-Fei… - arXiv preprint arXiv …, 2024 - arxiv.org
Imitation learning from human hand motion data presents a promising avenue for imbuing
robots with human-like dexterity in real-world manipulation tasks. Despite this potential …

Survey of Learning Approaches for Robotic In-Hand Manipulation

AI Weinberg, A Shirizly, O Azulay, A Sintov - arXiv preprint arXiv …, 2024 - arxiv.org
Human dexterity is an invaluable capability for precise manipulation of objects in complex
tasks. The capability of robots to similarly grasp and perform in-hand manipulation of objects …

On the utility of koopman operator theory in learning dexterous manipulation skills

Y Han, M Xie, Y Zhao… - Conference on Robot …, 2023 - proceedings.mlr.press
Despite impressive dexterous manipulation capabilities enabled by learning-based
approaches, we are yet to witness widespread adoption beyond well-resourced …

Twisting lids off with two hands

T Lin, ZH Yin, H Qi, P Abbeel, J Malik - arXiv preprint arXiv:2403.02338, 2024 - arxiv.org
Manipulating objects with two multi-fingered hands has been a long-standing challenge in
robotics, attributed to the contact-rich nature of many manipulation tasks and the complexity …

Estimator-coupled reinforcement learning for robust purely tactile in-hand manipulation

L Röstel, J Pitz, L Sievers… - 2023 IEEE-RAS 22nd …, 2023 - ieeexplore.ieee.org
This paper identifies and addresses the problems with naively combining (reinforcement)
learning-based controllers and state estimators for robotic in-hand manipulation …

TEXterity--Tactile Extrinsic deXterity: Simultaneous Tactile Estimation and Control for Extrinsic Dexterity

S Kim, A Bronars, P Patre, A Rodriguez - arXiv preprint arXiv:2403.00049, 2024 - arxiv.org
We introduce a novel approach that combines tactile estimation and control for in-hand
object manipulation. By integrating measurements from robot kinematics and an image …

Lessons from Learning to Spin" Pens"

J Wang, Y Yuan, H Che, H Qi, Y Ma, J Malik… - arXiv preprint arXiv …, 2024 - arxiv.org
In-hand manipulation of pen-like objects is an important skill in our daily lives, as many tools
such as hammers and screwdrivers are similarly shaped. However, current learning-based …