General in-hand object rotation with vision and touch

H Qi, B Yi, S Suresh, M Lambeta, Y Ma… - … on Robot Learning, 2023 - proceedings.mlr.press
We introduce Rotateit, a system that enables fingertip-based object rotation along multiple
axes by leveraging multimodal sensory inputs. Our system is trained in simulation, where it …

In-hand object rotation via rapid motor adaptation

H Qi, A Kumar, R Calandra, Y Ma… - Conference on Robot …, 2023 - proceedings.mlr.press
Generalized in-hand manipulation has long been an unsolved challenge of robotics. As a
small step towards this grand goal, we demonstrate how to design and learn a simple …

Dextreme: Transfer of agile in-hand manipulation from simulation to reality

A Handa, A Allshire, V Makoviychuk… - … on Robotics and …, 2023 - ieeexplore.ieee.org
Recent work has demonstrated the ability of deep reinforcement learning (RL) algorithms to
learn complex robotic behaviours in simulation, including in the domain of multi-fingered …

Rotating without seeing: Towards in-hand dexterity through touch

ZH Yin, B Huang, Y Qin, Q Chen, X Wang - arXiv preprint arXiv …, 2023 - arxiv.org
Tactile information plays a critical role in human dexterity. It reveals useful contact
information that may not be inferred directly from vision. In fact, humans can even perform in …

Robot synesthesia: In-hand manipulation with visuotactile sensing

Y Yuan, H Che, Y Qin, B Huang, ZH Yin… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Executing contact-rich manipulation tasks necessitates the fusion of tactile and visual
feedback. However, the distinct nature of these modalities poses significant challenges. In …

Visual dexterity: In-hand dexterous manipulation from depth

T Chen, M Tippur, S Wu, V Kumar… - Icml workshop on …, 2023 - openreview.net
In-hand object reorientation is necessary for performing many dexterous manipulation tasks,
such as tool use in unstructured environments that remain beyond the reach of current …

Visual dexterity: In-hand reorientation of novel and complex object shapes

T Chen, M Tippur, S Wu, V Kumar, E Adelson… - Science Robotics, 2023 - science.org
In-hand object reorientation is necessary for performing many dexterous manipulation tasks,
such as tool use in less structured environments, which remain beyond the reach of current …

Intelligent soft robotic grippers for agricultural and food product handling: A brief review with a focus on design and control

Y Liu, J Hou, C Li, X Wang - Advanced Intelligent Systems, 2023 - Wiley Online Library
Advances in material sciences, control algorithms, and manufacturing techniques have
facilitated rapid progress in soft grippers, propelling their adoption in various fields. In this …

Leap hand: Low-cost, efficient, and anthropomorphic hand for robot learning

K Shaw, A Agarwal, D Pathak - arXiv preprint arXiv:2309.06440, 2023 - arxiv.org
Dexterous manipulation has been a long-standing challenge in robotics. While machine
learning techniques have shown some promise, results have largely been currently limited …

Lessons from Learning to Spin" Pens"

J Wang, Y Yuan, H Che, H Qi, Y Ma, J Malik… - arXiv preprint arXiv …, 2024 - arxiv.org
In-hand manipulation of pen-like objects is an important skill in our daily lives, as many tools
such as hammers and screwdrivers are similarly shaped. However, current learning-based …