Data-driven robotic visual grasping detection for unknown objects: A problem-oriented review

H Tian, K Song, S Li, S Ma, J Xu, Y Yan - Expert Systems with Applications, 2023 - Elsevier
This paper presents a comprehensive survey of data-driven robotic visual grasping
detection (DRVGD) for unknown objects. We review both object-oriented and scene …

Calvin: A benchmark for language-conditioned policy learning for long-horizon robot manipulation tasks

O Mees, L Hermann, E Rosete-Beas… - IEEE Robotics and …, 2022 - ieeexplore.ieee.org
General-purpose robots coexisting with humans in their environment must learn to relate
human language to their perceptions and actions to be useful in a range of daily tasks …

What matters in language conditioned robotic imitation learning over unstructured data

O Mees, L Hermann, W Burgard - IEEE Robotics and …, 2022 - ieeexplore.ieee.org
A long-standing goal in robotics is to build robots that can perform a wide range of daily
tasks from perceptions obtained with their onboard sensors and specified only via natural …

Grounding language with visual affordances over unstructured data

O Mees, J Borja-Diaz, W Burgard - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
Recent works have shown that Large Language Models (LLMs) can be applied to ground
natural language to a wide variety of robot skills. However, in practice, learning multi-task …

Vlmbench: A compositional benchmark for vision-and-language manipulation

K Zheng, X Chen, OC Jenkins… - Advances in Neural …, 2022 - proceedings.neurips.cc
Benefiting from language flexibility and compositionality, humans naturally intend to use
language to command an embodied agent for complex tasks such as navigation and object …

Robotic grasping from classical to modern: A survey

H Zhang, J Tang, S Sun, X Lan - arXiv preprint arXiv:2202.03631, 2022 - arxiv.org
Robotic Grasping has always been an active topic in robotics since grasping is one of the
fundamental but most challenging skills of robots. It demands the coordination of robotic …

Semantically grounded object matching for robust robotic scene rearrangement

W Goodwin, S Vaze, I Havoutis… - … Conference on Robotics …, 2022 - ieeexplore.ieee.org
Object rearrangement has recently emerged as a key competency in robot manipulation,
with practical solutions generally involving object detection, recognition, grasping and high …

Fast high-quality tabletop rearrangement in bounded workspace

K Gao, D Lau, B Huang, KE Bekris… - … Conference on Robotics …, 2022 - ieeexplore.ieee.org
In this paper, we examine the problem of rearranging many objects on a tabletop in a
cluttered setting using overhand grasps. Efficient solutions for the problem, which capture a …

Interactive robotic grasping with attribute-guided disambiguation

Y Yang, X Lou, C Choi - 2022 International Conference on …, 2022 - ieeexplore.ieee.org
Interactive robotic grasping using natural language is one of the most fundamental tasks in
human-robot interaction. However, language can be a source of ambiguity, particularly …

Towards open-world interactive disambiguation for robotic grasping

Y Mo, H Zhang, T Kong - 2023 IEEE International Conference …, 2023 - ieeexplore.ieee.org
Language-based communications are essential in human-robot interaction, especially for
the majority of non-expert users. In this paper, we present SeeAsk, an open-world interactive …