Learning Instruction-Guided Manipulation Affordance via Large Models for Embodied Robotic Tasks

D Li, C Zhao, S Yang, L Ma, Y Li… - … on Advanced Robotics …, 2024 - ieeexplore.ieee.org
We study the task of language instruction-guided robotic manipulation, in which an
embodied robot is supposed to manipulate the target objects based on the language …

DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Text

S Li, Y Deng, W Lam - arXiv preprint arXiv:2310.12557, 2023 - arxiv.org
Spatial reasoning in text plays a crucial role in various real-world applications. Existing
approaches for spatial reasoning typically infer spatial relations from pure text, which …

BBSEA: An Exploration of Brain-Body Synchronization for Embodied Agents

S Yang, Q Luo, A Pani, Y Yang - arXiv preprint arXiv:2402.08212, 2024 - arxiv.org
Embodied agents capable of complex physical skills can improve productivity, elevate life
quality, and reshape human-machine collaboration. We aim at autonomous training of …

Stimulating Imagination: Towards General-purpose Object Rearrangement

J Wu, J Gu, X Ma, C Tang, J Chen - arXiv preprint arXiv:2408.01655, 2024 - arxiv.org
General-purpose object placement is a fundamental capability of an intelligent generalist
robot, ie, being capable of rearranging objects following human instructions even in novel …