Foundation Models Defining a New Era in Vision: a Survey and Outlook

M Awais, M Naseer, S Khan, RM Anwer… - … on Pattern Analysis …, 2025 - ieeexplore.ieee.org
Vision systems that see and reason about the compositional nature of visual scenes are
fundamental to understanding our world. The complex relations between objects and their …

Kinematic-aware prompting for generalizable articulated object manipulation with llms

W Xia, D Wang, X Pang, Z Wang… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Generalizable articulated object manipulation is essential for home-assistant robots. Recent
efforts focus on imitation learning from demonstrations or reinforcement learning in …

SculptDiff: Learning Robotic Clay Sculpting from Humans with Goal Conditioned Diffusion Policy

A Bartsch, A Car, C Avra, AB Farimani - arXiv preprint arXiv:2403.10401, 2024 - arxiv.org
Manipulating deformable objects remains a challenge within robotics due to the difficulties of
state estimation, long-horizon planning, and predicting how the object will deform given an …

Birp: Learning robot generalized bimanual coordination using relative parameterization method on human demonstration

J Liu, H Sim, C Li, KC Tan… - 2023 62nd IEEE …, 2023 - ieeexplore.ieee.org
Human bimanual manipulation can perform more complex tasks than a simple combination
of two single arms, which is credited to the spatio-temporal coordination between the arms …

Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstration

J Liu, Z Li, M Yu, Z Dong, S Calinon, D Caldwell… - arXiv preprint arXiv …, 2024 - arxiv.org
Humanoid robots are envisioned as embodied intelligent agents capable of performing a
wide range of human-level loco-manipulation tasks, particularly in scenarios requiring …

Learning Goal-oriented Bimanual Dough Rolling Using Dynamic Heterogeneous Graph Based on Human Demonstration

J Liu, C Li, S Wang, Z Dong, S Calinon, M Li… - arXiv preprint arXiv …, 2024 - arxiv.org
Soft object manipulation poses significant challenges for robots, requiring effective
techniques for state representation and manipulation policy learning. State representation …

Enhancing the LLM-Based Robot Manipulation Through Human-Robot Collaboration

H Liu, Y Zhu, K Kato, A Tsukahara, I Kondo… - arXiv preprint arXiv …, 2024 - arxiv.org
Large Language Models (LLMs) are gaining popularity in the field of robotics. However, LLM-
based robots are limited to simple, repetitive motions due to the poor integration between …

A Deep Learning-based Grasp Pose Estimation Approach for Large-Size Deformable Objects in Clutter

M Yu, Z Li, Z Li, J Liu, T Teng… - 2024 33rd IEEE …, 2024 - ieeexplore.ieee.org
Deformable objects especially large-size de-formable objects grasping is unappreciated but
widespread in industrial applications (eg, clothes recycling). While it encounters several …

[PDF][PDF] Improving LLM-based Robot Control via Human-Robot Cooperation

SR SM, V Kumar, M Srinivas, S Bhat - 2024 - researchgate.net
In the field of robotics, large language models, or LLMs, are becoming more and more
common. However, because of the inadequate connection between LLM and motion, LLM …

Autonomous Clay Sculpting from Human Demonstrations with Point Cloud Goal Conditioned Diffusion Policy

A Bartsch, A Car, C Avra, AB Farimani - ICRA 2024 Workshop on 3D … - openreview.net
3D deformable object manipulation remains a challenge due to the difficulties of state
estimation, long-horizon planning, and predicting how the object will deform given an …