World models and predictive coding for cognitive and developmental robotics: Frontiers and challenges

T Taniguchi, S Murata, M Suzuki, D Ognibene… - Advanced …, 2023 - Taylor & Francis
Creating autonomous robots that can actively explore the environment, acquire knowledge
and learn skills continuously is the ultimate achievement envisioned in cognitive and …

Holo-dex: Teaching dexterity with immersive mixed reality

SP Arunachalam, I Güzey, S Chintala… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
A fundamental challenge in teaching robots is to provide an effective interface for human
teachers to demonstrate useful skills to a robot. This challenge is exacerbated in dexterous …

Data augmentation for manipulation

P Mitrano, D Berenson - arXiv preprint arXiv:2205.02886, 2022 - arxiv.org
The success of deep learning depends heavily on the availability of large datasets, but in
robotic manipulation there are many learning problems for which such datasets do not exist …

Directed acyclic graph neural network for human motion prediction

Q Li, G Chalvatzaki, J Peters… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
Human motion prediction is essential in human-robot interaction. Current research mostly
considers the joint dependencies but ignores the bone dependencies and their relationship …

Graph-based task-specific prediction models for interactions between deformable and rigid objects

Z Weng, F Paus, A Varava, H Yin… - 2021 IEEE/RSJ …, 2021 - ieeexplore.ieee.org
Capturing scene dynamics and predicting the future scene state is challenging but essential
for robotic manipulation tasks, especially when the scene contains both rigid and …

Discovering predictive relational object symbols with symbolic attentive layers

A Ahmetoglu, B Celik, E Oztop… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
In this letter, we propose and realize a new deep learning architecture for discovering
symbolic representations for objects and their relations based on the self-supervised …

[HTML][HTML] Object and relation centric representations for push effect prediction

AE Tekden, A Erdem, E Erdem, T Asfour… - Robotics and Autonomous …, 2024 - Elsevier
Pushing is an essential non-prehensile manipulation skill used for tasks ranging from pre-
grasp manipulation to scene rearrangement, reasoning about object relations in the scene …

GSC: A graph-based skill composition framework for robot learning

Q Tian, S Zhang, D Wang, J Liu, S Yang - Robotics and Autonomous …, 2024 - Elsevier
Humans excel at performing a wide range of sophisticated tasks by leveraging skills
acquired from prior experiences. This characteristic is especially essential in robotics …

Learning latent object-centric representations for visual-based robot manipulation

Y Wang, J Wang, Y Li, C Hu… - … Conference on Advanced …, 2022 - ieeexplore.ieee.org
For multi-step robotic manipulation, it is important but challenging to predict the future state
of the object conditioned on the applied action, especially from the original sensory …

[PDF][PDF] Variational inference MPC using normalizing flows and out-of-distribution projection

P Mitrano, D Berenson - Robotics science and systems, 2023 - par.nsf.gov
The success of deep learning depends heavily on the availability of large datasets, but in
robotic manipulation there are many learning problems for which such datasets do not exist …