Learning object placements for relational instructions by hallucinating scene representations

O Mees, A Emek, J Vertens… - 2020 IEEE International …, 2020 - ieeexplore.ieee.org
Robots coexisting with humans in their environment and performing services for them need
the ability to interact with them. One particular requirement for such robots is that they are …

Evaluation of word representations in grounding natural language instructions through computational human-robot interaction

O Roesler, A Aly, T Taniguchi… - 2019 14th ACM/IEEE …, 2019 - ieeexplore.ieee.org
In order to interact with people in a natural way, a robot must be able to link words to objects
and actions. Although previous studies in the literature have investigated grounding, they …

A probabilistic framework for comparing syntactic and semantic grounding of synonyms through cross-situational learning

O Roesler, A Aly, T Taniguchi, Y Hayashi - ICRA-2018 Workshop on" …, 2018 - hal.science
Natural human-robot interaction requires robots to link words to objects and actions through
grounding. Although grounding has been investigated in previous studies, none of them …

Endowing robots with longer-term autonomy by recovering from external disturbances in manipulation through grounded anomaly classification and recovery policies

S Luo, H Wu, S Duan, Y Lin, J Rojas - Journal of Intelligent & Robotic …, 2021 - Springer
Robots are poised to interact with humans in unstructured environments. Despite
increasingly robust control algorithms, failure modes arise whenever the underlying …

Automatic selection of coordinate systems for learning relative and absolute spatial concepts

R Sagara, R Taguchi, A Taniguchi… - Frontiers in Robotics and …, 2022 - frontiersin.org
Robots employed in homes and offices need to adaptively learn spatial concepts using user
utterances. To learn and represent spatial concepts, the robot must estimate the coordinate …

Grounded word learning on a pepper robot

M Hirschmanner, S Gross, B Krenn… - Proceedings of the 18th …, 2018 - dl.acm.org
In this demonstration, we will showcase realtime grounded language learning on the
humanoid robot Pepper. In particular, learning word-object and word-action mapping from …

Unsupervised online grounding for social robots

O Roesler, E Bagheri - Robotics, 2021 - mdpi.com
Robots that incorporate social norms in their behaviors are seen as more supportive,
friendly, and understanding. Since it is impossible to manually specify the most appropriate …

A probabilistic approach to unsupervised induction of combinatory categorial grammar in situated human-robot interaction

A Aly, T Taniguchi, D Mochihashi - 2018 IEEE-RAS 18th …, 2018 - ieeexplore.ieee.org
Robots are progressively moving into spaces that have been primarily shaped by human
agency; they collaborate with human users in different tasks that require them to understand …

Unsupervised Online Grounding of Natural Language during Human-Robot Interactions

O Roesler - arXiv preprint arXiv:2007.04304, 2020 - arxiv.org
Allowing humans to communicate through natural language with robots requires
connections between words and percepts. The process of creating these connections is …

Natural task learning through simultaneous language grounding and action learning

O Roesler - 2023 - centaur.reading.ac.uk
Artificial agents and in particular robots, ie agents with some form of embodiment, provide
nearly unlimited possibilities to support humans in their daily lives by reliably performing …