Semantic-enhanced digital twin system for robot–environment interaction monitoring

X Li, B He, Z Wang, Y Zhou, G Li… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
In order to implement more accurate and fine-grained monitoring of robot-environment
interaction (REI) in real time, this article extends the concept of digital twin (DT) to REI …

Teaching a robot the semantics of assembly tasks

TR Savarimuthu, AG Buch, C Schlette… - … on Systems, Man …, 2017 - ieeexplore.ieee.org
We present a three-level cognitive system in a learning by demonstration context. The
system allows for learning and transfer on the sensorimotor level as well as the planning …

Visual manipulation relationship network for autonomous robotics

H Zhang, X Lan, X Zhou, Z Tian… - 2018 IEEE-RAS 18th …, 2018 - ieeexplore.ieee.org
Robotic grasping is one of the most important fields in robotics, in which great progress has
been made in recent years with the help of convolutional neural network (CNN). However …

Graph-based visual manipulation relationship reasoning network for robotic grasping

G Zuo, J Tong, H Liu, W Chen, J Li - Frontiers in Neurorobotics, 2021 - frontiersin.org
To grasp the target object stably and orderly in the object-stacking scenes, it is important for
the robot to reason the relationships between objects and obtain intelligent manipulation …

Towards combining commonsense reasoning and knowledge acquisition to guide deep learning

M Sridharan, T Mota - Autonomous Agents and Multi-Agent Systems, 2023 - Springer
Algorithms based on deep network models are being used for many pattern recognition and
decision-making tasks in robotics and AI. Training these models requires a large labeled …

Visual manipulation relationship recognition in object-stacking scenes

H Zhang, X Lan, X Zhou, Z Tian, Y Zhang… - Pattern Recognition …, 2020 - Elsevier
Object manipulation in object-stacking scenes is a significant but challenging skill for
intelligent robots. In most cases, the relationships among objects should be considered …

Recognition and prediction of manipulation actions using enriched semantic event chains

F Ziaeetabar, T Kulvicius, M Tamosiunaite… - Robotics and …, 2018 - Elsevier
Human activity understanding has attracted much attention in recent years, because it plays
a key role in a wide range of applications such as human–computer interfaces, visual …

[PDF][PDF] Incrementally Grounding Expressions for Spatial Relations between Objects.

T Mota, M Sridharan - IJCAI, 2018 - cs.bham.ac.uk
Recognizing, reasoning about, and providing understandable descriptions of spatial
relations between objects is an important task for robots interacting with humans. This paper …

[HTML][HTML] Symbolic representation of what robots are taught in one demonstration

AM Zanchettin - Robotics and Autonomous Systems, 2023 - Elsevier
To facilitate the use of robots in small and medium-sized enterprises (SMEs), they have to be
easily and quickly deployed by non-expert users. Programming by Demonstration (PbD) is …

Semantic learning from keyframe demonstration using object attribute constraints

B Sen, J Elfring, E Torta… - Frontiers in Robotics and …, 2024 - frontiersin.org
Learning from demonstration is an approach that allows users to personalize a robot's tasks.
While demonstrations often focus on conveying the robot's motion or task plans, they can …