Closed loop neural-symbolic learning via integrating neural perception, grammar parsing, and symbolic reasoning

Q Li, S Huang, Y Hong, Y Chen… - … on Machine Learning, 2020 - proceedings.mlr.press
The goal of neural-symbolic computation is to integrate the connectionist and symbolist
paradigms. Prior methods learn the neural-symbolic models using reinforcement learning …

Learning hierarchical task networks with preferences from unannotated demonstrations

K Chen, NS Srikanth, D Kent… - … on Robot Learning, 2021 - proceedings.mlr.press
We address the problem of learning Hierarchical Task Networks (HTNs) from unannotated
task demonstrations, while retaining action execution preferences present in the …

Commonsense Knowledge-Driven Joint Reasoning Approach for Object Retrieval in Virtual Reality

H Jiang, D Weng, X Dongye, L Luo… - ACM Transactions on …, 2023 - dl.acm.org
National Key Laboratory of General Artificial Intelligence, Beijing Institute for General
Artificial Intelligence (BIGAI), China Retrieving out-of-reach objects is a crucial task in virtual …

Automatic parameterization of motion and force controlled robot skills

VK Origanti, T Eiband, D Lee - International Conference on Robot …, 2021 - Springer
Compliant robot tasks such as grinding require a robot to use a specific control strategy and
to consider a number of process parameters. It is demanding to program such behaviors …

Vision‐tangible interactive display method for mixed and virtual reality: Toward the human‐centered editable reality

Z Zhang, Y Li, J Guo, D Weng, Y Liu… - Journal of the Society …, 2019 - Wiley Online Library
Building a human‐centered editable world can be fully realized in a virtual environment.
Both mixed reality (MR) and virtual reality (VR) are feasible solutions to support the attribute …

Patching interpretable And‐Or‐Graph knowledge representation using augmented reality

H Liu, Y Zhu, SC Zhu - Applied AI Letters, 2021 - Wiley Online Library
We present a novel augmented reality (AR) interface to provide effective means to diagnose
a robot's erroneous behaviors, endow it with new skills, and patch its knowledge structure …

[HTML][HTML] 基于人类演示视频的机器人指令生成框架

莫秀云, 陈俊洪, 杨振国, 刘文印 - 机器人, 2022 - html.rhhz.net
为了提高机器人学习技能的能力, 免除人工示教过程, 本文基于对无特殊标记的人类演示视频的
观察, 提出了一种基于序列到序列模式的机器人指令自动生成框架. 首先, 使用Mask R-CNN …

Toward an efficient hybrid interaction paradigm for object manipulation in optical see-through mixed reality

Z Zhang, D Weng, J Guo, Y Liu… - 2019 IEEE/RSJ …, 2019 - ieeexplore.ieee.org
Human-computer interaction (HCI) plays an important role in the near-field mixed reality, in
which the hand-based interaction is one of the most widely-used interaction modes …

[图书][B] Visual commonsense reasoning: Functionality, physics, causality, and utility

Y Zhu - 2018 - search.proquest.com
Abstract Reasoning about commonsense from visual input remains an important and
challenging problem in the field of computer vision. It is important because the ability to …

[图书][B] Learning How and Why: Causal Learning and Explanation from Physical, Interactive, and Communicative Environments

MJ Edmonds - 2021 - search.proquest.com
Artificial agents expected to operate alongside humans in daily life will be expected to
handle novel circumstances and explain their behavior to humans. In this dissertation, we …