Reflect: Summarizing robot experiences for failure explanation and correction

Z Liu, A Bahety, S Song - arXiv preprint arXiv:2306.15724, 2023 - arxiv.org
The ability to detect and analyze failed executions automatically is crucial for an explainable
and robust robotic system. Recently, Large Language Models (LLMs) have demonstrated …

[HTML][HTML] A causal-based approach to explain, predict and prevent failures in robotic tasks

M Diehl, K Ramirez-Amaro - Robotics and Autonomous Systems, 2023 - Elsevier
Robots working in human environments need to adapt to unexpected changes to avoid
failures. This is an open and complex challenge that requires robots to timely predict and …

Reactive or proactive? how robots should explain failures

G LeMasurier, A Gautam, Z Han, JW Crandall… - Proceedings of the …, 2024 - dl.acm.org
As robots tackle increasingly complex tasks, the need for explanations becomes essential
for gaining trust and acceptance. Explainable robotic systems should not only elucidate …

Causal-Based Approaches to Explain and Learn from Self-Extension—A Review

R Marfil, P Bustos, A Bandera - Electronics, 2024 - mdpi.com
The last decades have seen a revolution in autonomous robotics. Deep learning
approaches and their hardware implementations have made it possible to endow robots …

Multimodal Coherent Explanation Generation of Robot Failures

P Pramanick, S Rossi - 2024 IEEE/RSJ International …, 2024 - ieeexplore.ieee.org
The explainability of a robot's actions is crucial to its acceptance in social spaces. Explaining
why a robot fails to complete a given task is particularly important for non-expert users to be …

CAR-DESPOT: Causally-informed online POMDP planning for robots in confounded environments

R Cannizzaro, L Kunze - 2023 IEEE/RSJ International …, 2023 - ieeexplore.ieee.org
Robots operating in real-world environments must reason about possible outcomes of
stochastic actions and make decisions based on partial observations of the true world state …

Effects of Explanation Strategies to Resolve Failures in Human-Robot Collaboration

P Khanna, E Yadollahi, M Björkman… - 2023 32nd IEEE …, 2023 - ieeexplore.ieee.org
DH Despite significant improvements in robot capabilities, they are likely to fail in human-
robot collaborative tasks due to high unpredictability in human environments and varying …

Scale: Causal learning and discovery of robot manipulation skills using simulation

TE Lee, S Vats, S Girdhar, O Kroemer - 2023 - par.nsf.gov
We propose SCALE, an approach for discovering and learning a di-verse set of interpretable
robot skills from a limited dataset. Rather than learning a single skill which may fail to …

Multimodal Detection and Classification of Robot Manipulation Failures

A Inceoglu, EE Aksoy, S Sariel - IEEE Robotics and Automation …, 2023 - ieeexplore.ieee.org
An autonomous service robot should be able to interact with its environment safely and
robustly without requiring human assistance. Unstructured environments are challenging for …

Automating Robot Failure Recovery Using Vision-Language Models With Optimized Prompts

H Chen, Y Yao, R Liu, C Liu, J Ichnowski - arXiv preprint arXiv:2409.03966, 2024 - arxiv.org
Current robot autonomy struggles to operate beyond the assumed Operational Design
Domain (ODD), the specific set of conditions and environments in which the system is …