Redefining Counterfactual Explanations for Reinforcement Learning: Overview, Challenges and Opportunities

J Gajcin, I Dusparic - ACM Computing Surveys, 2024 - dl.acm.org
While AI algorithms have shown remarkable success in various fields, their lack of
transparency hinders their application to real-life tasks. Although explanations targeted at …

Safe: Saliency-aware counterfactual explanations for dnn-based automated driving systems

A Samadi, A Shirian, K Koufos… - 2023 IEEE 26th …, 2023 - ieeexplore.ieee.org
The explainability of Deep Neural Networks (DNNs) has recently gained significant
importance especially in safety-critical applications such as automated/autonomous …

Raccer: Towards reachable and certain counterfactual explanations for reinforcement learning

J Gajcin, I Dusparic - arXiv preprint arXiv:2303.04475, 2023 - arxiv.org
While reinforcement learning (RL) algorithms have been successfully applied to numerous
tasks, their reliance on neural networks makes their behavior difficult to understand and …

Counterfactual explainer framework for deep reinforcement learning models using policy distillation

A Samadi, K Koufos, K Debattista, M Dianati - arXiv preprint arXiv …, 2023 - arxiv.org
Deep Reinforcement Learning (DRL) has demonstrated promising capability in solving
complex control problems. However, DRL applications in safety-critical systems are …

Explainable deep reinforcement learning for space situational awareness: Counterfactual explanation approach

Z Fan, G Chen, KC Chang, S Khan… - 2024 IEEE Aerospace …, 2024 - ieeexplore.ieee.org
To effectively track resident space objects (RSOs), the tasking of sensors in a distributed
network requires flexible and adaptive approaches. While Deep Reinforcement Learning …

SAFE-RL: Saliency-Aware Counterfactual Explainer for Deep Reinforcement Learning Policies

A Samadi, K Koufos, K Debattista… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
While Deep Reinforcement Learning (DRL) has emerged as a promising solution for
intricate control tasks, the lack of explainability of the learned policies impedes its uptake in …

Explainable Interface for Human-Autonomy Teaming: A Survey

X Kong, Y Xing, A Tsourdos, Z Wang, W Guo… - arXiv preprint arXiv …, 2024 - arxiv.org
Nowadays, large-scale foundation models are being increasingly integrated into numerous
safety-critical applications, including human-autonomy teaming (HAT) within transportation …

Relevant Irrelevance: Generating Alterfactual Explanations for Image Classifiers

S Mertes, T Huber, C Karle, K Weitz… - arXiv preprint arXiv …, 2024 - arxiv.org
In this paper, we demonstrate the feasibility of alterfactual explanations for black box image
classifiers. Traditional explanation mechanisms from the field of Counterfactual Thinking are …

Predicate-based explanation of a Reinforcement Learning agent via action importance evaluation

L Saulières, M Cooper, FD de Saint-Cyr - 4th workshop on Advances in …, 2023 - hal.science
For the purpose of understanding the impact of a Reinforcement Learning (RL) agent's
decisions on the satisfaction of a given arbitrary predicate, we present a method based on …

ACTER: Diverse and Actionable Counterfactual Sequences for Explaining and Diagnosing RL Policies

J Gajcin, I Dusparic - arXiv preprint arXiv:2402.06503, 2024 - arxiv.org
Understanding how failure occurs and how it can be prevented in reinforcement learning
(RL) is necessary to enable debugging, maintain user trust, and develop personalized …