A Survey of Algorithmic Methods for Competency Self-Assessments in Human-Autonomy Teaming

N Conlon, NR Ahmed, D Szafir - ACM Computing Surveys, 2024 - dl.acm.org
Humans working with autonomous artificially intelligent systems may not be experts in the
inner workings of their machine teammates, but need to understand when to employ, trust …

Robot proficiency self-assessment using assumption-alignment tracking

X Cao, A Gautam, T Whiting, S Smith… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
While the design of autonomous robots often emphasizes developing proficient robots,
another important attribute of autonomous robot systems is their ability to evaluate their own …

Metrics for robot proficiency self-assessment and communication of proficiency in human-robot teams

A Norton, H Admoni, J Crandall, T Fitzgerald… - ACM Transactions on …, 2022 - dl.acm.org
As development of robots with the ability to self-assess their proficiency for accomplishing
tasks continues to grow, metrics are needed to evaluate the characteristics and performance …

Self-assessment of proficiency of intelligent systems: Challenges and opportunities

A Gautam, JW Crandall, MA Goodrich - … Systems, July 16-20, 2020, USA, 2021 - Springer
Autonomous systems, although capable of performing complicated tasks much faster than
humans, are brittle due to uncertainties encountered in most real-time applications. People …

Learning Self-Confidence from Semantic Action Embeddings for Improved Trust in Human-Robot Interaction

C Goubard, Y Demiris - 2024 IEEE International Conference on …, 2024 - ieeexplore.ieee.org
In Human-Robot Interaction (HRI) scenarios, human factors like trust can greatly impact task
performance and interaction quality. Recent research has confirmed that perceived robot …

“I'm Confident This Will End Poorly”: Robot Proficiency Self-Assessment in Human-Robot Teaming

N Conlon, D Szafir, N Ahmed - 2022 IEEE/RSJ International …, 2022 - ieeexplore.ieee.org
Human-robot teams are expected to accomplish complex tasks in high-risk and uncertain
environments. In domains such as space exploration or search & rescue, a human operator …

Generalizing competency self-assessment for autonomous vehicles using deep reinforcement learning

N Conlon, A Acharya, J McGinley, T Slack… - AIAA SCITECH 2022 …, 2022 - arc.aiaa.org
View Video Presentation: https://doi. org/10.2514/6.2022-2496. vid Due to the increased role
of autonomous robots in accomplishing a variety of challenging tasks alongside humans, it …

Proficiency self-assessment without breaking the robot: Anomaly detection using assumption-alignment tracking from safe experiments

X Cao, JW Crandall, E Pedersen… - … on Robotics and …, 2023 - ieeexplore.ieee.org
Proficiency self-assessment (PSA), the ability to assess how well one can carry out a task, is
a desirable capability of autonomous robot systems. Prior work has proposed assumption …

[HTML][HTML] Event-triggered robot self-assessment to aid in autonomy adjustment

N Conlon, N Ahmed, D Szafir - Frontiers in Robotics and AI, 2024 - frontiersin.org
Introduction: Human–robot teams are being called upon to accomplish increasingly complex
tasks. During execution, the robot may operate at different levels of autonomy (LOAs) …

Dynamic Competency Self-Assessment for Autonomous Agents

N Conlon, NR Ahmed, D Szafir - arXiv preprint arXiv:2303.01646, 2023 - arxiv.org
As autonomous robots are deployed in increasingly complex environments, platform
degradation, environmental uncertainties, and deviations from validated operation …