Foundation models in robotics: Applications, challenges, and the future

R Firoozi, J Tucker, S Tian, A Majumdar, J Sun… - arXiv preprint arXiv …, 2023 - arxiv.org
We survey applications of pretrained foundation models in robotics. Traditional deep
learning models in robotics are trained on small datasets tailored for specific tasks, which …

Conformal decision theory: Safe autonomous decisions from imperfect predictions

J Lekeufack, AN Angelopoulos, A Bajcsy… - … on Robotics and …, 2024 - ieeexplore.ieee.org
We introduce Conformal Decision Theory, a framework for producing safe autonomous
decisions despite imperfect machine learning predictions. Examples of such decisions are …

Toward general-purpose robots via foundation models: A survey and meta-analysis

Y Hu, Q Xie, V Jain, J Francis, J Patrikar… - arXiv preprint arXiv …, 2023 - arxiv.org
Building general-purpose robots that can operate seamlessly, in any environment, with any
object, and utilizing various skills to complete diverse tasks has been a long-standing goal in …

Active uncertainty reduction for safe and efficient interaction planning: A shielding-aware dual control approach

H Hu, D Isele, S Bae, JF Fisac - The International Journal of …, 2023 - journals.sagepub.com
The ability to accurately predict others' behavior is central to the safety and efficiency of
robotic systems in interactive settings, such as human–robot interaction and multi-robot …

Learning-aware safety for interactive autonomy

H Hu, Z Zhang, K Nakamura, A Bajcsy… - arXiv preprint arXiv …, 2023 - arxiv.org
One of the outstanding challenges for the widespread deployment of robotic systems like
autonomous vehicles is ensuring safe interaction with humans without sacrificing efficiency …

A learning-based framework for safe human-robot collaboration with multiple backup control barrier functions

NC Janwani, E Daş, T Touma, SX Wei… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Ensuring robot safety in complex environments is a difficult task due to actuation limits, such
as torque bounds. This paper presents a safety-critical control framework that leverages …

Hamilton-Jacobi Reachability in Reinforcement Learning: A Survey

M Ganai, S Gao, S Herbert - IEEE Open Journal of Control …, 2024 - ieeexplore.ieee.org
Recent literature has proposed approaches that learn control policies with high performance
while maintaining safety guarantees. Synthesizing Hamilton-Jacobi (HJ) reachable sets has …

Model-Based Runtime Monitoring with Interactive Imitation Learning

H Liu, S Dass, R Martín-Martín… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
Robot learning methods have recently made great strides, but generalization and
robustness challenges still hinder their widespread deployment. Failing to detect and …

Deception game: Closing the safety-learning loop in interactive robot autonomy

H Hu, Z Zhang, K Nakamura, A Bajcsy… - 7th Annual Conference …, 2023 - openreview.net
An outstanding challenge for the widespread deployment of robotic systems like
autonomous vehicles is ensuring safe interaction with humans without sacrificing …

Learning-based legged locomotion; state of the art and future perspectives

S Ha, J Lee, M van de Panne, Z Xie, W Yu… - arXiv preprint arXiv …, 2024 - arxiv.org
Legged locomotion holds the premise of universal mobility, a critical capability for many real-
world robotic applications. Both model-based and learning-based approaches have …