Voicepilot: Harnessing LLMs as speech interfaces for physically assistive robots

A Padmanabha, J Yuan, J Gupta… - Proceedings of the 37th …, 2024 - dl.acm.org
Physically assistive robots present an opportunity to significantly increase the well-being
and independence of individuals with motor impairments or other forms of disability who are …

Jailbreaking llm-controlled robots

A Robey, Z Ravichandran, V Kumar, H Hassani… - arXiv preprint arXiv …, 2024 - arxiv.org
The recent introduction of large language models (LLMs) has revolutionized the field of
robotics by enabling contextual reasoning and intuitive human-robot interaction in domains …

Remembr: Building and reasoning over long-horizon spatio-temporal memory for robot navigation

A Anwar, J Welsh, J Biswas, S Pouya… - arXiv preprint arXiv …, 2024 - arxiv.org
Navigating and understanding complex environments over extended periods of time is a
significant challenge for robots. People interacting with the robot may want to ask questions …

Spine: Online semantic planning for missions with incomplete natural language specifications in unstructured environments

Z Ravichandran, V Murali, M Tzes, GJ Pappas… - arXiv preprint arXiv …, 2024 - arxiv.org
As robots become increasingly capable, users will want to describe high-level missions and
have robots fill in the gaps. In many realistic settings, pre-built maps are difficult to obtain, so …

Industry 6.0: New generation of industry driven by generative AI and swarm of heterogeneous robots

A Lykov, MA Cabrera, M Konenkov, V Serpiva… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper presents the concept of Industry 6.0, introducing the world's first fully automated
production system that autonomously handles the entire product design and manufacturing …

[HTML][HTML] Integrating Belief-Desire-Intention agents with large language models for reliable human–robot interaction and explainable Artificial Intelligence

L Frering, G Steinbauer-Wagner, A Holzinger - Engineering Applications of …, 2025 - Elsevier
This paper presents the development of an innovative communication interface between
humans and robots, designed for human-in-the-loop interaction with a user interface through …

A Robotic AI Algorithm for Fusing Generative Large Models in Agriculture Internet of Things

G Hou, R Niu, H Chen, Y Wang, Z Zhu… - IEEE Internet of …, 2024 - ieeexplore.ieee.org
Robot perception difficulties in complex environments seriously affect robot operational
efficiency. The application of generative big model (GBM) technology on robots through the …

MissionGPT: Mission Planner for Mobile Robot based on Robotics Transformer Model

V Berman, A Bazhenov, D Tsetserukou - arXiv preprint arXiv:2411.05107, 2024 - arxiv.org
This paper presents a novel approach to building mission planners based on neural
networks with Transformer architecture and Large Language Models (LLMs). This approach …

BUMBLE: Unifying Reasoning and Acting with Vision-Language Models for Building-wide Mobile Manipulation

R Shah, A Yu, Y Zhu, Y Zhu, R Martín-Martín - arXiv preprint arXiv …, 2024 - arxiv.org
To operate at a building scale, service robots must perform very long-horizon mobile
manipulation tasks by navigating to different rooms, accessing different floors, and …

LAMARS: Large Language Model-Based Anticipation Mechanism Acceleration in Real-Time Robotic Systems

Y Gao, W Luo, X Wang, S Zhang, P Goh - IEEE Access, 2024 - ieeexplore.ieee.org
Large language models (LLMs) have assumed an increasingly crucial role in robotic
systems because of their ability to leverage the extensive knowledge they possess in robotic …