Large language models for robotics: Opportunities, challenges, and perspectives

J Wang, Z Wu, Y Li, H Jiang, P Shu, E Shi, H Hu… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models (LLMs) have undergone significant expansion and have been
increasingly integrated across various domains. Notably, in the realm of robot task planning …

A Survey on Integration of Large Language Models with Intelligent Robots

Y Kim, D Kim, J Choi, J Park, N Oh, D Park - arXiv preprint arXiv …, 2024 - arxiv.org
In recent years, the integration of large language models (LLMs) has revolutionized the field
of robotics, enabling robots to communicate, understand, and reason with human-like …

Large language models for robotics: A survey

F Zeng, W Gan, Y Wang, N Liu, PS Yu - arXiv preprint arXiv:2311.07226, 2023 - arxiv.org
The human ability to learn, generalize, and control complex manipulation tasks through multi-
modality feedback suggests a unique capability, which we refer to as dexterity intelligence …

[HTML][HTML] Large language models for human-robot interaction: A review

C Zhang, J Chen, J Li, Y Peng, Z Mao - Biomimetic Intelligence and …, 2023 - Elsevier
The fusion of large language models and robotic systems has introduced a transformative
paradigm in human–robot interaction, offering unparalleled capabilities in natural language …

Action Contextualization: Adaptive Task Planning and Action Tuning using Large Language Models

S Gupta, K Yao, L Niederhauser, A Billard - arXiv preprint arXiv …, 2024 - arxiv.org
Large Language Models (LLMs) present a promising frontier in robotic task planning by
leveraging extensive human knowledge. Nevertheless, the current literature often overlooks …

Understanding Large-Language Model (LLM)-powered Human-Robot Interaction

CY Kim, CP Lee, B Mutlu - arXiv preprint arXiv:2401.03217, 2024 - arxiv.org
Large-language models (LLMs) hold significant promise in improving human-robot
interaction, offering advanced conversational skills and versatility in managing diverse, open …

Introspective Planning: Guiding Language-Enabled Agents to Refine Their Own Uncertainty

K Liang, Z Zhang, JF Fisac - arXiv preprint arXiv:2402.06529, 2024 - arxiv.org
Large language models (LLMs) exhibit advanced reasoning skills, enabling robots to
comprehend natural language instructions and strategically plan high-level actions through …

Chat with the environment: Interactive multimodal perception using large language models

X Zhao, M Li, C Weber, MB Hafez… - 2023 IEEE/RSJ …, 2023 - ieeexplore.ieee.org
Programming robot behavior in a complex world faces challenges on multiple levels, from
dextrous low-level skills to high-level planning and reasoning. Recent pre-trained Large …

Translating natural language to planning goals with large-language models

Y Xie, C Yu, T Zhu, J Bai, Z Gong, H Soh - arXiv preprint arXiv:2302.05128, 2023 - arxiv.org
Recent large language models (LLMs) have demonstrated remarkable performance on a
variety of natural language processing (NLP) tasks, leading to intense excitement about their …

Manipvqa: Injecting robotic affordance and physically grounded information into multi-modal large language models

S Huang, I Ponomarenko, Z Jiang, X Li, X Hu… - arXiv preprint arXiv …, 2024 - arxiv.org
The integration of Multimodal Large Language Models (MLLMs) with robotic systems has
significantly enhanced the ability of robots to interpret and act upon natural language …