Pyrobolearn: A python framework for robot learning practitioners

B Delhaisse, L Rozo… - Conference on Robot …, 2020 - proceedings.mlr.press
On the quest for building autonomous robots, several robot learning frameworks with
different functionalities have recently been developed. Yet, frameworks that combine diverse …

Kinematic-aware Prompting for Generalizable Articulated Object Manipulation with LLMs

W Xia, D Wang, X Pang, Z Wang, B Zhao… - arXiv preprint arXiv …, 2023 - arxiv.org
Generalizable articulated object manipulation is essential for home-assistant robots. Recent
efforts focus on imitation learning from demonstrations or reinforcement learning in …

Do as i can, not as i say: Grounding language in robotic affordances

M Ahn, A Brohan, N Brown, Y Chebotar… - arXiv preprint arXiv …, 2022 - arxiv.org
Large language models can encode a wealth of semantic knowledge about the world. Such
knowledge could be extremely useful to robots aiming to act upon high-level, temporally …

Lmflow: An extensible toolkit for finetuning and inference of large foundation models

S Diao, R Pan, H Dong, KS Shum, J Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Large foundation models have demonstrated a great ability to achieve general human-level
intelligence far beyond traditional approaches. As the technique keeps attracting attention …

Vima: Robot manipulation with multimodal prompts

Y Jiang, A Gupta, Z Zhang, G Wang, Y Dou, Y Chen… - 2023 - openreview.net
Prompt-based learning has emerged as a successful paradigm in natural language
processing, where a single general-purpose language model can be instructed to perform …

If llm is the wizard, then code is the wand: A survey on how code empowers large language models to serve as intelligent agents

K Yang, J Liu, J Wu, C Yang, YR Fung, S Li… - arXiv preprint arXiv …, 2024 - arxiv.org
The prominent large language models (LLMs) of today differ from past language models not
only in size, but also in the fact that they are trained on a combination of natural language …

Expel: Llm agents are experiential learners

A Zhao, D Huang, Q Xu, M Lin, YJ Liu… - Proceedings of the AAAI …, 2024 - ojs.aaai.org
The recent surge in research interest in applying large language models (LLMs) to decision-
making tasks has flourished by leveraging the extensive world knowledge embedded in …

Language-driven representation learning for robotics

S Karamcheti, S Nair, AS Chen, T Kollar, C Finn… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent work in visual representation learning for robotics demonstrates the viability of
learning from large video datasets of humans performing everyday tasks. Leveraging …

What language model to train if you have one million gpu hours?

TL Scao, T Wang, D Hesslow, L Saulnier… - arXiv preprint arXiv …, 2022 - arxiv.org
The crystallization of modeling methods around the Transformer architecture has been a
boon for practitioners. Simple, well-motivated architectural variations can transfer across …

Distilling LLMs' Decomposition Abilities into Compact Language Models

D Tarasov, K Shridhar - arXiv preprint arXiv:2402.01812, 2024 - arxiv.org
Large Language Models (LLMs) have demonstrated proficiency in their reasoning abilities,
yet their large size presents scalability challenges and limits any further customization. In …