Never stop learning: The effectiveness of fine-tuning in robotic reinforcement learning

R Julian, B Swanson, GS Sukhatme, S Levine… - arXiv preprint arXiv …, 2020 - arxiv.org
… In this paper, we present a method and empirical evidence towards a robot learningrobotic
manipulation policies to new variations by fine-tuning via off-policy reinforcement learning, …

MOTO: Offline pre-training to online fine-tuning for model-based robot learning

R Rafailov, KB Hatch, V Kolev… - … on Robot Learning, 2023 - proceedings.mlr.press
fine-tuning for reinforcement learning from high-dimensional observations in the context of
realistic robot … Recent offline model-free approaches successfully use online fine-tuning to …

Robonet: Large-scale multi-robot learning

S Dasari, F Ebert, S Tian, S Nair, B Bucher… - arXiv preprint arXiv …, 2019 - arxiv.org
robot. This leads to a frequent tension in robotic learning: how can we learn generalizable
robotic … achieves the best performance when finetuned with 300 trajectories from the test robot. …

Legged robots that keep on learning: Fine-tuning locomotion policies in the real world

L Smith, JC Kew, XB Peng, S Ha, J Tan… - … on Robotics and …, 2022 - ieeexplore.ieee.org
… 1: We demonstrate real-world improvement through fine-tuning multiple skills to various
real-world environments. The robot learns to walk back and forth on grass (top left) and side-step …

Sim-to-real robot learning from pixels with progressive nets

AA Rusu, M Večerík, T Rothörl… - … on robot learning, 2017 - proceedings.mlr.press
… to many new tasks without destruction from fine-tuning. Second, the columns may be … , or
simply to improve learning speed when transferring to the real robot. Third, progressive nets …

On the effectiveness of fine-tuning versus meta-RL for robot manipulation

Z Mandi, P Abbeel, S James - … on Pre-training Robot Learning, 2022 - openreview.net
… -task pretraining, followed by fine-tuning on novel tasks, performs … robot learning to
shift towards 54 more challenging benchmarks, and involve multi-task pretraining with fine-tuning

Transformer adapters for robot learning

A Liang, I Singh, K Pertsch… - … -training Robot Learning, 2022 - openreview.net
finetuning. In comparison, the MLP backbone pretrained on the same data is unable to
generalize zeroshot to unseen tasks. By pretraining on even more diverse task-agnostic data, we …

Robot learning in homes: Improving generalization and reducing dataset bias

A Gupta, A Murali, DP Gandhi… - Advances in neural …, 2018 - proceedings.neurips.cc
… -LCA dataset, we compare to a common domain adaptation baseline: fine-tuning the model
learned on Lab-LCA with 5K home grasps (‘Fine-tuned’ in Table 1). We notice that this is …

Iterative residual tuning for system identification and sim-to-real robot learning

AD Allevato, E Schaertl Short, M Pryor, AL Thomaz - Autonomous Robots, 2020 - Springer
Robots are increasingly learning complex skills in simulation… iterative residual tuning (IRT),
a deep learning system … IRT learns to estimate the parameter difference between two …

Tunenet: One-shot residual tuning for system identification and sim-to-real robot task transfer

A Allevato, ES Short, M Pryor… - … on Robot Learning, 2020 - proceedings.mlr.press
… Abstract: As researchers teach robots to perform more and more … learning-based method
to directly tune the parameters of one model to match another using an iterative residual tuning