Gnfactor: Multi-task real robot learning with generalizable neural feature fields

Y Ze, G Yan, YH Wu, A Macaluso… - … on Robot Learning, 2023 - proceedings.mlr.press
It is a long-standing problem in robotics to develop agents capable of executing diverse
manipulation tasks from visual observations in unstructured real-world environments. To …

Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review

TAQ Nguyen, A Bourki, M Macudzinski… - arXiv preprint arXiv …, 2024 - arxiv.org
This review thoroughly examines the role of semantically-aware Neural Radiance Fields
(NeRFs) in visual scene understanding, covering an analysis of over 250 scholarly papers. It …

DFields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Robotic Manipulation

Y Wang, Z Li, M Zhang, K Driggs-Campbell… - arXiv preprint arXiv …, 2023 - arxiv.org
Scene representation has been a crucial design choice in robotic manipulation systems. An
ideal representation should be 3D, dynamic, and semantic to meet the demands of diverse …

Manigaussian: Dynamic gaussian splatting for multi-task robotic manipulation

G Lu, S Zhang, Z Wang, C Liu, J Lu, Y Tang - arXiv preprint arXiv …, 2024 - arxiv.org
Performing language-conditioned robotic manipulation tasks in unstructured environments
is highly demanded for general intelligent robots. Conventional robotic manipulation …

Reconstructive latent-space neural radiance fields for efficient 3d scene representations

T Aumentado-Armstrong, A Mirzaei… - arXiv preprint arXiv …, 2023 - arxiv.org
Neural Radiance Fields (NeRFs) have proven to be powerful 3D representations, capable of
high quality novel view synthesis of complex scenes. While NeRFs have been applied to …

NeRF in Robotics: A Survey

G Wang, L Pan, S Peng, S Liu, C Xu, Y Miao… - arXiv preprint arXiv …, 2024 - arxiv.org
Meticulous 3D environment representations have been a longstanding goal in computer
vision and robotics fields. The recent emergence of neural implicit representations has …

Reinforcement Learning with Generalizable Gaussian Splatting

J Wang, Q Zhang, J Sun, J Cao, Y Shao… - arXiv preprint arXiv …, 2024 - arxiv.org
An excellent representation is crucial for reinforcement learning (RL) performance,
especially in vision-based reinforcement learning tasks. The quality of the environment …

Dnact: Diffusion guided multi-task 3d policy learning

G Yan, YH Wu, X Wang - arXiv preprint arXiv:2403.04115, 2024 - arxiv.org
This paper presents DNAct, a language-conditioned multi-task policy framework that
integrates neural rendering pre-training and diffusion training to enforce multi-modality …

Robo360: A 3D Omnispective Multi-Material Robotic Manipulation Dataset

L Liang, L Bian, C Xiao, J Zhang, L Chen, I Liu… - arXiv preprint arXiv …, 2023 - arxiv.org
Building robots that can automate labor-intensive tasks has long been the core motivation
behind the advancements in computer vision and the robotics community. Recent interest in …

Never-Ending Embodied Robot Learning

W Liang, G Sun, Q He, Y Ren, J Dong… - arXiv preprint arXiv …, 2024 - arxiv.org
Relying on large language models (LLMs), embodied robots could perform complex
multimodal robot manipulation tasks from visual observations with powerful generalization …