Ok-robot: What really matters in integrating open-knowledge models for robotics

P Liu, Y Orru, J Vakil, C Paxton, NMM Shafiullah… - arXiv preprint arXiv …, 2024 - arxiv.org
Remarkable progress has been made in recent years in the fields of vision, language, and
robotics. We now have vision models capable of recognizing objects based on language …

Manigaussian: Dynamic gaussian splatting for multi-task robotic manipulation

G Lu, S Zhang, Z Wang, C Liu, J Lu, Y Tang - European Conference on …, 2024 - Springer
Performing language-conditioned robotic manipulation tasks in unstructured environments
is highly demanded for general intelligent robots. Conventional robotic manipulation …

Bunny-visionpro: Real-time bimanual dexterous teleoperation for imitation learning

R Ding, Y Qin, J Zhu, C Jia, S Yang, R Yang… - arXiv preprint arXiv …, 2024 - arxiv.org
Teleoperation is a crucial tool for collecting human demonstrations, but controlling robots
with bimanual dexterous hands remains a challenge. Existing teleoperation systems …

Robogen: Towards unleashing infinite data for automated robot learning via generative simulation

Y Wang, Z Xian, F Chen, TH Wang, Y Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
We present RoboGen, a generative robotic agent that automatically learns diverse robotic
skills at scale via generative simulation. RoboGen leverages the latest advancements in …

Chaineddiffuser: Unifying trajectory diffusion and keypose prediction for robotic manipulation

Z Xian, N Gkanatsios, T Gervet, TW Ke… - … Annual Conference on …, 2023 - openreview.net
We present ChainedDiffuser, a policy architecture that unifies action keypose prediction and
trajectory diffusion generation for learning robot manipulation from demonstrations. Our …

Gr-2: A generative video-language-action model with web-scale knowledge for robot manipulation

CL Cheang, G Chen, Y Jing, T Kong, H Li, Y Li… - arXiv preprint arXiv …, 2024 - arxiv.org
We present GR-2, a state-of-the-art generalist robot agent for versatile and generalizable
robot manipulation. GR-2 is first pre-trained on a vast number of Internet videos to capture …

Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation

X Ma, S Patidar, I Haughton… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract This paper introduces Hierarchical Diffusion Policy (HDP) a hierarchical agent for
multi-task robotic manipulation. HDP factorises a manipulation policy into a hierarchical …

DFields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Robotic Manipulation

Y Wang, M Zhang, Z Li… - ICRA 2024 Workshop …, 2023 - openreview.net
Scene representation has been a crucial design choice in robotic manipulation systems. An
ideal representation should be 3D, dynamic, and semantic to meet the demands of diverse …

Gen2sim: Scaling up robot learning in simulation with generative models

P Katara, Z Xian, K Fragkiadaki - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
Generalist robot manipulators need to learn a wide variety of manipulation skills across
diverse environments. Current robot training pipelines rely on humans to provide kinesthetic …

SUGAR: Pre-training 3D Visual Representations for Robotics

S Chen, R Garcia, I Laptev… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Learning generalizable visual representations from Internet data has yielded promising
results for robotics. Yet prevailing approaches focus on pre-training 2D representations …