Vision-based Learning for Drones: A Survey

J Xiao, R Zhang, Y Zhang, M Feroskhan - arXiv preprint arXiv:2312.05019, 2023 - arxiv.org
Drones as advanced cyber-physical systems are undergoing a transformative shift with the
advent of vision-based learning, a field that is rapidly gaining prominence due to its …

Manipulating Neural Path Planners via Slight Perturbations

Z Xiong, S Jagannathan - IEEE Robotics and Automation …, 2024 - ieeexplore.ieee.org
Data-driven neural path planners are attracting increasing interest in the robotics
community. However, their neural network components typically come as black boxes …

Large-Scale Actionless Video Pre-Training via Discrete Diffusion for Efficient Policy Learning

H He, C Bai, L Pan, W Zhang, B Zhao, X Li - arXiv preprint arXiv …, 2024 - arxiv.org
Learning a generalist embodied agent capable of completing multiple tasks poses
challenges, primarily stemming from the scarcity of action-labeled robotic datasets. In …

SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation

J Zhang, C Bai, H He, W Xia, Z Wang, B Zhao… - arXiv preprint arXiv …, 2024 - arxiv.org
Acquiring a multi-task imitation policy in 3D manipulation poses challenges in terms of
scene understanding and action prediction. Current methods employ both 3D representation …

Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goals

M Reuss, ÖE Yağmurlu, F Wenzel… - First Workshop on Vision …, 2024 - openreview.net
This work introduces the Multimodal Diffusion Transformer (MDT), a novel diffusion policy
framework, that excels at learning versatile behavior from multimodal goal specifications …

AdaDemo: Data-Efficient Demonstration Expansion for Generalist Robotic Agent

T Mu, Y Guo, J Xu, A Goyal, H Su, D Fox… - arXiv preprint arXiv …, 2024 - arxiv.org
Encouraged by the remarkable achievements of language and vision foundation models,
developing generalist robotic agents through imitation learning, using large demonstration …

TeleMoMa: A Modular and Versatile Teleoperation System for Mobile Manipulation

S Dass, W Ai, Y Jiang, S Singh, J Hu, R Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
A critical bottleneck limiting imitation learning in robotics is the lack of data. This problem is
more severe in mobile manipulation, where collecting demonstrations is harder than in …

General-purpose foundation models for increased autonomy in robot-assisted surgery

S Schmidgall, JW Kim, A Kuntz, AE Ghazi… - arXiv preprint arXiv …, 2024 - arxiv.org
The dominant paradigm for end-to-end robot learning focuses on optimizing task-specific
objectives that solve a single robotic problem such as picking up an object or reaching a …

Multi-task robot data for dual-arm fine manipulation

H Kim, Y Ohmura, Y Kuniyoshi - arXiv preprint arXiv:2401.07603, 2024 - arxiv.org
In the field of robotic manipulation, deep imitation learning is recognized as a promising
approach for acquiring manipulation skills. Additionally, learning from diverse robot datasets …

Multi-Agent Behavior Retrieval

S Kuroki, M Nishimura, T Kozuno - arXiv preprint arXiv:2312.02008, 2023 - arxiv.org
This paper aims to enable multi-agent systems to effectively utilize past memories to adapt to
novel collaborative tasks in a data-efficient fashion. We propose the Multi-Agent …