Generative ai for unmanned vehicle swarms: Challenges, applications and opportunities

G Liu, N Van Huynh, H Du, DT Hoang, D Niyato… - arXiv preprint arXiv …, 2024 - arxiv.org
With recent advances in artificial intelligence (AI) and robotics, unmanned vehicle swarms
have received great attention from both academia and industry due to their potential to …

Robogen: Towards unleashing infinite data for automated robot learning via generative simulation

Y Wang, Z Xian, F Chen, TH Wang, Y Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
We present RoboGen, a generative robotic agent that automatically learns diverse robotic
skills at scale via generative simulation. RoboGen leverages the latest advancements in …

An interactive agent foundation model

Z Durante, B Sarkar, R Gong, R Taori, Y Noda… - arXiv preprint arXiv …, 2024 - arxiv.org
The development of artificial intelligence systems is transitioning from creating static, task-
specific models to dynamic, agent-based systems capable of performing well in a wide …

[PDF][PDF] A Comprehensive Survey of Image and Video Generative AI: Recent Advances, Variants, and Applications

S Yazdani, N Saxena, Z Wang, Y Wu, W Zhang - 2024 - researchgate.net
In recent years, the field of deep learning has experienced a surge in the popularity of
generative models, largely propelled by the transformative influence of Generative …

Position Paper: Agent AI Towards a Holistic Intelligence

Q Huang, N Wake, B Sarkar, Z Durante, R Gong… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent advancements in large foundation models have remarkably enhanced our
understanding of sensory information in open-world environments. In leveraging the power …

Reinforcement Learning via Auxiliary Task Distillation

AN Harish, L Heck, JP Hanna, Z Kira, A Szot - arXiv preprint arXiv …, 2024 - arxiv.org
We present Reinforcement Learning via Auxiliary Task Distillation (AuxDistill), a new method
that enables reinforcement learning (RL) to perform long-horizon robot control problems by …

GPT-Fabric: Folding and Smoothing Fabric by Leveraging Pre-Trained Foundation Models

V Raval, E Zhao, H Zhang, S Nikolaidis… - arXiv preprint arXiv …, 2024 - arxiv.org
Fabric manipulation has applications in folding blankets, handling patient clothing, and
protecting items with covers. It is challenging for robots to perform fabric manipulation since …

DiffGen: Robot Demonstration Generation via Differentiable Physics Simulation, Differentiable Rendering, and Vision-Language Model

Y Jin, J Lv, S Jiang, C Lu - arXiv preprint arXiv:2405.07309, 2024 - arxiv.org
Generating robot demonstrations through simulation is widely recognized as an effective
way to scale up robot data. Previous work often trained reinforcement learning agents to …

Advancing Behavior Generation in Mobile Robotics through High-Fidelity Procedural Simulations

VA Kich, JA Bottega, R Steinmetz, RB Grando… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper introduces YamaS, a simulator integrating Unity3D Engine with Robotic
Operating System for robot navigation research and aims to facilitate the development of …