A survey of embodied ai: From simulators to research tasks

J Duan, S Yu, HL Tan, H Zhu… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
There has been an emerging paradigm shift from the era of “internet AI” to “embodied AI,”
where AI algorithms and agents no longer learn from datasets of images, videos or text …

Google scanned objects: A high-quality dataset of 3d scanned household items

L Downs, A Francis, N Koenig, B Kinman… - … on Robotics and …, 2022 - ieeexplore.ieee.org
Interactive 3D simulations have enabled break-throughs in robotics and computer vision, but
simulating the broad diversity of environments needed for deep learning requires large …

Habitat 2.0: Training home assistants to rearrange their habitat

A Szot, A Clegg, E Undersander… - Advances in neural …, 2021 - proceedings.neurips.cc
Abstract We introduce Habitat 2.0 (H2. 0), a simulation platform for training virtual robots in
interactive 3D environments and complex physics-enabled scenarios. We make …

Kubric: A scalable dataset generator

K Greff, F Belletti, L Beyer, C Doersch… - Proceedings of the …, 2022 - openaccess.thecvf.com
Data is the driving force of machine learning, with the amount and quality of training data
often being more important for the performance of a system than architecture and training …

Behavior-1k: A benchmark for embodied ai with 1,000 everyday activities and realistic simulation

C Li, R Zhang, J Wong, C Gokmen… - … on Robot Learning, 2023 - proceedings.mlr.press
We present BEHAVIOR-1K, a comprehensive simulation benchmark for human-centered
robotics. BEHAVIOR-1K includes two components, guided and motivated by the results of an …

The role of physics-based simulators in robotics

CK Liu, D Negrut - Annual Review of Control, Robotics, and …, 2021 - annualreviews.org
Physics-based simulation provides an accelerated and safe avenue for developing,
verifying, and testing robotic control algorithms and prototype designs. In the quest to …

robosuite: A modular simulation framework and benchmark for robot learning

Y Zhu, J Wong, A Mandlekar, R Martín-Martín… - arXiv preprint arXiv …, 2020 - arxiv.org
robosuite is a simulation framework for robot learning powered by the MuJoCo physics
engine. It offers a modular design for creating robotic tasks as well as a suite of benchmark …

Sapien: A simulated part-based interactive environment

F Xiang, Y Qin, K Mo, Y Xia, H Zhu… - Proceedings of the …, 2020 - openaccess.thecvf.com
Building home assistant robots has long been a goal for vision and robotics researchers. To
achieve this task, a simulated environment with physically realistic simulation, sufficient …

Threedworld: A platform for interactive multi-modal physical simulation

C Gan, J Schwartz, S Alter, D Mrowca… - arXiv preprint arXiv …, 2020 - arxiv.org
We introduce ThreeDWorld (TDW), a platform for interactive multi-modal physical simulation.
TDW enables simulation of high-fidelity sensory data and physical interactions between …

Neural radiance flow for 4d view synthesis and video processing

Y Du, Y Zhang, HX Yu, JB Tenenbaum… - 2021 IEEE/CVF …, 2021 - computer.org
We present a method, Neural Radiance Flow (NeRFlow), to learn a 4D spatial-temporal
representation of a dynamic scene from a set of RGB images. Key to our approach is the use …