Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …
computer agents with intelligent capabilities such as understanding, reasoning, and learning …
Foundations & trends in multimodal machine learning: Principles, challenges, and open questions
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …
computer agents with intelligent capabilities such as understanding, reasoning, and learning …
Meta-world: A benchmark and evaluation for multi-task and meta reinforcement learning
Meta-reinforcement learning algorithms can enable robots to acquire new skills much more
quickly, by leveraging prior experience to learn how to learn. However, much of the current …
quickly, by leveraging prior experience to learn how to learn. However, much of the current …
Habitat: A platform for embodied ai research
We present Habitat, a platform for research in embodied artificial intelligence (AI). Habitat
enables training embodied agents (virtual robots) in highly efficient photorealistic 3D …
enables training embodied agents (virtual robots) in highly efficient photorealistic 3D …
Sapien: A simulated part-based interactive environment
Building home assistant robots has long been a goal for vision and robotics researchers. To
achieve this task, a simulated environment with physically realistic simulation, sufficient …
achieve this task, a simulated environment with physically realistic simulation, sufficient …
On evaluation of embodied navigation agents
Skillful mobile operation in three-dimensional environments is a primary topic of study in
Artificial Intelligence. The past two years have seen a surge of creative work on navigation …
Artificial Intelligence. The past two years have seen a surge of creative work on navigation …
Vision-and-language navigation: Interpreting visually-grounded navigation instructions in real environments
A robot that can carry out a natural-language instruction has been a dream since before the
Jetsons cartoon series imagined a life of leisure mediated by a fleet of attentive robot …
Jetsons cartoon series imagined a life of leisure mediated by a fleet of attentive robot …
Building cooperative embodied agents modularly with large language models
Large Language Models (LLMs) have demonstrated impressive planning abilities in single-
agent embodied tasks across various domains. However, their capacity for planning and …
agent embodied tasks across various domains. However, their capacity for planning and …
Soundspaces: Audio-visual navigation in 3d environments
Moving around in the world is naturally a multisensory experience, but today's embodied
agents are deaf—restricted to solely their visual perception of the environment. We introduce …
agents are deaf—restricted to solely their visual perception of the environment. We introduce …
Robothor: An open simulation-to-real embodied ai platform
M Deitke, W Han, A Herrasti… - Proceedings of the …, 2020 - openaccess.thecvf.com
Visual recognition ecosystems (eg ImageNet, Pascal, COCO) have undeniably played a
prevailing role in the evolution of modern computer vision. We argue that interactive and …
prevailing role in the evolution of modern computer vision. We argue that interactive and …