Ai alignment: A comprehensive survey

J Ji, T Qiu, B Chen, B Zhang, H Lou, K Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
AI alignment aims to make AI systems behave in line with human intentions and values. As
AI systems grow more capable, the potential large-scale risks associated with misaligned AI …

Affordances from human videos as a versatile representation for robotics

S Bahl, R Mendonca, L Chen… - Proceedings of the …, 2023 - openaccess.thecvf.com
Building a robot that can understand and learn to interact by watching humans has inspired
several vision problems. However, despite some successful results on static datasets, it …

Foundation models for decision making: Problems, methods, and opportunities

S Yang, O Nachum, Y Du, J Wei, P Abbeel… - arXiv preprint arXiv …, 2023 - arxiv.org
Foundation models pretrained on diverse data at scale have demonstrated extraordinary
capabilities in a wide range of vision and language tasks. When such models are deployed …

Mimicplay: Long-horizon imitation learning by watching human play

C Wang, L Fan, J Sun, R Zhang, L Fei-Fei, D Xu… - arXiv preprint arXiv …, 2023 - arxiv.org
Imitation learning from human demonstrations is a promising paradigm for teaching robots
manipulation skills in the real world. However, learning complex long-horizon tasks often …

Structured world models from human videos

R Mendonca, S Bahl, D Pathak - arXiv preprint arXiv:2308.10901, 2023 - arxiv.org
We tackle the problem of learning complex, general behaviors directly in the real world. We
propose an approach for robots to efficiently learn manipulation skills using only a handful of …

Roboagent: Generalization and efficiency in robot manipulation via semantic augmentations and action chunking

H Bharadhwaj, J Vakil, M Sharma, A Gupta… - arXiv preprint arXiv …, 2023 - arxiv.org
The grand aim of having a single robot that can manipulate arbitrary objects in diverse
settings is at odds with the paucity of robotics datasets. Acquiring and growing such datasets …

Diff-lfd: Contact-aware model-based learning from visual demonstration for robotic manipulation via differentiable physics-based simulation and rendering

X Zhu, JH Ke, Z Xu, Z Sun, B Bai, J Lv… - … on Robot Learning, 2023 - proceedings.mlr.press
Abstract Learning from Demonstration (LfD) is an efficient technique for robots to acquire
new skills through expert observation, significantly mitigating the need for laborious manual …

Towards a richer 2D understanding of hands at scale

T Cheng, D Shan, A Hassen… - Advances in Neural …, 2023 - proceedings.neurips.cc
As humans, we learn a lot about how to interact with the world by observing others
interacting with their hands. To help AI systems obtain a better understanding of hand …

H-InDex: Visual reinforcement learning with hand-informed representations for dexterous manipulation

Y Ze, Y Liu, R Shi, J Qin, Z Yuan… - Advances in Neural …, 2024 - proceedings.neurips.cc
Human hands possess remarkable dexterity and have long served as a source of inspiration
for robotic manipulation. In this work, we propose a human $\textbf {H} $ and-$\textbf {In} …

An outlook into the future of egocentric vision

C Plizzari, G Goletto, A Furnari, S Bansal… - International Journal of …, 2024 - Springer
What will the future be? We wonder! In this survey, we explore the gap between current
research in egocentric vision and the ever-anticipated future, where wearable computing …