Towards Generalist Robot Learning from Internet Video: A Survey

R McCarthy, DCH Tan, D Schmidt, F Acero… - arXiv preprint arXiv …, 2024 - arxiv.org
This survey presents an overview of methods for learning from video (LfV) in the context of
reinforcement learning (RL) and robotics. We focus on methods capable of scaling to large …

Hierarchical World Models as Visual Whole-Body Humanoid Controllers

N Hansen, J SV, V Sobal, Y LeCun, X Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
Whole-body control for humanoids is challenging due to the high-dimensional nature of the
problem, coupled with the inherent instability of a bipedal morphology. Learning from visual …

Are Transformers Truly Foundational for Robotics?

JAR Marshall, AB Barron - arXiv preprint arXiv:2411.16917, 2024 - arxiv.org
Generative Pre-Trained Transformers (GPTs) are hyped to revolutionize robotics. Here we
question their utility. GPTs for autonomous robotics demand enormous and costly compute …

FIDLAR: Forecast-Informed Deep Learning Architecture for Flood Mitigation

J Shi, Z Yin, A Leon, J Obeysekera… - arXiv preprint arXiv …, 2024 - arxiv.org
In coastal river systems, frequent floods, often occurring during major storms or king tides,
pose a severe threat to lives and property. However, these floods can be mitigated or even …