Aligning cyber space with physical world: A comprehensive survey on embodied ai

Y Liu, W Chen, Y Bai, X Liang, G Li, W Gao… - arXiv preprint arXiv …, 2024 - arxiv.org
Embodied Artificial Intelligence (Embodied AI) is crucial for achieving Artificial General
Intelligence (AGI) and serves as a foundation for various applications that bridge cyberspace …

Toward general-purpose robots via foundation models: A survey and meta-analysis

Y Hu, Q Xie, V Jain, J Francis, J Patrikar… - arXiv preprint arXiv …, 2023 - arxiv.org
Building general-purpose robots that operate seamlessly in any environment, with any
object, and utilizing various skills to complete diverse tasks has been a long-standing goal in …

Transfer learning in robotics: An upcoming breakthrough? A review of promises and challenges

N Jaquier, MC Welle, A Gams, K Yao… - … Journal of Robotics …, 2023 - journals.sagepub.com
Transfer learning is a conceptually-enticing paradigm in pursuit of truly intelligent embodied
agents. The core concept—reusing prior knowledge to learn in and from novel situations—is …

Bridging the Literacy Gap: A Multisensory Approach to Effective Intervention

P Vestal, OK Kilag, GG Alvez, D Escabas… - … disciplinary Journal of …, 2023 - multijournals.org
This systematic literature review and meta-analysis illuminate the transformative potential of
multisensory literacy instruction within the domain of literacy education. Drawing from a …

Core challenges in embodied vision-language planning

J Francis, N Kitamura, F Labelle, X Lu, I Navarro… - Journal of Artificial …, 2022 - jair.org
Recent advances in the areas of multimodal machine learning and artificial intelligence (AI)
have led to the development of challenging tasks at the intersection of Computer Vision …

Mosaic: Learning unified multi-sensory object property representations for robot learning via interactive perception

G Tatiya, J Francis, HH Wu, Y Bisk… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
A holistic understanding of object properties across diverse sensory modalities (eg, visual,
audio, and haptic) is essential for tasks ranging from object categorization to complex …

Multimodal embodied attribute learning by robots for object-centric action policies

X Zhang, S Amiri, J Sinapov, J Thomason, P Stone… - Autonomous …, 2023 - Springer
Robots frequently need to perceive object attributes, such as red, heavy, and empty, using
multimodal exploratory behaviors, such as look, lift, and shake. One possible way for robots …

Privileged Sensing Scaffolds Reinforcement Learning

ES Hu, J Springer, O Rybkin, D Jayaraman - arXiv preprint arXiv …, 2024 - arxiv.org
We need to look at our shoelaces as we first learn to tie them but having mastered this skill,
can do it from touch alone. We call this phenomenon" sensory scaffolding": observation …

Cross-tool and cross-behavior perceptual knowledge transfer for grounded object recognition

G Tatiya, J Francis, J Sinapov - arXiv preprint arXiv:2303.04023, 2023 - arxiv.org
Humans learn about objects via interaction and using multiple perceptions, such as vision,
sound, and touch. While vision can provide information about an object's appearance, non …

Visuo-Tactile based Predictive Cross Modal Perception for Object Exploration in Robotics

A Dutta, E Burdet, M Kaboli - arXiv preprint arXiv:2405.12634, 2024 - arxiv.org
Autonomously exploring the unknown physical properties of novel objects such as stiffness,
mass, center of mass, friction coefficient, and shape is crucial for autonomous robotic …