DRAGON: A dialogue-based robot for assistive navigation with visual language grounding

S Liu, A Hasan, K Hong, R Wang… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
Persons with visual impairments (PwVI) have difficulties understanding and navigating
spaces around them. Current wayfinding technologies either focus solely on navigation or …

ANAVI: Audio Noise Awareness using Visuals of Indoor environments for NAVIgation

V Jain, R Veerapaneni, Y Bisk - arXiv preprint arXiv:2410.18932, 2024 - arxiv.org
We propose Audio Noise Awareness using Visuals of Indoors for NAVIgation for quieter
robot path planning. While humans are naturally aware of the noise they make and its …

A Data-Efficient Visual-Audio Representation with Intuitive Fine-tuning for Voice-Controlled Robots

P Chang, S Liu, T Ji, N Chakraborty, K Hong… - arXiv preprint arXiv …, 2023 - arxiv.org
A command-following robot that serves people in everyday life must continually improve
itself in deployment domains with minimal help from its end users, instead of engineers …

Learning Rewards and Skills to Follow Commands with a Data Efficient Visual-Audio Representation

P Chang, S Liu, T Ji, N Chakraborty, DL McPherson… - 2023 - openreview.net
Based on the recent advancements in representation learning, we propose a novel
framework for command-following robots with raw sensor inputs. Previous RL-based …

[PDF][PDF] Designing and building a dialogue mechanism suitable for RoboPuppet with using deep inference learning

M Amirkhani, H Shahbazi - Amirkabir Journal of Mechanical …, 2023 - mej.aut.ac.ir
This research endeavors to construct a mechanism, blending text mining and natural
language processing, to apply a deep learning dialogue and deep reasoning approach to …

[PDF][PDF] Structured Interaction Models for Robot Learning in Human Spaces

S Liu - shuijing725.github.io
Robots are becoming increasingly capable of performing tasks in isolation. However, how to
operate them in human environments remains an open challenge. Subtle and highly …