Self-recovery prompting: Promptable general purpose service robot system with foundation models and self-recovery
M Shirasaka, T Matsushima… - … on Robotics and …, 2024 - ieeexplore.ieee.org
A general-purpose service robot (GPSR), which can execute diverse tasks in various
environments, requires a system with high generalizability and adaptability to tasks and …
environments, requires a system with high generalizability and adaptability to tasks and …
R -Bench: Benchmarking the Robustness of Referring Perception Models Under Perturbations
Referring perception, which aims at grounding visual objects with multimodal referring
guidance, is essential for bridging the gap between humans, who provide instructions, and …
guidance, is essential for bridging the gap between humans, who provide instructions, and …
Towards Robotic Companions: Understanding Handler-Guide Dog Interactions for Informed Guide Dog Robot Design
Dog guides are favored by blind and low-vision (BLV) individuals for their ability to enhance
independence and confidence by reducing safety concerns and increasing navigation …
independence and confidence by reducing safety concerns and increasing navigation …
Everyday Challenges for Individuals Aging with Vision Impairment: Technology Implications
ET Remillard, LM Koon, TL Mitzner… - The …, 2024 - academic.oup.com
Abstract Background and Objectives There are growing numbers of older adults with long-
term vision impairment who are likely to experience everyday activity challenges from their …
term vision impairment who are likely to experience everyday activity challenges from their …
Is it safe to cross? Interpretable Risk Assessment with GPT-4V for Safety-Aware Street Crossing
Safely navigating street intersections is a complex challenge for blind and low-vision
individuals, as it requires a nuanced understanding of the surrounding context-a task heavily …
individuals, as it requires a nuanced understanding of the surrounding context-a task heavily …
BUMBLE: Unifying Reasoning and Acting with Vision-Language Models for Building-wide Mobile Manipulation
To operate at a building scale, service robots must perform very long-horizon mobile
manipulation tasks by navigating to different rooms, accessing different floors, and …
manipulation tasks by navigating to different rooms, accessing different floors, and …
MP2D: An Automated Topic Shift Dialogue Generation Framework Leveraging Knowledge Graphs
Despite advancements in on-topic dialogue systems, effectively managing topic shifts within
dialogues remains a persistent challenge, largely attributed to the limited availability of …
dialogues remains a persistent challenge, largely attributed to the limited availability of …
-Bench: Benchmarking the Robustness of Referring Perception Models under Perturbations
Referring perception, which aims at grounding visual objects with multimodal referring
guidance, is essential for bridging the gap between humans, who provide instructions, and …
guidance, is essential for bridging the gap between humans, who provide instructions, and …
Guide-LLM: An Embodied LLM Agent and Text-Based Topological Map for Robotic Guidance of People with Visual Impairments
S Song, S Kodagoda, A Gunatilake… - arXiv preprint arXiv …, 2024 - arxiv.org
Navigation presents a significant challenge for persons with visual impairments (PVI). While
traditional aids such as white canes and guide dogs are invaluable, they fall short in …
traditional aids such as white canes and guide dogs are invaluable, they fall short in …
Memory-Maze: Scenario Driven Benchmark and Visual Language Navigation Model for Guiding Blind People
Visual Language Navigation (VLN) powered navigation robots have the potential to guide
blind people by understanding and executing route instructions provided by sighted …
blind people by understanding and executing route instructions provided by sighted …