Lana: A language-capable navigator for instruction following and generation
Recently, visual-language navigation (VLN)--entailing robot agents to follow navigation
instructions--has shown great advance. However, existing literature put most emphasis on …
instructions--has shown great advance. However, existing literature put most emphasis on …
Counterfactual cycle-consistent learning for instruction following and generation in vision-language navigation
Since the rise of vision-language navigation (VLN), great progress has been made in
instruction following--building a follower to navigate environments under the guidance of …
instruction following--building a follower to navigate environments under the guidance of …
Learning to follow and generate instructions for language-capable navigation
Visual-language navigation (VLN) is a challenging task that requires embodied agents to
follow natural language instructions to navigate in previously unseen environments …
follow natural language instructions to navigate in previously unseen environments …
Multimodal estimation and communication of latent semantic knowledge for robust execution of robot instructions
The goal of this article is to enable robots to perform robust task execution following human
instructions in partially observable environments. A robot's ability to interpret and execute …
instructions in partially observable environments. A robot's ability to interpret and execute …
Hierarchical reinforcement learning for pedagogical policy induction
In interactive e-learning environments such as Intelligent Tutoring Systems, there are
pedagogical decisions to make at two main levels of granularity: whole problems and single …
pedagogical decisions to make at two main levels of granularity: whole problems and single …
Navigational instruction generation as inverse reinforcement learning with neural machine translation
Modern robotics applications that involve human-robot interaction require robots to be able
to communicate with humans seamlessly and effectively. Natural language provides a …
to communicate with humans seamlessly and effectively. Natural language provides a …
Personalized dynamics models for adaptive assistive navigation systems
Consider an assistive system that guides visually impaired users through speech and haptic
feedback to their destination. Existing robotic and ubiquitous navigation technologies (eg …
feedback to their destination. Existing robotic and ubiquitous navigation technologies (eg …
Leveraging granularity: Hierarchical reinforcement learning for pedagogical policy induction
In interactive e-learning environments such as Intelligent Tutoring Systems, pedagogical
decisions can be made at different levels of granularity. In this work, we focus on making …
decisions can be made at different levels of granularity. In this work, we focus on making …
Improving student-system interaction through data-driven explanations of hierarchical reinforcement learning induced pedagogical policies
Motivated by the recent advances of reinforcement learning and the traditional grounded
Self Determination Theory (SDT), we explored the impact of hierarchical reinforcement …
Self Determination Theory (SDT), we explored the impact of hierarchical reinforcement …
Learning to give route directions from human demonstrations
For several applications, robots and other computer systems must provide route descriptions
to humans. These descriptions should be natural and intuitive for the human users. In this …
to humans. These descriptions should be natural and intuitive for the human users. In this …