Assistive tele-op: Leveraging transformers to collect robotic task demonstrations

HM Clever, A Handa, H Mazhar, K Parker… - arXiv preprint arXiv …, 2021 - arxiv.org
Sharing autonomy between robots and human operators could facilitate data collection of
robotic task demonstrations to continuously improve learned models. Yet, the means to …

Habitat-web: Learning embodied object-search strategies from human demonstrations at scale

R Ramrakhya, E Undersander… - Proceedings of the …, 2022 - openaccess.thecvf.com
We present a large-scale study of imitating human demonstrations on tasks that require a
virtual robot to search for objects in new environments-(1) ObjectGoal Navigation (eg'find & …

Pato: Policy assisted teleoperation for scalable robot data collection

S Dass, K Pertsch, H Zhang, Y Lee, JJ Lim… - arXiv preprint arXiv …, 2022 - arxiv.org
Large-scale data is an essential component of machine learning as demonstrated in recent
advances in natural language processing and computer vision research. However …

The benefits of teaching robots using vr demonstrations

A Jackson, BD Northcutt, G Sukthankar - Companion of the 2018 ACM …, 2018 - dl.acm.org
One of the advantages of teaching robots by demonstration is that it can be more intuitive for
users to demonstrate rather than describe the desired robot behavior. However, when the …

Customized handling of unintended interface operation in assistive robots

D Gopinath, MN Javaremi… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
We present an assistance system that reasons about a human's intended actions during
robot teleoperation in order to provide appropriate modifications on unintended behavior …

Helping robots learn: a human-robot master-apprentice model using demonstrations via virtual reality teleoperation

J DelPreto, JI Lipton, L Sanneman… - … on Robotics and …, 2020 - ieeexplore.ieee.org
As artificial intelligence becomes an increasingly prevalent method of enhancing robotic
capabilities, it is important to consider effective ways to train these learning pipelines and to …

Vrgym: A virtual testbed for physical and interactive ai

X Xie, H Liu, Z Zhang, Y Qiu, F Gao, S Qi… - Proceedings of the …, 2019 - dl.acm.org
We propose VRGym, a virtual reality (VR) testbed for realistic human-robot interaction.
Different from existing toolkits and VR environments, the VRGym emphasizes on building …

Learning user-preferred mappings for intuitive robot control

M Li, DP Losey, J Bohg… - 2020 IEEE/RSJ …, 2020 - ieeexplore.ieee.org
When humans control drones, cars, and robots, we often have some preconceived notion of
how our inputs should make the system behave. Existing approaches to teleoperation …

Robot teleoperation with augmented reality virtual surrogates

ME Walker, H Hedayati, D Szafir - 2019 14th ACM/IEEE …, 2019 - ieeexplore.ieee.org
Teleoperation remains a dominant control paradigm for human interaction with robotic
systems. However, teleoperation can be quite challenging, especially for novice users. Even …

Open teach: A versatile teleoperation system for robotic manipulation

A Iyer, Z Peng, Y Dai, I Guzey, S Haldar… - arXiv preprint arXiv …, 2024 - arxiv.org
Open-sourced, user-friendly tools form the bedrock of scientific advancement across
disciplines. The widespread adoption of data-driven learning has led to remarkable …