Transformers for one-shot visual imitation

S Dasari, A Gupta - Conference on Robot Learning, 2021 - proceedings.mlr.press
Humans are able to seamlessly visually imitate others, by inferring their intentions and using
past experience to achieve the same end goal. In other words, we can parse complex …

[HTML][HTML] Towards commissioning, resilience and added value of Augmented Reality in robotics: Overcoming technical obstacles to industrial applicability

J Lambrecht, L Kästner, J Guhl, J Krüger - Robotics and Computer …, 2021 - Elsevier
Augmented Reality (AR) has the potential for facilitating the interaction with robots by
enhancing the operator's spatial understanding as well as providing further cognitive …

Watch it move: Unsupervised discovery of 3d joints for re-posing of articulated objects

A Noguchi, U Iqbal, J Tremblay… - Proceedings of the …, 2022 - openaccess.thecvf.com
Rendering articulated objects while controlling their poses is critical to applications such as
virtual reality or animation for movies. Manipulating the pose of an object, however, requires …

A brief survey of sim2real methods for robot learning

K Dimitropoulos, I Hatzilygeroudis… - … Conference on Robotics …, 2022 - Springer
Simulation has been crucial for robotics research development almost from the beginning of
its existence. While simulation has been widely used for education, testing, and prototyping …

Act the part: Learning interaction strategies for articulated object part discovery

SY Gadre, K Ehsani, S Song - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
People often use physical intuition when manipulating articulated objects, irrespective of
object semantics. Motivated by this observation, we identify an important embodied task …

Single-view robot pose and joint angle estimation via render & compare

Y Labbé, J Carpentier, M Aubry… - Proceedings of the …, 2021 - openaccess.thecvf.com
We introduce RoboPose, a method to estimate the joint angles and the 6D camera-to-robot
pose of a known articulated robot from a single RGB image. This is an important problem to …

Markerless camera-to-robot pose estimation via self-supervised sim-to-real transfer

J Lu, F Richter, MC Yip - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Solving the camera-to-robot pose is a fundamental requirement for vision-based robot
control, and is a process that takes considerable effort and cares to make accurate …

Simnet: Enabling robust unknown object manipulation from pure synthetic data via stereo

T Kollar, M Laskey, K Stone… - … on Robot Learning, 2022 - proceedings.mlr.press
Robot manipulation of unknown objects in unstructured environments is a challenging
problem due to the variety of shapes, materials, arrangements and lighting conditions. Even …

Image-based pose estimation and shape reconstruction for robot manipulators and soft, continuum robots via differentiable rendering

J Lu, F Liu, C Girerd, MC Yip - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
State estimation from measured data is crucial for robotic applications as autonomous
systems rely on sensors to capture the motion and localize in the 3D world. Among sensors …

Structure from action: Learning interactions for articulated object 3d structure discovery

N Nie, SY Gadre, K Ehsani, S Song - arXiv preprint arXiv:2207.08997, 2022 - arxiv.org
We introduce Structure from Action (SfA), a framework to discover 3D part geometry and joint
parameters of unseen articulated objects via a sequence of inferred interactions. Our key …