Algorithms and systems for manipulating multiple objects

Z Pan, A Zeng, Y Li, J Yu… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Robot manipulation of multiple objects is an important topic for applications including
warehouse automation, service robots performing cleaning, and large-scale object sorting …

Making sense of vision and touch: Learning multimodal representations for contact-rich tasks

MA Lee, Y Zhu, P Zachares, M Tan… - IEEE Transactions …, 2020 - ieeexplore.ieee.org
Contact-rich manipulation tasks in unstructured environments often require both haptic and
visual feedback. It is nontrivial to manually design a robot controller that combines these …

Multimodal sensor fusion with differentiable filters

MA Lee, B Yi, R Martín-Martín… - 2020 IEEE/RSJ …, 2020 - ieeexplore.ieee.org
Leveraging multimodal information with recursive Bayesian filters improves performance
and robustness of state estimation, as recursive filters can combine different modalities …

Tactile slam: Real-time inference of shape and pose from planar pushing

S Suresh, M Bauza, KT Yu… - … on Robotics and …, 2021 - ieeexplore.ieee.org
Tactile perception is central to robot manipulation in unstructured environments. However, it
requires contact, and a mature implementation must infer object models while also …

Learning tactile models for factor graph-based estimation

P Sodhi, M Kaess, M Mukadam… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
We're interested in the problem of estimating object states from touch during manipulation
under occlusions. In this work, we address the problem of estimating object poses from …

Differentiable factor graph optimization for learning smoothers

B Yi, MA Lee, A Kloss, R Martín-Martín… - 2021 IEEE/RSJ …, 2021 - ieeexplore.ieee.org
A recent line of work has shown that end-to-end optimization of Bayesian filters can be used
to learn state estimators for systems whose underlying models are difficult to hand-design or …

Detect, reject, correct: Crossmodal compensation of corrupted sensors

MA Lee, M Tan, Y Zhu, J Bohg - 2021 IEEE international …, 2021 - ieeexplore.ieee.org
Using sensor data from multiple modalities presents an opportunity to encode redundant
and complementary features that can be useful when one modality is corrupted or noisy …

Patchgraph: In-hand tactile tracking with learned surface normals

P Sodhi, M Kaess, M Mukadanr… - … on Robotics and …, 2022 - ieeexplore.ieee.org
We address the problem of tracking 3D object poses from touch during in-hand
manipulations. Specifically, we look at tracking small objects using vision-based tactile …

In-hand object pose tracking via contact feedback and gpu-accelerated robotic simulation

J Liang, A Handa, K Van Wyk… - … on Robotics and …, 2020 - ieeexplore.ieee.org
Tracking the pose of an object while it is being held and manipulated by a robot hand is
difficult for vision-based methods due to significant occlusions. Prior works have explored …

Leo: Learning energy-based models in factor graph optimization

P Sodhi, E Dexheimer, M Mukadam… - … on Robot Learning, 2022 - proceedings.mlr.press
We address the problem of learning observation models end-to-end for estimation. Robots
operating in partially observable environments must infer latent states from multiple sensory …