Reinforcement learning with model-based feedforward inputs for robotic table tennis

H Ma, D Büchler, B Schölkopf, M Muehlebach - Autonomous Robots, 2023 - Springer
We rethink the traditional reinforcement learning approach, which is based on optimizing
over feedback policies, and propose a new framework that optimizes over feedforward …

Black-box vs. gray-box: A case study on learning table tennis ball trajectory prediction with spin and impacts

J Achterhold, P Tobuschat, H Ma… - … for Dynamics and …, 2023 - proceedings.mlr.press
In this paper, we present a method for table tennis ball trajectory filtering and prediction. Our
gray-box approach builds on a physical model. At the same time, we use data to learn …

Data-efficient online learning of ball placement in robot table tennis

P Tobuschat, H Ma, D Büchler… - 2023 IEEE/RSJ …, 2023 - ieeexplore.ieee.org
We present an implementation of an online op-timization algorithm for hitting a predefined
target when returning ping-pong balls with a table tennis robot. The online algorithm …

AIMY: An open-source table tennis ball launcher for versatile and high-fidelity trajectory generation

A Dittrich, J Schneider, S Guist, N Gürtler… - … on Robotics and …, 2023 - ieeexplore.ieee.org
To approach the level of advanced human players in table tennis with robots, generating
varied ball trajectories in a reproducible and controlled manner is essential. Current ball …

A Robust Open-source Tendon-driven Robot Arm for Learning Control of Dynamic Motions

S Guist, J Schneider, H Ma, V Berenz, J Martus… - arXiv preprint arXiv …, 2023 - arxiv.org
A long-lasting goal of robotics research is to operate robots safely, while achieving high
performance which often involves fast motions. Traditional motor-driven systems frequently …

A Pontryagin Perspective on Reinforcement Learning

O Eberhard, C Vernade, M Muehlebach - arXiv preprint arXiv:2405.18100, 2024 - arxiv.org
Reinforcement learning has traditionally focused on learning state-dependent policies to
solve optimal control problems in a closed-loop fashion. In this work, we introduce the …

Semi-Parametric Musculoskeletal Model for Reinforcement Learning-Based Trajectory Tracking

H Xu, J Fan, H Ma, Q Wang - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
This article aims to solve the trajectory tracking task of the pneumatic musculoskeletal robot
within a model-based reinforcement learning framework. Considering the limited sensors …

Balancing a 3D Inverted Pendulum using Remote Magnetic Manipulation

J Zughaibi, BJ Nelson, M Muehlebach - arXiv preprint arXiv:2402.06012, 2024 - arxiv.org
Remote magnetic manipulation offers wireless control over magnetic objects, which has
important medical applications, such as targeted drug delivery and minimally invasive …

Safe & Accurate at Speed with Tendons: A Robot Arm for Exploring Dynamic Motion

S Guist, J Schneider, H Ma, L Chen, V Berenz… - RSS 2024 Workshop … - openreview.net
Operating robots precisely and at high speeds has been a long-standing goal of robotics
research. Balancing these competing demands is key to enabling the seamless …

Speech Recognition System of Specific Vocabulary

S Zhao - 2023 3rd Asia-Pacific Conference on Communications …, 2023 - ieeexplore.ieee.org
End-to-end speech recognition system can realize the conversion from input audio to
character text without complicated data processing, and it is widely used in speech …