Towards automated system and experiment reproduction in robotics

F Lier, M Hanheide, L Natale, S Schulz… - 2016 IEEE/RSJ …, 2016 - ieeexplore.ieee.org
Even though research on autonomous robots and human-robot interaction accomplished
great progress in recent years, and reusable soft-and hardware components are available …

[PDF][PDF] Can we reproduce it? toward the implementation of good experimental methodology in interdisciplinary robotics research

F Lier, P Lücking, J De Leeuw… - ICRA 2017 workshop …, 2017 - researchgate.net
The insufficient level of reproducibility of published experimental results has been identified
as a core issue in the field of robotics in recent years. Why is that? First of all, robotics …

Swarmrob: A toolkit for reproducibility and sharing of experimental artifacts in robotics research

A Pörtner, M Hoffmann, M König - arXiv preprint arXiv:1801.04199, 2018 - arxiv.org
Due to the complexity of robotics, the reproducibility of results and experiments is one of the
fundamental problems in robotics research. While the problem has been identified by the …

Swarmrob: A docker-based toolkit for reproducibility and sharing of experimental artifacts in robotics research

A Pörtner, M Hoffmann, S Zug… - 2018 IEEE International …, 2018 - ieeexplore.ieee.org
Due to the high complexity, the reproducibility of experiments is one of the fundamental
problems of robotics research. Although the problem has been identified by the community …

WoZ4U: an open-source wizard-of-oz interface for easy, efficient and robust HRI experiments

F Rietz, A Sutherland, S Bensch, S Wermter… - Frontiers in Robotics …, 2021 - frontiersin.org
Wizard-of-Oz experiments play a vital role in Human-Robot Interaction (HRI), as they allow
for quick and simple hypothesis testing. Still, a publicly available general tool to conduct …

SIERRA: A Modular Framework for Accelerating Research and Improving Reproducibility

J Harwell, M Gini - 2023 IEEE International Conference on …, 2023 - ieeexplore.ieee.org
We present SIERRA, a novel framework for accelerating development and improving
reproducibility of results in robotics research. SIERRA accelerates research by automating …

Towards safe, realistic testbed for robotic systems with human interaction

B Lee, J Brookshire, R Yahata… - … on Robotics and …, 2022 - ieeexplore.ieee.org
Simulation has been a necessary, safe testbed for robotics systems (RS). However, testing
in simulation alone is not enough for robotic systems operating in close proximity, or …

[PDF][PDF] Toward replicable and measurable robotics research [from the guest editors]

F Bonsignorio, AP Del Pobil - IEEE Robotics & Automation …, 2015 - scholar.archive.org
The famous experiment by Gal-ileo—one of the founders of modern science—in Pisa's
Cathedral in 1582, was one of the very first examples of a scientific experiment validating a …

A new kind of article for reproducible research in intelligent robotics [from the field]

F Bonsignorio - IEEE Robotics & Automation Magazine, 2017 - ieeexplore.ieee.org
The reproducibility of experimental results is a key characteristic of the scientific method.
Despite that, in robotics and artificial intelligence (AI)—maybe for good reason—replicating …

Research reproducibility and performance evaluation for dependable robots

E Guglielmelli - IEEE Robotics & Automation Magazine, 2015 - scholar.archive.org
This issue of IEEE Robotics & Automation Magazine (RAM) focuses on reproducibility and
measurability of robotics research. When announcing this special issue, I already outlined …