The insufficient level of reproducibility of published experimental results has been identified
as a core issue in the field of robotics in recent years. Why is that? First of all, robotics …

The reproducibility of experimental results is a key characteristic of the scientific method.
Despite that, in robotics and artificial intelligence (AI)—maybe for good reason—replicating …

Experiments are essential ingredients of science, both to confirm/refute a theory and to
discover new theories. It is a common belief that experimentation in robotics has not yet …

The famous experiment by Gal-ileo—one of the founders of modern science—in Pisa's
Cathedral in 1582, was one of the very first examples of a scientific experiment validating a …

There is, in the robotics community, a growing awareness of the difficulty to compare in a
rigorous quantitative way the many research results obtained in the many different …

Even though research on autonomous robots and human-robot interaction accomplished
great progress in recent years, and reusable soft-and hardware components are available …

A few months ago, a graduate student in another country called me (Vaughan) to ask for the
source code of one of my multi-robot simulation experiments. The student had an idea for a …

This issue of IEEE Robotics & Automation Magazine (RAM) focuses on reproducibility and
measurability of robotics research. When announcing this special issue, I already outlined …

The robotics research field lacks formalized definitions and frameworks for evaluating
advanced capabilities including generalizability (the ability for robots to perform tasks under …

Due to the complexity of robotics, the reproducibility of results and experiments is one of the
fundamental problems in robotics research. While the problem has been identified by the …