[PDF][PDF] Toward replicable and measurable robotics research [from the guest editors]

F Bonsignorio, AP Del Pobil - IEEE Robotics & Automation …, 2015 - scholar.archive.org
The famous experiment by Gal-ileo—one of the founders of modern science—in Pisa's
Cathedral in 1582, was one of the very first examples of a scientific experiment validating a …

A new kind of article for reproducible research in intelligent robotics [from the field]

F Bonsignorio - IEEE Robotics & Automation Magazine, 2017 - ieeexplore.ieee.org
The reproducibility of experimental results is a key characteristic of the scientific method.
Despite that, in robotics and artificial intelligence (AI)—maybe for good reason—replicating …

[PDF][PDF] Defining the requisites of a replicable robotics experiment

F Bonsignorio, J Hallam, A Del Pobil - RSS2009 Workshop on …, 2009 - heronrobots.com
There is, in the robotics community, a growing awareness of the difficulty to compare in a
rigorous quantitative way the many research results obtained in the many different …

Measuring performance: metrics for manipulator design, control, and optimization

M Russo - Robotics, 2022 - mdpi.com
How good is a robot? Three challenges arise from this question: first, defining performance
from the robot's observable behavior; second, quantifying performance with an index that is …

Towards automated system and experiment reproduction in robotics

F Lier, M Hanheide, L Natale, S Schulz… - 2016 IEEE/RSJ …, 2016 - ieeexplore.ieee.org
Even though research on autonomous robots and human-robot interaction accomplished
great progress in recent years, and reusable soft-and hardware components are available …

Integrated benchmarking and design for reproducible and accessible evaluation of robotic agents

J Tani, AF Daniele, G Bernasconi… - 2020 IEEE/RSJ …, 2020 - ieeexplore.ieee.org
As robotics matures and increases in complexity, it is more necessary than ever that robot
autonomy research be reproducible. Compared to other sciences, there are specific …

Grasping the performance: Facilitating replicable performance measures via benchmarking and standardized methodologies

J Falco, K Van Wyk, S Liu… - IEEE Robotics & …, 2015 - ieeexplore.ieee.org
It is comparatively easy to make computers exhibit adult-level performance on intelligence
tests or playing checkers, and difficult to give them the skills of a one-year-old when it comes …

Competitions for benchmarking: Task and functionality scoring complete performance assessment

F Amigoni, E Bastianelli, J Berghofer… - IEEE Robotics & …, 2015 - ieeexplore.ieee.org
Scientific experiments and robotic competitions share some common traits that can put the
debate about developing better experimental methodologies and replicability of results in …

[图书][B] Experimental Robotics: The 12th International Symposium on Experimental Robotics

O Khatib, V Kumar, G Sukhatme - 2013 - books.google.com
Experimental Robotics: The 12th International Symposium on Experimental Robotics Page 1
springer tracts in advanced robotics 79 star Oussama Khatib Vijay Kumar Gaurav Sukhatme …

[图书][B] Performance evaluation and benchmarking of intelligent systems

R Madhavan, E Tunstel, E Messina - 2009 - Springer
To design and develop capable, dependable, and affordable intelligent systems, their
performance must be measurable. Scientific methodologies for standardization and …