Volltext-Downloads (blau) und Frontdoor-Views (grau)

Towards Benchmarking of Domestic Robotic Assistants

  • As service robotics research advances rapidly, availability of objective, reproducible test specifications and evaluation criteria and also of benchmarking is more and more felt to be desirable in the community. As a first step towards benchmarking, in this paper we propose a formalization of tests - exemplified for domestic grasp&place tasks. The underlying philosophy of our approach is to confront the robot system in a black-box manner with requirements of a “rational customer”, and characterize the performance of the system in an objective way by the outcomes of a test-suite tailored to this scenario. A formalized single test description consists of a clear and reproducible specification of the robot’s task and the full context on the one hand, and a number of figures which objectively characterize the test result on the other hand. We illustrate this methodology for the domestic assistance scenario.

Export metadata

Additional Services

Search Google Scholar


Author:Ioannis Iossifidis, Gisbert Lawitzky, Steffen Knoop, Raoul Zöllner
Parent Title (English):Advances in Human-Robot-Interaction
Publisher:Springer Press
Document Type:Part of a Book
Year of Completion:2004
Release Date:2019/05/15
First Page:403
Last Page:414
Institutes:Fachbereich 1 - Institut Informatik
DDC class:600 Technik, Medizin, angewandte Wissenschaften / 620 Ingenieurwissenschaften und Maschinenbau
Licence (German):License LogoNo Creative Commons