Volltext-Downloads (blau) und Frontdoor-Views (grau)

Towards Benchmarking of Domestic Robotic Assistants

  • As service robotics research advances rapidly, availability of objective, reproducible test specifications and evaluation criteria and also of benchmarking is more and more felt to be desirable in the community. As a first step towards benchmarking, in this paper we propose a formalization of tests - exemplified for domestic grasp&place tasks. The underlying philosophy of our approach is to confront the robot system in a black-box manner with requirements of a “rational customer”, and characterize the performance of the system in an objective way by the outcomes of a test-suite tailored to this scenario. A formalized single test description consists of a clear and reproducible specification of the robot’s task and the full context on the one hand, and a number of figures which objectively characterize the test result on the other hand. We illustrate this methodology for the domestic assistance scenario.

Export metadata

Additional Services

Share in Twitter Search Google Scholar


Author:Ioannis Iossifidis, Gisbert Lawitzky, Steffen Knoop, Raoul Zöllner
Parent Title (English):Advances in Human-Robot-Interaction
Publisher:Springer Press
Document Type:Part of a Book
Year of Completion:2004
Release Date:2019/05/15
First Page:403
Last Page:414
Institutes:Fachbereich 1 - Institut Informatik
DDC class:600 Technik, Medizin, angewandte Wissenschaften / 620 Ingenieurwissenschaften und Maschinenbau
Licence (German):License LogoNo Creative Commons