Volltext-Downloads (blau) und Frontdoor-Views (grau)

Neural Network Based Data Fusion for Hand Pose Recognition with Multiple ToF Sensors

  • We present a study on 3D based hand pose recognition using a new generation of low-cost time-of-flight(ToF) sensors intended for outdoor use in automotive human-machine interaction. As signal quality is impaired compared to Kinect-type sensors, we study several ways to improve performance when a large number of gesture classes is involved. We investigate the performance of different 3D descriptors, as well as the fusion of two ToF sensor streams. By basing a data fusion strategy on the fact that multilayer perceptrons can produce normalized confidences individually for each class, and similarly by designing information-theoretic online measures for assessing confidences of decisions, we show that appropriately chosen fusion strategies can improve overall performance to a very satisfactory level. Real-time capability is retained as the used 3D descriptors, the fusion strategy as well as the online confidence measures are computationally efficient.

Export metadata

Additional Services

Share in Twitter Search Google Scholar


Author:Thomas Kopinski, Alexander Gepperth, Uwe Handmann, Stefan Geisler
Parent Title (German):Artificial Neural Networks and Machine Learning – ICANN 2014
Document Type:Part of a Book
Year of Completion:2014
Release Date:2019/07/12
Issue:vol 8681
Page Number:8
First Page:233
Last Page:240
Institutes:Fachbereich 1 - Institut Informatik
DDC class:600 Technik, Medizin, angewandte Wissenschaften / 621.3 Elektrotechnik, Elektronik
Licence (German):License LogoNo Creative Commons