Start / Publications / Lightweight palm and finger tracking for real-time 3D ...

Lightweight palm and finger tracking for real-time 3D gesture control

Georg Hackenberg, Rod McCall and Wolfgang Broll

Virtual Reality Conference (VR), 2011 IEEE, pp.19-26 , 19-23 March 2011

motion capture gesture recognition computer vision user interface

Abstract

We present a novel technique implementing barehanded interaction with virtual 3D content by employing a time-of-flight camera. The system improves on existing 3D multi-touch systems by working regardless of lighting conditions and supplying a working volume large enough for multiple users. Previous systems were limited either by environmental requirements, working volume, or computational resources necessary for realtime operation. By employing a time-of-flight camera, the system is capable of reliably recognizing gestures at the finger level in real-time at more than 50 fps with commodity computer hardware using our newly developed precision hand and finger-tracking algorithm. Building on this algorithm, the system performs gesture recognition with simple constraint modeling over statistical aggregations of the hand appearances in a working volume of more than 8 cubic meters. Two iterations of user tests were performed on a prototype system, demonstrating the feasibility and usability of the approach as well as providing first insights regarding the acceptance of true barehanded touch-based 3D interaction.

Slides

BibTEX

@INPROCEEDINGS{ 
	author={Hackenberg, G. and McCall, R. and Broll, Wolfgang}, 
	booktitle={Virtual Reality Conference (VR), 2011 IEEE}, 
	title={Lightweight palm and finger tracking for real-time 3D gesture control}, 
	year={2011}, 
	month={March}, 
	pages={19-26},
	doi={10.1109/VR.2011.5759431}, 
	ISSN={1087-8270},
}

You might also be interested in

Cyber-physical manufacturing system development: A test-driven design method and exploratory case study

Georg Hackenberg and Jakob Mund

" Today, manufacturing engineering companies still struggle developing cyber-physical solutions. Studies suggest that inappropriate engineering methods dominated by mechanical design decisions and incompatible engineering tool landscapes are key problems that lead to isolated and potentially inconsistent ..."

In 5th International Conference on Mechatronics and Control Engineering , 14-17 December 2016

manufacturing system system engineering system design system verification system validation

Performance Analysis of Adaptive Runge-Kutta Methods in Region of Interest

Alarico Campetelli and Georg Hackenberg

" The combination of embedded systems with physical components, termed Cyber-Physical Systems (CPSs), poses important challenges in the design, modelling, simulation and verification of systems, because they combine discrete software elaborations with analogues time evolutions and ..."

In 2nd International IFIP Workshop on Emerging Ideas and Trends in Engineering of Cyber-Physical Systems , 13-17 April 2015

Bibtex

mechatronic system system engineering system verification system validation

Towards Early Emergent Property Understanding: Merging Behavior Space Exploration and Model-based Software Engineering

Georg Hackenberg and Denis Bytschkow

" During early phases of complex systems engineering typically many structural and behavioral aspects are unclear. In particular, when it comes to constraints on the result of interactions between distributed components (emergent properties) current software engineering ..."

In 2012 Extreme Modeling Workshop (XM '12), ACM, New York, NY, USA, pp.39-44 , 1 October 2014

Slides Bibtex

energy system system engineering system design system validation dynamic programming