Start / Publications / Lightweight palm and finger tracking for real-time 3D ...

Lightweight palm and finger tracking for real-time 3D gesture control

Georg Hackenberg, Rod McCall and Wolfgang Broll

Virtual Reality Conference (VR), 2011 IEEE, pp.19-26 , 19-23 March 2011

motion capture gesture recognition computer vision user interface


We present a novel technique implementing barehanded interaction with virtual 3D content by employing a time-of-flight camera. The system improves on existing 3D multi-touch systems by working regardless of lighting conditions and supplying a working volume large enough for multiple users. Previous systems were limited either by environmental requirements, working volume, or computational resources necessary for realtime operation. By employing a time-of-flight camera, the system is capable of reliably recognizing gestures at the finger level in real-time at more than 50 fps with commodity computer hardware using our newly developed precision hand and finger-tracking algorithm. Building on this algorithm, the system performs gesture recognition with simple constraint modeling over statistical aggregations of the hand appearances in a working volume of more than 8 cubic meters. Two iterations of user tests were performed on a prototype system, demonstrating the feasibility and usability of the approach as well as providing first insights regarding the acceptance of true barehanded touch-based 3D interaction.



	author={Hackenberg, G. and McCall, R. and Broll, Wolfgang}, 
	booktitle={Virtual Reality Conference (VR), 2011 IEEE}, 
	title={Lightweight palm and finger tracking for real-time 3D gesture control}, 

You might also be interested in

Early Estimation of Multi-Objective Traffic Flow

Dominik Ascher and Georg Hackenberg

" Intelligent Transportation Systems (ITS) have come a long way targeting problems such as increasing emissions and growing vehicle numbers. Current approaches address a variety of objectives including congestion management, collision avoidance, energy-efficiency and emission reduction. ..."

In Connected Vehicles and Expo (ICCVE), 2014 International Conference on , 11-14 November 2014


transportation system system engineering system design system validation

The TRANSP-0 framework for integrated transportation and power system design

Dominik Ascher and Georg Hackenberg

" Increasing penetration of decentralized energy production as well as the propagation of new transportation paradigms such as transportation electrification, autonomous vehicles and mobility-on-demand will require interrelated key changes to current transportation and power systems. To ..."

In 19th IEEE International Conference on Intelligent Transportation Systems (ITSC 2016) , 01-04 November 2016

transportation system energy system system engineering system design system validation

Applying formal software engineering techniques to smart grids

Georg Hackenberg, Maximilian Irlbeck, Vasileios Koutsoumpas and Denis Bytschkow

" Engineering complex systems that have to meet critical requirements is a difficult task, especially if multiple engineering disciplines are involved. Common practice in domains like the automotive or avionic industry shows that formal methods improve ..."

In Software Engineering for the Smart Grid (SE4SG), 2012 International Workshop on, pp.50-56 , 3 June 2012

Slides Bibtex

energy system system engineering system design system validation