Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/100286
Title: Human-virtual human interaction by upper body gesture understanding
Authors: Xiao, Yang
Yuan, Junsong
Thalmann, Daniel
Keywords: Electrical and Electronic Engineering
Issue Date: 2013
Source: Xiao, Y., Yuan, J., & Thalmann, D., (2013). Human-Virtual Human Interaction by Upper Body Gesture Understanding. Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology. 133-142.
Abstract: In this paper, a novel human-virtual human interaction system is proposed. This system supports a real human to communicate with a virtual human using natural body language. Meanwhile, the virtual human is capable of understanding the meaning of human upper body gestures and reacting with its own personality by the means of body action, facial expression and verbal language simultaneously. In total, 11 human upper body gestures with and without human-object interaction are currently involved in the system. They can be characterized by human head, hand and arm posture. In our system implementation, the wearable Immersion CyberGlove II is used to capture the hand posture and the vision-based Microsoft Kinect takes charge of capturing the head and arm posture. This is a new sensor solution for human-gesture capture, and can be regarded as the most important contribution of this paper. Based on the posture data from the CyberGlove II and the Kinect, an effective and real-time human gesture recognition algorithm is also proposed. To verify the effectiveness of the gesture recognition method, we build a human gesture sample dataset. Additionally, the experiments demonstrate that our algorithm can recognize human gestures with high accuracy in real time. [This research is partially supported by IMI Seed Grant. It is partially carried out at BeingThere Centre with the support from the Singapore National Research Foundation under its International Research Centre @ Singapore Funding Initiative and administered by the IDM Programme Office.]
URI: https://hdl.handle.net/10356/100286
http://hdl.handle.net/10220/18125
DOI: 10.1145/2503713.2503727
Rights: © 2013 Association for Computing Machinery This is the author created version of a work that has been peer reviewed and accepted for publication by Human-Virtual Human Interaction by Upper Body Gesture Understanding , Association for Computing Machinery. It incorporates referee’s comments but changes resulting from the publishing process, such as copyediting, structural formatting, may not be reflected in this document. The published version is available at: http://dx.doi.org/10.1145/2503713.2503727].
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:EEE Conference Papers

Files in This Item:
File Description SizeFormat 
Human-Virtual Human Interaction by Upper Body Gesture Understanding.pdf8.39 MBAdobe PDFThumbnail
View/Open

Google ScholarTM

Check

Altmetric


Plumx

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.