Hand gesture study using Kinect

Abstract

This project is aimed at utilising the Kinect Sensor to track the skeletal structure of the patients’ hand and measure the angle between the joints of the finger of interest. The severity of the patients’ finger injuries is evaluated by doctors and therapist by measuring the angle of bend of the injured finger using a goniometer.

Through the phase of the final year project, the author had attempted several methods in achieving the desired objective. However, the author faces difficulty in creating a program that could track the finger gestures. Hence, the author utilised Microsoft Visual Studio to create a windows presentation foundation application using C# programming language for the code-behind and extensible application markup language for the user interface.

The program codes are written based on the Kinect for Windows software developer kit and the Vitruvius library. The application developed works concurrently with the Kinect Sensor to track the human skeletal structure and measures the angles on the joints of the human arms. The author then tested the application to detect the skeletal structure of his body.