Virtual assembling using hand tracking with leap motion controller

Abstract

The hand tracking device Leap Motion Controller has been applied in many areas since it was released. Most applications are related to gaming and sign language recognition, where high precision is not a necessity. However, in places like surgical training and virtual assembly, the precision could be fatal. With the aim of higher precision, a new interaction mechanism is designed to manipulate objects, in which collision detection between the virtual hand and objects is not required. Instead, it controls the grasping and releasing with the gestures of one hand and moves the object with the other hand's displacement. This mechanism is implemented in Unity 20.1.2 with Leap Motion SDK 4.1.0 and Leap Motion Unity Module 4.7.1. After several tests, the mechanism is proven to have reasonably high precision. It allows the users to adjust the parameters to create customized systems, leading to an optimal outcome.