Interactive audio using leap motion

Abstract

Over recent years, Human-Computer Interaction (HCI) technology has developed rapidly and steadily. Current technologies including Oculus Rift, Google Cardboard, and Leap Motion are the popular choices for interactive application and game development. While motion tracking technologies are advancing well, there is still a lot of potential in the implementation of gesture recognition for applications across different platforms. In this project, the objective is to deliver a fresh and new form of interactive audio experience involving Leap Motion, Android and Google Cardboard. Motivated by the potential of music game being played on a more interactive platform, this project ultimately strives to integrate Leap Motion and Virtual Reality into the 3D music game created. The entire system was also developed on a mobile platform to increase its prospect and mobility. As the project was integrated across multiple platforms, different issues were analyzed and discussed.