Design and implementation of an integrated interactive display system

Abstract

This final year project report documents the design and implementation of an integrated interactive display system. The project mainly focuses on potential improvements of existing interactive display systems like interactive advertising displays and Smart TVs. Two kinds of interactive methods were designed and implemented during the project. One is to use a smart phone to upload multimedia contents as well as to control the mouse cursor of a display. The other is to use gestures to control the mouse cursor of a display. The author has been invited by Nanyang Innovation and Enterprise Office (NIEO) to apply a technology disclosure (TD) for this final year project.

For the first part, an Android application was developed from scratch and there are mainly two functions in the Android application. Firstly, the application can upload images, music and videos to a remote server and then be extracted by display system. Secondly, the application can control the move of mouse cursor on the display by smart phone’s built-in motion sensors. To the best of the author’s knowledge, this is the first mobile application that utilizes motion sensors to control an interactive display system.

For the second part, a Kinect device is connected to the system and used to detect the gestures of users. The Kinect was programmed to recognize the right hand palm of the user. In the meanwhile, the move of mouse cursor on the display will follow the move of the right hand.

The developed prototype has broad commercial potentials. Firstly, the prototype can improve the current digital advertising technology. Since any advertising display in the world can be controlled by the developed Android application, companies can change their advertisements any time with a smart phone. Secondly, the two remote control techniques developed can be used in the next generation smart TV to improve users’ viewing experience.