Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/66841
Title: Virtual piano
Authors: Tan, Alan Lai Chian
Keywords: DRNTU::Engineering
Issue Date: 2016
Abstract: Smartphones are small but powerful devices, providing humans with countless uses, from making phone calls and taking photos, to accessing the Internet from almost anywhere. The late twentieth-century saw an explosion of computer applications. Through the installation of apps, the list of possible smartphone uses multiplies by tens of thousands and grows longer every day. With smarter phone cameras coming to the market, there has been great interest in computer vision applications using real-time image processing in mobile devices. This project develops an Android mobile application that uses real-time image processing techniques to provide a close simulation of playing the piano on a piece of paper with piano keys drawn or printed on it. The mobile device is placed on an elevated platform and at an angle for optimum view of the paper piano. When the application is started, the user switches on the piano and fingertip detection, fix the detected keys, and can then start playing on the paper piano. The application tracks fingertips for finger presses on the prefixed piano keys and then plays the corresponding sounds. The application is developed using OpenCV, a library for real-time image processing with over 2500 optimized algorithms. The application is tested on a Samsung Galaxy Note 4 under a single light condition in a small room. The empirical results showed that the proposed set of methodologies worked well for single fingertip keystrokes but failed partially for multiple fingertip keystrokes and more research is needed to implement a robust algorithm to accurately detect multiple keystrokes.
URI: http://hdl.handle.net/10356/66841
Rights: Nanyang Technological University
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
FYP Virtual Piano Tan Lai Chian Alan.pdf
  Restricted Access
Full Report5.36 MBAdobe PDFView/Open

Page view(s)

239
Updated on Dec 1, 2020

Download(s) 50

21
Updated on Dec 1, 2020

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.