Please use this identifier to cite or link to this item:
Title: Low-resource symbolic music generation using transformers and chord identification heuristic
Authors: Chio, Ting Kiat
Keywords: Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Visual arts and music::Music
Issue Date: 2021
Publisher: Nanyang Technological University
Source: Chio, T. K. (2021). Low-resource symbolic music generation using transformers and chord identification heuristic. Final Year Project (FYP), Nanyang Technological University, Singapore.
Abstract: Music generation using computers is a task that while interesting, has received comparatively little attention compared to more mainstream problems. With recent advances in deep learning methods, it affords music generation researchers a new range of tools to apply to the cause. One of these is the Transformer, an Attention-driven model that has had considerable success in modelling sequential data, beating out once state-of-the-art models such as Long-Short Term Memory models. Even though there are existing efforts to apply Transformer models to the music generation task, the application of music domain knowledge is still lacking. Models are still largely trained on data that conveys only pitch, with information underlying the data such as chord progressions largely being unattended to. The purpose of this research is to test if the inclusion of chord progression labels can help improve model performance in the task of music generation, with the goal of producing more realistic and pleasant-sounding pieces. A template-mask method was used to quickly label large sets of pianoroll data, before the data was converted into a MIDI-like format with the inclusion of Chord events to represent chords in a chord progression. A generator Transformer based off the GPT-2 model was then trained on this data. By observing the pieces generated by the model, we were able to identify convincing signs that the model was able to learn the concept of chords and chord progressions, as well as produce pieces that have more recurring structure due to its understanding of these latent structures of music.
Schools: School of Computer Science and Engineering 
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
  Restricted Access
859.89 kBAdobe PDFView/Open

Page view(s)

Updated on Jun 8, 2023


Updated on Jun 8, 2023

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.