EEG recognition for music generation

Abstract

With the rise of the metaverse industry, research has been conducted to develop the user experience when playing games in augmented reality (AR) and virtual reality (VR). Many companies have attached Electroencephalography (EEG) sensors to AR/VR headsets to understand how users feel when playing games. The game content developers can understand the user experience and design a better gaming environment by processing and analyzing the EEG signals. Besides gaming content and lighting effect, the sound effect plays a significant role in inducing feelings for gamers. The user experience can be stimulated or changed to align with the game designer's intention by changing the music melody. This paper proposes a method of generating music that can induce the desired emotion based on the user's feelings. After understanding the user's emotion for a piece of a specific song, the system will generate and add more notes to that piece of music such that the modified music will sound happy and sad or neutral based on the user's feelings.