Please use this identifier to cite or link to this item:
Title: Ensemble application of ELM and GPU for real-time multimodal sentiment analysis
Authors: Tran, Ha-Nguyen
Cambria, Erik
Keywords: Engineering::Computer science and engineering
Issue Date: 2017
Source: Tran, H.-N., & Cambria, E. (2018). Ensemble application of ELM and GPU for real-time multimodal sentiment analysis. Memetic Computing, 10(1), 3-13. doi:10.1007/s12293-017-0228-3
Journal: Memetic Computing
Abstract: The enormous number of videos posted everyday on multimedia websites such as Facebook and YouTube makes the Internet an infinite source of information. Collecting and processing such information, however, is a very challenging task as it involves dealing with a huge amount of information that is changing at a very high speed. To this end, we leverage on the processing speed of extreme learning machine and graphics processing unit to overcome the limitations of standard learning algorithms and central processing unit (CPU) and, hence, perform real-time multimodal sentiment analysis, i.e., harvesting sentiments from web videos by taking into account audio, visual and textual modalities as sources of the information. For the sentiment classification, we leveraged on sentic memes, i.e., basic units of sentiment whose combination can potentially describe the full range of emotional experiences that are rooted in any of us, including different degrees of polarity. We used both feature and decision level fusion methods to fuse the information extracted from the different modalities. Using the sentiment annotated dataset generated from YouTube video reviews, our proposed multimodal system is shown to achieve an accuracy of 78%. In term of processing speed, our method shows improvements of several orders of magnitude for feature extraction compared to CPU-based counterparts.
ISSN: 1865-9284
DOI: 10.1007/s12293-017-0228-3
Rights: © 2017 Springer-Verlag Berlin Heidelberg. All rights reserved.
Fulltext Permission: none
Fulltext Availability: No Fulltext
Appears in Collections:SCSE Journal Articles

Citations 20

Updated on Mar 2, 2021

Citations 20

Updated on Mar 7, 2021

Page view(s)

Updated on May 23, 2022

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.