Please use this identifier to cite or link to this item:
Title: ABCDM : an Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis
Authors: Basiri, Mohammad Ehsan
Nemati, Shahla
Abdar, Moloud
Cambria, Erik
Acharya, U. Rajendra
Keywords: Engineering::Computer science and engineering
Issue Date: 2021
Source: Basiri, M. E., Nemati, S., Abdar, M., Cambria, E. & Acharya, U. R. (2021). ABCDM : an Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis. Future Generation Computer Systems, 115, 279-294.
Project: A18A2b0046
Journal: Future Generation Computer Systems
Abstract: Sentiment analysis has been a hot research topic in natural language processing and data mining fields in the last decade. Recently, deep neural network (DNN) models are being applied to sentiment analysis tasks to obtain promising results. Among various neural architectures applied for sentiment analysis, long short-term memory (LSTM) models and its variants such as gated recurrent unit (GRU) have attracted increasing attention. Although these models are capable of processing sequences of arbitrary length, using them in the feature extraction layer of a DNN makes the feature space high dimensional. Another drawback of such models is that they consider different features equally important. To address these problems, we propose an Attention-based Bidirectional CNN-RNN Deep Model (ABCDM). By utilizing two independent bidirectional LSTM and GRU layers, ABCDM will extract both past and future contexts by considering temporal information flow in both directions. Also, the attention mechanism is applied on the outputs of bidirectional layers of ABCDM to put more or less emphasis on different words. To reduce the dimensionality of features and extract position-invariant local features, ABCDM utilizes convolution and pooling mechanisms. The effectiveness of ABCDM is evaluated on sentiment polarity detection which is the most common and essential task of sentiment analysis. Experiments were conducted on five review and three Twitter datasets. The results of comparing ABCDM with six recently proposed DNNs for sentiment analysis show that ABCDM achieves state-of-the-art results on both long review and short tweet polarity classification.
ISSN: 0167-739X
DOI: 10.1016/j.future.2020.08.005
Rights: © 2020 Elsevier B.V. All rights reserved.
Fulltext Permission: none
Fulltext Availability: No Fulltext
Appears in Collections:SCSE Journal Articles

Citations 5

Updated on Dec 28, 2021

Page view(s)

Updated on May 24, 2022

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.