Please use this identifier to cite or link to this item:
Title: Concept-level image sentiment analysis with semi-supervised learning
Authors: Kamath, Shantanu Arun
Keywords: DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
Issue Date: 2018
Abstract: Advancing technological wave and rapid growth in social media platforms have enabled people to represent their experience, stances, and feelings using visual media such as images. Mining sentiments from images over various platforms can be used to provide crucial information on the opinions of the people and the general outlook on the topic. The critical need for this will grow exponentially, in pace with the global growth of content. Expressiveness varies from one person to another. Most images posted on Twitter lack good labels and the accompanying tweets have a lot of noise. Hence, in this paper, we identify the contents and sentiments in images through the extraction of image features. We leverage on the fact that Restricted Boltzmann Machines allows greedy, layer-wise and unsupervised pre-training that provides great performance in image classification. In particular, we present a novel semi-supervised method to extract features from Twitter images by unsupervised pre-training of Convolutional Restricted Boltzmann Machines (CRBM) with Contrastive Divergence (CD) followed by supervised training of Convolutional Neural Networks (CNN) and a Recurrent Neural Network (RNN) with backpropagation. The model is evaluated on a Twitter dataset of images and corresponding labels and show that accuracy is higher than using just Convolutional Neural Networks (CNN).
Rights: Nanyang Technological University
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
  Restricted Access
Final Report6.07 MBAdobe PDFView/Open

Page view(s) 50

checked on Oct 26, 2020

Download(s) 50

checked on Oct 26, 2020

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.