Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/73957
Title: Transfer learning through deep learning
Authors: Lee, Rhui Dih
Keywords: DRNTU::Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Issue Date: 2018
Abstract: Deep learning method, convolutional neural network (CNN) outperforms conventional machine learning method in the famous 1000-class large scale image recognition challenge held in 2012. Since then, state-of-art CNN model is getting deeper and its capacity is getting larger. Multiple regularization techniques have been proposed to overcome overfitting, which results in exceeding human’s level. However, every machine learning method is very domain-dependent, an efficient way to increase its ability to generalize well to the real-world domain is still an open research issue. The common scenario where training dataset is small, latency of prediction is critical, or memory resource is constrained would impact the applicability of deep learning. Transfer learning is used to address these restraints. This project focuses on experiment with multiple transfer learning methods through deep learning on a very noisy dataset, namely WebVision Database. In this report, I discuss the current state of deep learning and transfer learning. Then, I review multiple significant transfer learning methods and suggest how we can combine the use of them. I experiment with a baseline transfer method and another adaptation-transfer method on WebVision Database. I find that this dataset is hard-to-transfer and baseline method still convincingly works. I also report on the implementation in detail and evaluate the result obtained. Finally, I explore the potential of further experiment could be done and conclude the project.
URI: http://hdl.handle.net/10356/73957
Rights: Nanyang Technological University
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
FYP_LEERHUIDIH.pdf
  Restricted Access
1.31 MBAdobe PDFView/Open

Page view(s)

150
Updated on Nov 28, 2020

Download(s)

56
Updated on Nov 28, 2020

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.