Please use this identifier to cite or link to this item:
Title: Incremental learning technologies for semantic segmentation
Authors: Yang, Yizhuo
Keywords: Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Yang, Y. (2022). Incremental learning technologies for semantic segmentation. Master's thesis, Nanyang Technological University, Singapore.
Abstract: Semantic segmentation models based on deep learning technologies have achieved remarkable results in recent years. However, many models encounter the problem of catastrophic forgetting, i.e. when the model is required to learn a new task without labels for old objects, its performance drops significantly on the previous tasks. This property greatly limits the application of the semantic segmentation models to the practical world. To solve this problem, an incremental learning method: Combination of Old Prediction and Modified Label (COPML) is developed in this dissertation project. The proposed method utilizes the prediction results of the old model and the modified labels of the new task to create pseudo labels which are close to the ground truth. By using these pseudo labels for training, the model is expected to preserve the knowledge of old tasks. In addition, other incremental learning technologies - knowledge distillation, replay and parameter freezing are also applied to the proposed method to further assist the model in overcoming catastrophic forgetting. The effectiveness of the proposed method is validated on two semantic segmentation models: Unet and Deeplab3 in Pascal-VOC 2012 dataset and a self-made dataset which contains images taken in NTU and its surroundings. The experimental results demonstrate that COPML enables the model to maintain most of the old knowledge while obtaining an excellent performance on a new task.
Schools: School of Electrical and Electronic Engineering 
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Theses

Files in This Item:
File Description SizeFormat 
Incremental Learning Technologies for Semantic Segmentation.pdf
  Restricted Access
1.4 MBAdobe PDFView/Open

Page view(s)

Updated on Sep 25, 2023


Updated on Sep 25, 2023

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.