Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/155041
Title: Semantic-guided distribution calibrating for few-shot classification
Authors: Qiu, Guochen
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2021
Publisher: Nanyang Technological University
Source: Qiu, G. (2021). Semantic-guided distribution calibrating for few-shot classification. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/155041
Abstract: The meta-learning paradigm is a mainstream method to solve the problem of few-shot learning. It constructs multiple tasks through episodic training so that the model can quickly generalize to new tasks. However, episodic training only sample a few training instances (shots) per class for simulating the test- time scenario, the randomness of sampling and scarcity of data will bring biased feature distribution of the task, which occurs in both meta-training and meta-testing. In this work, we propose a semantic guided adaptive distribution calibrated framework to alleviate this phenomenon, committing to using debiased information to eliminate bias. Semantic Conditional Batch Normalization (SCBN) , is to alleviate the deviations of the same class distribution in different episodic caused by sampling from the level of feature maps. In addition, a semantic Transformer (ST) is introduced to map the support and query set into a new feature space, where their domain gap is smaller. In both modules, the category semantic representation (text or language) is used as a high-level feature to modify the distribution. In this way, debiased semantic representation can make the model not be disturbed by sampling, and adjust the feature distribution adaptively, so that the class distribution can be separated as much as possible in the feature space. Experimental results show that it compares favourably to the previous state-of-the-art results for images only and images combined with semantics-based approaches.
URI: https://hdl.handle.net/10356/155041
Fulltext Permission: embargo_restricted_20240130
Fulltext Availability: With Fulltext
Appears in Collections:EEE Theses

Files in This Item:
File Description SizeFormat 
NTU_EEE_MSc_Dissertation_QIU_GUOCHEN.pdf
  Until 2024-01-30
2.11 MBAdobe PDFUnder embargo until Jan 30, 2024

Page view(s)

65
Updated on May 20, 2022

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.