Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/146731
Title: Fault detection method based on high-level feedback and reconstruction for image recognition
Authors: Xu, Jin
Keywords: Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Issue Date: 2021
Publisher: Nanyang Technological University
Source: Xu, J. (2021). Fault detection method based on high-level feedback and reconstruction for image recognition. Doctoral thesis, Nanyang Technological University, Singapore.
Abstract: Image recognition problem is a typical challenge for artificial intelligence. Deep learning methods have shown great progress in this area in recent years. However, this approach has the limitation of outputting wrong result with high confidence when the input is not well represented in the training data, such as adversarial examples (natural images with intentionally designed small perturbations that are imperceptible by human beings) and unusual images that is not covered in the training. This limitation causes great safety concerns for the deployment of existing deep learning systems for critical applications such as autonomous driving and medical diagnosis. However, it is not practical to include all adversarial or unusual images in training because images are highly variable. It is therefore desirable to design an image recognition system with the ability of fault detection. When an “unseen” image, either adversarial or unusual, is input to the system, the fault detection mechanism recognizes the situation and raise a red flag. With the fault detected, further steps such as intervention like double checking by a person can be taken to avoid damages. Inspired by the human perception system, the research reported in this thesis focusses on a novel fault detection mechanism and a reconstruction process. This mechanism, named Detection Based on Feedback and Reconstruction (DBFR), requires no change of the existing recognition system and generates a reconstructed image as an intuitive “internal model” to indicate whether the interpretation is supported by what is learned in the training while performing the inference. By comparing the reconstructed image with the input image, the incorrect interpretation can be detected with high probability. Experiments validate the superior effectiveness of this method over existing defense methods and the reconstructed images help to interpret the internal decision process of the deep learning system, which is currently treated as a black box in most applications.
URI: https://hdl.handle.net/10356/146731
DOI: 10.32657/10356/146731
Rights: This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0).
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:MAE Theses

Files in This Item:
File Description SizeFormat 
PhD Thesis - XU JIN.pdfA thesis submitted to the Nanyang Technological University in partial fulfilment of the requirement for the degree of Doctor of Philosophy4.55 MBAdobe PDFView/Open

Page view(s)

256
Updated on Jul 4, 2022

Download(s) 50

112
Updated on Jul 4, 2022

Google ScholarTM

Check

Altmetric


Plumx

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.