Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/155514
Title: Style transfer between different illumination, weather and seasonal conditions
Authors: Zhu, Fangzheng
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2021
Publisher: Nanyang Technological University
Source: Zhu, F. (2021). Style transfer between different illumination, weather and seasonal conditions. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/155514
Abstract: The autonomous mobile robot is the key direction of robot research, while visual localization is the core of autonomous robot research. The bias caused by different illumination, weather, and seasonal conditions may undermine the robot perception and lead to imprecise localization results, while style transfer is an effective solution to it. A recent class of style transfer models allows a realistic translation of images between visual domains with comparatively little training data and without data pairing. In this work, I research methods for style transfer based on Generative Adversarial Network (GAN) and apply them to image retrieval and visual localization. I implement the ToDayGAN model, which can transfer the style of images between different illumination, weather and seasonal conditions. After researching the state-of-the-art visual localization methods on the effect of changing conditions, I apply the style transfer model to implement hierarchical localization, and use SuperPoint to export the dense local descriptors and NetVLAD to export global image-wide descriptors, finally, the SolvePnPRansac pose estimation algorithm is used to obtain a more accurate 6- DoF pose. This approach improves localization performance compared to the current visual localization methods in a framework with several types of standard metrics, which means applying style transfer methods to the task of visual localization is very effective across the contrasting visual conditions.
URI: https://hdl.handle.net/10356/155514
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Theses

Files in This Item:
File Description SizeFormat 
Dissertation Zhu Fangzheng.pdf
  Restricted Access
3.25 MBAdobe PDFView/Open

Page view(s)

96
Updated on Nov 26, 2022

Download(s)

8
Updated on Nov 26, 2022

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.