Please use this identifier to cite or link to this item:
Title: Machine learning for multi-sensor data fusion
Authors: Ong, Yiin Lih
Keywords: DRNTU::Engineering::Electrical and electronic engineering
Issue Date: 2019
Abstract: Data processing has been an integral part of preparations before machine learning model training. Ranging from simple adjustments such as contrast & brightness tuning to more complex procedures including normalization & Zero Component Analysis (ZCA), these are all processes geared towards providing a better data set for higher quality model training. Data fusion, on the other hand, aims to create a higher quality model via the combination of data from various sensors. This procedure of merging multiple datasets will produce fused data sets of higher quality in terms of consistency, compactness and accuracy. However, data fusion faces a critical challenge in the form of the expert knowledge in a domain required to pinpoint and extract suitable parameters for the task at hand. In this report, we will explore various machine-learning based data fusion techniques to facilitate the automated correlation and extraction of highly weighted parameters. In addition, fused data sets will be put to the test with several image detection networks for quality checks in terms of accuracy and advantage over conventional data sets. The objective of this project is to investigate the viability of multi-sensor data fusion in conjunction with deep-learning techniques. At the end of the project, a Multi-Model Based Data Fusion approach was developed based on multiple neural network models written in python for the PyTorch framework. The Data Fusion approach was able to outperform the Single-Model counterparts that did not utilize data fusion, achieving better classification results for 50% of all the individual test sets used to validate the model, while the Single-Model achieved better classification results for 25% and 31.25% of all the individual test sets respectively for each of the data types (RGB, Thermal image) involved in data fusion.
Rights: Nanyang Technological University
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
FYP Final Report Ong Yiin Lih A2090-181 Submission file PDF.pdf
  Restricted Access
Main Article4.35 MBAdobe PDFView/Open

Page view(s) 50

checked on Oct 20, 2020

Download(s) 50

checked on Oct 20, 2020

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.