Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/159546
Title: Extrinsic calibration between thermal camera and mmWave radar for intelligent robots
Authors: Zhang, Shini
Keywords: Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Zhang, S. (2022). Extrinsic calibration between thermal camera and mmWave radar for intelligent robots. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/159546
Abstract: LiDAR (Light Detection And Ranging) and RGB (Red-Green-Blue) camera perform well in general condition while 4D mmWave Radar (RAdio Detection And Ranging) and thermal camera do better in harsh environment. 4D Radar and thermal camera data fusion futher benefits intelligent robots to be used in various scenarios. There were limited literatures about these two sensors fusion as it was not long after the 4D Radar is pushed into market. Moreover, due to the heterogeneity of the two sensors, common feature is the main difficulty of the calibration. To solve these problems, 4DRadar2ThermalCalib is proposed. The three main contributions of this dissertation are: 1) A systematic intrinsic and extrinsic calibration method, 4DRadar2ThermalCalib, for a 4D mmWave Radar and a thermal camera is proposed. 2) A novel calibration target, sphericaltrihedral, is designed to provide the common features between a 4D mmWave Radar and a thermal camera. 3) Sphere center features in both Radar point cloud data and thermal image data are detected automatically. The results of the extrinsic calibration is obtained by minimizing the re-projection error. Both quantitative and qualitative analysis are implemented to prove that the 4DRadar2ThermalCalib method performs well in real environment. The overall re-projection error is 1.88 pixels.
URI: https://hdl.handle.net/10356/159546
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Theses

Files in This Item:
File Description SizeFormat 
Extrinsic Calibration between Thermal Camera and mmWave Radar for Intelligent Robots.pdf
  Restricted Access
4.86 MBAdobe PDFView/Open

Page view(s)

16
Updated on Jul 4, 2022

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.