Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/163030
Title: BIM-based indoor robot initialization in construction automation using object detection
Authors: Zhao, Xinge
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Zhao, X. (2022). BIM-based indoor robot initialization in construction automation using object detection. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/163030
Abstract: In recent years, there has been increasing interest for construction automation solutions to revolutionize the conventional construction industry and among them, robotics solutions are commonly used to automate construction tasks and to operate under dangerous conditions. To ensure the satisfactory performance of robotics solutions at construction sites, especially for applications using mobile robots, awareness of the location is required to initialize the robot before the navigation can be commenced. However, in indoor construction sites, GPS is not accessible, and infrastructure-based wireless networks such as WiFi, Bluetooth are not available yet, making automated initialization of mobile robots difficult. The traditional marker-based methods require manual deployment and calibration, and markers could be blocked by construction materials and components. Therefore, infrastructure-free and robust robot initialization methods are required for the complex construction environments. This research aims to develop an integrated Building Information Model (BIM)-based indoor robot initialization system using an object detector to initiate the robot location in an environment map built from BIM, given the robot deployed at an arbitrary location. CNN-based object detection techniques are used to recognize and locate the visual features, which are common and widely distributed building components at construction sites. A feature matching algorithm is proposed to correlate the acquired online information of detected features with geometric and semantic information retrieved from BIM, and the robot location in the BIM coordinate frame is estimated based on the feature association. Moreover, the proposed robot initialization system provides the functions of robot exploration and BIM-based local navigation that interacts with the visual recognition system to supervise the robot motion for active localization, making the entire system fully automatic. This system could ease the problem of devices or markers deployment and time-consuming environment configuration for robot initialization at construction sites. It can be integrated into the robot navigation system towards a completely automatic mobile robot navigation stack in construction automation. The proposed system was validated through experiments at various environments including real-world construction sites and the robustness and efficiency are illustrated.
URI: https://hdl.handle.net/10356/163030
Rights: This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0).
Fulltext Permission: embargo_20241116
Fulltext Availability: With Fulltext
Appears in Collections:EEE Theses

Files in This Item:
File Description SizeFormat 
Thesis_First Amendment.pdf
  Until 2024-11-16
20.11 MBAdobe PDFUnder embargo until Nov 16, 2024

Page view(s)

38
Updated on Nov 29, 2022

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.