Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/160020
Title: Visual servo control of robot manipulator with applications to construction automation
Authors: Jin, Yuxin
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Jin, Y. (2022). Visual servo control of robot manipulator with applications to construction automation. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/160020
Abstract: The construction industry has long been a labour-intensive sector. The gap between the continuously increasing demand for housing and the shirking workforce is growing wider day-to-day. In addition, the fatal and injury rate at the workplace for the construction sector remains stubbornly high as compared to other industries. Construction companies are seeking for robotics and automation technologies to keep a balance between safety, accuracy, and efficiency. Vision system is a crucial part of the robotic system in construction automation. By deploying a vision system on a robot, we can automate the detections of construction materials, installation components, and defects. Current state-of-art models for object detection extract the image feature vectors using a deep neural network which consists of a series of convolutional layers and max-pooling layers to generate the final output. After training a deep neural network model with a suitable dataset, it can classify and localize numerous classes. Its detection performance will be fixed throughout the prediction process. Typically, detection results will include object class, confidence level, bounding box size, and bounding box coordinates. The confidence level determines how confident we are to confirm the presence of an object. It can vary dramatically due to different lighting conditions, changes in the distance and angle of the camera. This thesis aims to explore the use of robot visual servoing technique to improve detection performance during real-time inspection. The proposed method utilizes object detection information to guide the robot system for achieving a better view of the target object. A region-based visual servoing controller is developed to position the target object in the center of the field of view (FOV) while also maximize of the coverage of the object within the FOV. A case study will be performed on tile cracks inspection by using the proposed technique. The inspection process is an important step to evaluate the current stage of the construction project as well as alert the supervisors if there is an error. It is also a tedious job as it requires close observation through every wall in every room among all the units. Tile cracks are commonly occurring during the transportation or installation process and the cracks are usually tiny and therefore not easily detected by human workers. By combining the visual servo control technique with a deep-learning-based object detector, we aim to achieve a higher confidence level for the detection of the tile cracks. Experimental results are presented to illustrate the performance.
URI: https://hdl.handle.net/10356/160020
DOI: 10.32657/10356/160020
Schools: School of Electrical and Electronic Engineering 
Rights: This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0).
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:EEE Theses

Files in This Item:
File Description SizeFormat 
Master_Thesis_JYX_14Jul.pdf14.71 MBAdobe PDFThumbnail
View/Open

Page view(s)

253
Updated on Jun 18, 2024

Download(s) 50

144
Updated on Jun 18, 2024

Google ScholarTM

Check

Altmetric


Plumx

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.