Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/163416
Title: Hybrid SLAM and object recognition on an embedded platform
Authors: Chan, Jaryl Jia Le
Keywords: Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
Engineering::Computer science and engineering::Computer systems organization::Special-purpose and application-based systems
Engineering::Computer science and engineering::Hardware
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Chan, J. J. L. (2022). Hybrid SLAM and object recognition on an embedded platform. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/163416
Project: SCSE21-0704
Abstract: Simultaneous Localization and Mapping (SLAM) is a technique employed in the field of robotics to allow mobile robots to navigate an unfamiliar environment. Visual SLAM is a subset of SLAM which uses a camera as the primary sensor to give mobile robots the illusion of vision. Traditionally, Visual SLAM uses images from the camera to only perform SLAM. We propose the addition of an Object Recognition subsystem which utilizes the same images being processed for Visual SLAM, while supplementing it with additional information. This project proposes the development of a Hybrid SLAM and Object Recognition system which has the capability to augment existing SLAM applications with the contextual information gathered by Object Recognition techniques. The hybrid system is developed on the Jetson Xavier NX embedded system, with the Stereolabs ZED2 Stereo AI Camera providing a live video feed. The backbone of the system is the ORB-SLAM3 Visual SLAM algorithm as it is one of the most recognized and competent Visual SLAM algorithms in the present day. The Object Recognition component is handled by a Deep Learning YOLO-based model which provides fast performance for real-time detection.
URI: https://hdl.handle.net/10356/163416
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
JarylChan_FYP_FinalReport_Amended_v1.1.pdf
  Restricted Access
3.85 MBAdobe PDFView/Open

Page view(s)

136
Updated on Jan 30, 2023

Download(s)

30
Updated on Jan 30, 2023

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.