Please use this identifier to cite or link to this item:
Title: Goal-oriented grasping in clutter with human-in-the-loop implementation
Authors: Wang, Yi
Keywords: Engineering::Computer science and engineering
Engineering::Mechanical engineering
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Wang, Y. (2022). Goal-oriented grasping in clutter with human-in-the-loop implementation. Final Year Project (FYP), Nanyang Technological University, Singapore.
Abstract: For people with motor impairment, robotic arms can act as body surrogates to aid with everyday tasks. However, teleoperation of a high-DoF robotic arm using low-DoF controllers is tedious. Even with the integration of autonomous motion planners and grasp planners, the operation is difficult in a cluttered environment. State-of-the-art works for grasping objects amidst clutter do not work well in practical settings due to errors in perception and scene understanding. In this work, we aim to address these limitations with a Human-In-The-Loop (HITL) approach. We developed an interface which allows human to interrupt and change the operation of the robot if the actions taken by the robot are incorrect. A robot arm was integrated with the interface to develop a complete system for object grasping in clutter. To evaluate the system, experiments were conducted with human subjects. Results of the experiments showed that the proposed implementation provided a greater sense of control and more robust functionalities as compared to other evaluated approaches. Our system also helped users to retrieve objects in a shorter amount of time. Discussions were made on various insights gained while developing and testing this system and ways for further improvement were suggested.
Schools: School of Mechanical and Aerospace Engineering 
Research Centres: Rehabilitation Research Institute of Singapore (RRIS) 
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:MAE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
  Restricted Access
15.56 MBAdobe PDFView/Open

Page view(s)

Updated on Jun 2, 2023


Updated on Jun 2, 2023

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.