Please use this identifier to cite or link to this item:
Title: Development of gesture control of robotic arm/robotic structures for assistive systems
Authors: Tan, Yi Ming
Keywords: Engineering::Electrical and electronic engineering::Computer hardware, software and systems
Issue Date: 2021
Publisher: Nanyang Technological University
Source: Tan, Y. M. (2021). Development of gesture control of robotic arm/robotic structures for assistive systems. Final Year Project (FYP), Nanyang Technological University, Singapore.
Abstract: The development and use of collaborative robots have been on the rise in recent years, enabling humans to perform tasks with precision and ability that would otherwise be humanly impossible. Many of such robotic applications and studies conducted were to simplify or automate work processes and reduce the workload of general, able-bodied users. Little research and work were done to investigate the possibilities of new interfaces which allow users with physical limitations to interact and control robotic systems. This project proposes a method for interaction making use of a Leap Motion Controller, an LSTM machine learning model, and a Niryo Ned robotic arm. The Leap Motion Controller, an optical hand tracking module was used to read and return data of hands and fingers detected. An LSTM model was trained to classify and recognize a set of 9 different gestures and the classified gestures are then used to control a robotic arm. The final trained LSTM model was able to achieve an F-score of 92% when evaluated against a test set of 9 gestures. After, it was successfully integrated and implemented with a Niryo Ned robotic arm which was tasked to perform 8 actions. The development of this system would be beneficial especially in the field of assistive technology, giving individuals with physical limitations and disabilities ways to overcome their limitations, enabling them to live independently in this world that is largely catered to the able-bodied majority.
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
U1821492H_TAN YI MING_FYP Final Report.pdf
  Restricted Access
1.18 MBAdobe PDFView/Open

Page view(s)

Updated on Jan 20, 2022


Updated on Jan 20, 2022

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.