Please use this identifier to cite or link to this item:
Title: AI-based indoor human gesture recognition using FMCW radar
Authors: Liu, Boya
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Liu, B. (2022). AI-based indoor human gesture recognition using FMCW radar. Master's thesis, Nanyang Technological University, Singapore.
Abstract: Human gesture recognition is an emerging necessity of in the industry. How- ever, traditional Computer Vision, which typically uses optical sensors, often fails in this task, due to unstable light conditions and possible blockages. Radar- based sensors, however, are able to detect an object in low-light conditions, as well as penetrate through blockages. Therefore, in this project, we focus on radar-based gesture recognition. We used TI’s AW1642 FMCW radar to collect data from three volunteers, per- forming 7 common gestures in an indoor laboratory setting. A preprocessing pipeline was built to generate Micro-Doppler heatmaps, which describes the mo- tion of different part of human body. These are fed into our carefully-designed deep neural networks to perform gesture classification. We are able to achieve an average accuracy of 82.13% for the 7-gesture classification. However, there remains an important need to generalize the solution, i.e., to achieve good performance on people not seen in the training set. In our ex- periments, we found the gaps in the same gestures of different people. We proposed to solve this using domain adversarial training. This allows us to ex- tract person/domain-independent features. When testing with unseen individuals, we are able to improve the accuracy by over 8% for 7-gesture classification. Keywords: radar, FMCW radar, Deep-learning, Micro-Doppler, Gesture Classifi- cation, Domain Adaptation
Schools: School of Electrical and Electronic Engineering 
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Theses

Files in This Item:
File Description SizeFormat 
  Restricted Access
7.09 MBAdobe PDFView/Open

Page view(s)

Updated on Sep 21, 2023


Updated on Sep 21, 2023

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.