Please use this identifier to cite or link to this item:
Title: Gait recognition by dynamic vision sensor and deep neural network
Authors: Ng, Noah Winston
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Ng, N. W. (2022). Gait recognition by dynamic vision sensor and deep neural network. Final Year Project (FYP), Nanyang Technological University, Singapore.
Project: A2035-211
Abstract: Gait recognition is a study about identifying an individual by the pattern of walking. In this project, we explored the application of Dynamic Vision Sensor (DVS) event- based data on capturing gait movement and the Deep Learning approach for the gait recognition task. DVS has a different approach to capturing a gait movement compared to the commonly used RGB sensors. Instead of capturing an image as a frame by RGB camera, DVS captures gait movement as asynchronous events when there are changes in intensity. DVS offers several benefits compared to RGB sensors such as the ability to capture movement in microseconds, lower consumption in resources, and larger dynamic range. On the other hand, the DVS sensor is sensitive to noise, hence reducing noise events. Moreover, the deep learning approach, specifically the convolutional neural network has been proven successful in the image recognition task. The main objective of this project is to build and evaluate the performance of a gait recognition task by a Deep Neural Network (DNN) using event-based data collected from DVS. We used an event- based DVS128-Gait dataset. The DNN is expected to identify a person’s gait using event-based data produced by DVS. In this project, we establish a data pre- processing method to reduce noise from the DVS camera and transform event-based data into a suitable data representation format for deep learning purposes. We will study the effect of noise filter for event-based data, and the difference in data representation to the performance of the deep neural network. Additionally, we will explore the effect of modification of deep neural network training configurations on its performance for the gait recognition task. Finally, we performed model performance benchmarking with different king of popular CNN architecture.
Schools: School of Electrical and Electronic Engineering 
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
FYP Final Report (A2035-211) - Noah Winston Ng .pdf
  Restricted Access
2.35 MBAdobe PDFView/Open

Page view(s)

Updated on Sep 21, 2023


Updated on Sep 21, 2023

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.