Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/140561
Title: Detecting gaze interaction in video sequences
Authors: Xu, Siyuan
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2020
Publisher: Nanyang Technological University
Project: ISM-DISS-01954
Abstract: The research about exploring the interaction of human action has been popular in the field of computer vision. Specially, detecting whether people are looking at each other offers great help to figure out the relationship between people in video sequences. In this dissertation, our first method is LAEO-Net with slightly change to fit in our dataset’s meeting environment, including head detection, track of head position and final bin-classification. It is made up of three branches, two of them employ 3D convolutional layers to extract the characteristic and the other applies 2D convolutional layers for head relative position. Besides, we propose another method to do the auxiliary determination. It can be divided in three different mathematical models based on the multi-loss head pose estimation. Three Euler angels presenting head pose are obtained by the network separately, in order to improve the accuracy of the final results. In the part of evaluation, we choose UCO-LAEO and AVA-LAEO datasets to do the training and compare above methods on TVHID dataset and do the analysis according to respective advantages and weakness.
URI: https://hdl.handle.net/10356/140561
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Theses

Files in This Item:
File Description SizeFormat 
XU SIYUAN--Dissertation-Final Version.pdf
  Restricted Access
1.74 MBAdobe PDFView/Open

Page view(s)

172
Updated on Jan 28, 2023

Download(s)

3
Updated on Jan 28, 2023

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.