Please use this identifier to cite or link to this item:
Title: Visual relationship detection
Authors: Park, Kunyoung
Keywords: Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Park, K. (2022). Visual relationship detection. Final Year Project (FYP), Nanyang Technological University, Singapore.
Project: SCSE21-0518
Abstract: Visual relationship detection is the process of pairing the objects in the image and identifying the relationships between the objects in the form of “object-predicate-object”, such as “person riding bike”. Although there had been many attempts to develop visual relationship detection, most may not provide useful information about the image due to biasedness. For instance, predicates made by biased scene graph generation (SGG) such as “on” and “next to” do not provide useful information about the image as compared to predicates generated by unbiased SGG, such as “sitting on” and “in front of”. In this project, Total Direct Effect (TDE) in causal inference with counterfactual thinking method was explored and adopted on SGG to remove the biasedness. This implementation had shown significant improvement of accuracy measured with Mean Recall@K (mR@K) metric used in this project. The results of the visual relationship detection were also visualised and analysed.
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
FYP Report (Park Kunyoung).pdf
  Restricted Access
989.23 kBAdobe PDFView/Open

Page view(s)

Updated on May 20, 2022


Updated on May 20, 2022

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.