Please use this identifier to cite or link to this item:
Full metadata record
DC FieldValueLanguage
dc.contributor.authorBharadwaja, Tanayen_US
dc.identifier.citationBharadwaja, T. (2022). Graph attention networks and approximate personalized propagation of neural prediction models for unsupervised graph representation learning. Final Year Project (FYP), Nanyang Technological University, Singapore.
dc.description.abstractRecent years have brought progress in the graph machine learning space, with the unsupervised graph representation learning field gaining traction due to the immense resources required to label graph data. A leading approach in the field, Deep Graph InfoMax, has been shown to provide good performance in training Graph Convolutional Networks (GCNs) for the task in an unsupervised manner suing mutual information. In this paper, we proposed the novel approach of using Graph Attention Networks (GATs) and Approximate Personalized Propagation of Neural Prediction (APPNP) models trained with the Deep Graph InfoMax training method. We tested the transductively trained models on three challenging graph benchmarks and used a small training sample along with a Logistic Regression classifier to evaluate the quality of the representations generated. GAT models showed good performance and were able to attain a similar accuracy to GCN-based approaches. However, APPNP models were not able to learn well from the Deep Graph InfoMax training method, with lacklustre performance. The success of the GAT models solidifies the theory behind the training method, and we suggest that more developments on GAT variants suited to Deep Graph InfoMax be done to bring better learning through mutual information. On the other hand, the APPNP models require further improvements to be trained with mutual information for arbitrary graphs. Increased computing power to tackle larger benchmarks would also prove to be useful for the graph representation learning task.en_US
dc.publisherNanyang Technological Universityen_US
dc.subjectEngineering::Computer science and engineeringen_US
dc.titleGraph attention networks and approximate personalized propagation of neural prediction models for unsupervised graph representation learningen_US
dc.typeFinal Year Project (FYP)en_US
dc.contributor.supervisorKe Yiping, Kellyen_US
dc.contributor.schoolSchool of Computer Science and Engineeringen_US
dc.description.degreeBachelor of Science in Data Science and Artificial Intelligenceen_US
item.fulltextWith Fulltext-
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)
Files in This Item:
File Description SizeFormat 
  Restricted Access
8.08 MBAdobe PDFView/Open

Page view(s)

Updated on Jun 29, 2022


Updated on Jun 29, 2022

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.