Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/72828
Title: Tools for analysis of large-scale networks (I) algorithms, analytics and visualization
Authors: Zhang, Xinyi
Keywords: DRNTU::Engineering::Computer science and engineering
Issue Date: 2017
Abstract: Rapid development in social network Internet application have led to unprecedented increase in the size and quality of datasets. Developing a tool which can be used in analysing large scale network can indeed make our life much easier and contribute to data analytic. This project aimed to continue to work onto the large scaled analyzation tool that is developed by the previous student, Chua Chee Ann. In the previous tool, many basic analytical functions such as data search, topic modelling on the retrieved data and graphic user interface has been implemented successfully. Among all the social media sites, Twitter was chosen and 16.5GB raw tweets was used as the dataset in this project. In this project, 2 approaches have been taken to improve the overall performance of this tool. Firstly, existing data structure-grid file has been analysed and implemented onto the dataset, which proven to be effectively improve the query time of different type of queries. Secondly, multiprocessing has been implemented in this project to improve the efficiency of the data processing time specifically on Topic Modelling function.
URI: http://hdl.handle.net/10356/72828
Rights: Nanyang Technological University
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
Final Year Project Report.pdf
  Restricted Access
1.89 MBAdobe PDFView/Open

Page view(s)

110
Updated on Nov 30, 2020

Download(s)

28
Updated on Nov 30, 2020

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.