Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/156153
Full metadata record
DC FieldValueLanguage
dc.contributor.authorWei, Zhifengen_US
dc.date.accessioned2022-04-05T05:41:43Z-
dc.date.available2022-04-05T05:41:43Z-
dc.date.issued2021-
dc.identifier.citationWei, Z. (2021). Online news analytics based on AI techniques. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/156153en_US
dc.identifier.urihttps://hdl.handle.net/10356/156153-
dc.description.abstractText classification is an important technique in the field of Natural Language Processing (NLP). Using this technology, we can efficiently extract the types of text materials that we are interested in from massive texts, which can greatly improve the efficiency of our work and facilitate our lives. This Dissertation focus on the news classification task of natural disasters. First of all, a news data set with nearly 2000 articles is collected. Then, different Text Representation methods such as Bag of words (BOW), term frequency–inverse document frequency (TF-IDF) and Latent Dirichlet Allocation (LDA) are tested using different classifiers and their classification performance are compared. After that, some deep learning neural network such as CNN, LSTM and Transformer are used to perform classification tasks on the data set collected before and the classification performance of these models are compared. At the same time, the performance of the randomly initialized Word Embeddings, Word2vec, Glove, and Bert pre-trained models on this data set are analyzed and compared. This Dissertation uses python3 and Pytorch deep learning framework for experimental demonstration. Accuracy, precision, recall and f1 score are used as evaluation criteria. The demonstration results show that the Transformer model and the Bert pre-trained model are slightly better than other models for classification tasks on the dataset collected in this dissertation.en_US
dc.language.isoenen_US
dc.publisherNanyang Technological Universityen_US
dc.subjectEngineering::Electrical and electronic engineering::Computer hardware, software and systemsen_US
dc.titleOnline news analytics based on AI techniquesen_US
dc.typeThesis-Master by Courseworken_US
dc.contributor.supervisorMao Kezhien_US
dc.contributor.schoolSchool of Electrical and Electronic Engineeringen_US
dc.description.degreeMaster of Science (Signal Processing)en_US
dc.contributor.supervisoremailEKZMao@ntu.edu.sgen_US
item.grantfulltextrestricted-
item.fulltextWith Fulltext-
Appears in Collections:EEE Theses
Files in This Item:
File Description SizeFormat 
MSc_Dissertation_FianlVersion1.pdf
  Restricted Access
4.5 MBAdobe PDFView/Open

Page view(s)

56
Updated on Jun 28, 2022

Download(s)

7
Updated on Jun 28, 2022

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.