Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/76918
Title: Autonomous learning machine on online big data analytics
Authors: Lim, Yan Jun
Keywords: DRNTU::Engineering::Computer science and engineering
Issue Date: 2019
Publisher: Nanyang Technological University
Abstract: The term “Big Data” refers to a proportion of dataset, which does not allow existing database management tools to retrieve, store, handle and analyze. Although the big data is often affiliated with the topic of volume, researchers in the field have found that it is inherent to other 4Vs: Variety, Velocity, Veracity, Velocity, etc. Different data analytic tools have been suggested. One commonly and widely used approach is the so-called MapReduce from Google. Nevertheless, most of existing works are offline in nature, because it expects full access of complete dataset and enable a machine learning algorithm to achieve multiple passes over all data. In this project, an online parallelization technique is developed, with integration of an Autonomous Learning Machine (ALMA). In addition, a data fusion technique is also developed, which will merge the product of ALMA from different parallelized data partitions. Both techniques are developed using R programming in the RStudio environment, and Apache Spark.
URI: http://hdl.handle.net/10356/76918
Rights: Nanyang Technological University
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
AMENDED_FYP REPORT YANJUN.pdf
  Restricted Access
857.55 kBAdobe PDFView/Open

Page view(s)

151
Updated on Oct 15, 2021

Download(s) 50

28
Updated on Oct 15, 2021

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.