Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/40791
Title: Efficient clustering algorithm for large datasets
Authors: Chen, Fangying.
Keywords: DRNTU::Engineering::Electrical and electronic engineering::Computer hardware, software and systems
Issue Date: 2010
Abstract: Clustering, in data mining, is useful for identifying interesting distributions and discovering groups in the underlying data. Traditional clustering algorithms either favor clusters with similar sizes and spherical shapes, or are very sensitive to outliers. These shortcomings are alleviated in a novel algorithm called CURE which was proposed by some researchers. CURE achieves the improvement by representing each cluster with a constant number of well-scattered points from the cluster and then shrinking them toward the center of the cluster by a specified fraction. In an effort to keep up with the rapid growth in the size of databases, CURE incorporates two techniques, random sampling and partitioning, to cope with large datasets. The tenet of both techniques is to reduce the input size to clustering process in order to fit in the main memory. Nowadays, high dimensional data is commonly found in a wide range of real-life applications, like web documents, transaction data and gene expression data. There is an urge for efficient high dimensional data clustering. In this Final Year Project, CURE algorithm is first implemented for low dimensional data with Java programming language. The program is tested on sample datasets. A series of simulations with different parameter settings are carried out and a parameter sensitivity analysis is performed. After being verified on low dimensional data, the program is modified to deal with high dimensional data. Later, the modified program is tested on high dimensional sample datasets and a parameter analysis is performed as well. The objective of this project is to implement CURE using Java. The implementation details, the testing results and performance evaluation are reported.
URI: http://hdl.handle.net/10356/40791
Rights: Nanyang Technological University
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
eA3233-091.pdf
  Restricted Access
2.08 MBAdobe PDFView/Open

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.