Please use this identifier to cite or link to this item:
https://hdl.handle.net/10356/17010
Title: | Data stream mining | Authors: | Wan, Li | Keywords: | DRNTU::Engineering::Computer science and engineering::Information systems::Database management | Issue Date: | 2009 | Abstract: | The data stream mining problem has been studied extensively in recent years, due to the greatease in collection of stream data. The essential to a data stream mining algorithms is that we can only read data once. Unfortunately, most of traditional data mining algorithms do not have such single-scan property. Usually, data stream is considered as semi-in¯nite. It is impossible to store all the past data with limited resources. Thus, mining high dimensional data streams is a challenging task. In this report, we are going to propose some interesting observations on feature quality stream(FQS), which is obtained from data stream in real time, and a frame- work to analyze such stream. The analysis results of FQS are used to reduce the dimension of data streams. We will also propose a data stream mining framework called MR-Stream. It is a e±cient data stream clustering framework with the following properties: (1) computes and updates synopsis information in constant time; (2) allows users to discover clusters at multiple resolutions; (3) determines the right time for users to generate clusters from the synopsis in- formation; (4) generates clusters of higher purity than existing algorithms; and (5) determines the right threshold function for density-based clustering based on the fading model of stream data. MR-Stream can be extend to solve classi¯cation problem. The classi¯cation results ob- tained from the online component of MR-Stream framework are in realtime. The result given by MR-Stream is presented as a probability distribution table over di®erent classes. | URI: | http://hdl.handle.net/10356/17010 | Schools: | School of Computer Engineering | Research Centres: | Centre for Advanced Information Systems | Rights: | Nanyang Technological University | Fulltext Permission: | restricted | Fulltext Availability: | With Fulltext |
Appears in Collections: | SCSE Student Reports (FYP/IA/PA/PI) |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Wan Li 09.pdf Restricted Access | 918.19 kB | Adobe PDF | View/Open |
Page view(s) 50
505
Updated on Mar 27, 2024
Download(s)
7
Updated on Mar 27, 2024
Google ScholarTM
Check
Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.