Please use this identifier to cite or link to this item:
Title: Oblique decision tree ensemble via twin bounded SVM
Authors: Ganaie, M. A.
Tanveer, M.
Suganthan, Ponnuthurai Nagaratnam
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2020
Source: Ganaie, M. A., Tanveer, M. & Suganthan, P. N. (2020). Oblique decision tree ensemble via twin bounded SVM. Expert Systems With Applications, 143, 113072-.
Journal: Expert Systems with Applications
Abstract: Ensemble methods with “perturb and combine” strategy have shown improved performance in the classification problems. Recently, random forest algorithm was ranked one among 179 classifiers evaluated on 121 UCI datasets. Motivated by this, we propose a new approach for the generation of oblique decision trees. At each non-leaf node, the training data samples are grouped in two categories based on the Bhattachrayya distance with randomly selected feature subset. Then, twin bounded support vector machine (TBSVM) is used to get two clustering hyperplanes such that each hyperplane is closer to data points of one group and as far as possible from the data points of other group. Based on these hyperplanes, each non-leaf node is splitted to generate the decision tree. In this paper, we used different base models like random forest (RaF), rotation forest (RoF), random sub rotation forest (RRoF) to generate the different oblique decision tree forests named as TBRaF, TBRoF and TBRRoF, respectively. In earlier oblique decision trees, like multisurface proximal support vector machine (MPSVM) based oblique decision trees, matrices are semi-positive definite and hence different regularization methods are required. However, no explicit regularization techniques need to be applied to the primal problems as the matrices in the proposed TBRaF, TBRoF and TBRRoF are positive definite. We evaluated the performance of the proposed models (TBRaF, TBRoF and TBRRoF) on 49 datasets taken from the UCI repository and on some real-world biological datasets (not in UCI). The experimental results and statistical tests conducted show that TBRaF and TBRRoF outperform other baseline methods.
ISSN: 0957-4174
DOI: 10.1016/j.eswa.2019.113072
Schools: School of Electrical and Electronic Engineering 
Rights: © 2019 Elsevier Ltd. All rights reserved.
Fulltext Permission: none
Fulltext Availability: No Fulltext
Appears in Collections:EEE Journal Articles

Citations 10

Updated on Jul 21, 2024

Web of ScienceTM
Citations 10

Updated on Oct 29, 2023

Page view(s)

Updated on Jul 22, 2024

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.