Please use this identifier to cite or link to this item:
Title: Heterogeneous oblique random forest
Authors: Katuwal, Rakesh
Suganthan, Ponnuthurai Nagaratnam
Zhang, Le
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2019
Source: Katuwal, R, Suganthan, P. N., & Zhang, Le. (2019). Heterogeneous oblique random forest. Pattern Recognition, 99, 107078-. doi:10.1016/j.patcog.2019.107078
Journal: Pattern Recognition
Abstract: Decision trees in random forests use a single feature in non-leaf nodes to split the data. Such splitting results in axis-parallel decision boundaries which may fail to exploit the geometric structure in the data. In oblique decision trees, an oblique hyperplane is employed instead of an axis-parallel hyperplane. Trees with such hyperplanes can better exploit the geometric structure to increase the accuracy of the trees and reduce the depth. The present realizations of oblique decision trees do not evaluate many promising oblique splits to select the best. In this paper, we propose a random forest of heterogeneous oblique decision trees that employ several linear classifiers at each non-leaf node on some top ranked partitions which are obtained via one-vs-all and two-hyperclasses based approaches and ranked based on ideal Gini scores and cluster separability. The oblique hyperplane that optimizes the impurity criterion is then selected as the splitting hyperplane for that node. We benchmark 190 classifiers on 121 UCI datasets. The results show that the oblique random forests proposed in this paper are the top 3 ranked classifiers with the heterogeneous oblique random forest being statistically better than all 189 classifiers in the literature.
ISSN: 0031-3203
DOI: 10.1016/j.patcog.2019.107078
Rights: © 2019 Elsevier Ltd. All rights reserved. This paper was published in Pattern Recognition and is made available with permission of Elsevier Ltd.
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:EEE Journal Articles

Files in This Item:
File Description SizeFormat 
Heterogeneous Oblique Random Forest.pdf610.76 kBAdobe PDFView/Open

Citations 20

Updated on Mar 2, 2021

Citations 20

Updated on Mar 5, 2021

Page view(s)

Updated on Jan 16, 2022

Download(s) 50

Updated on Jan 16, 2022

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.