Please use this identifier to cite or link to this item:
|Title:||An information theoretic kernel algorithm for robust online learning||Authors:||Fan, Haijin
|Keywords:||DRNTU::Engineering::Electrical and electronic engineering||Issue Date:||2012||Source:||Fan, H., Song, Q.,& Xu, Z. (2012). An information theoretic kernel algorithm for robust online learning. The 2012 International Joint Conference on Neural Networks (IJCNN).||Abstract:||Kernel methods are widely used in nonlinear modeling applications. In this paper, a robust information theoretic sparse kernel algorithm is proposed for online learning. In order to reduce the computational cost and make the algorithm suitable for online applications, we investigate an information theoretic sparsification rule based on the mutual information between the system input and output to determine the update of the dictionary (support vectors). According to the rule, only novel and informative samples are selected to form a sparse and compact dictionary. Furthermore, to improve the generalization ability, a robust learning scheme is proposed to avoid the algorithm over learning the redundant samples, which assures the convergence of the learning algorithm and makes the learning algorithm converge to its steady state much faster. Experiment are conducted on practical and simulated data and results are shown to validate the effectiveness of our proposed algorithm.||URI:||https://hdl.handle.net/10356/98221
|DOI:||http://dx.doi.org/10.1109/IJCNN.2012.6252837||Rights:||© 2012 IEEE.||Fulltext Permission:||none||Fulltext Availability:||No Fulltext|
|Appears in Collections:||EEE Conference Papers|
Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.