Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/81712
Title: Combating Negative Transfer From Predictive Distribution Differences
Authors: Seah, Chun-Wei
Ong, Yew-Soon
Tsang, Ivor W.
Keywords: Domain adaptation (DA); logistic regression (LR); negative transfer; predictive distribution matching (PDM); support vector machines (SVMs)
Issue Date: 2012
Source: Seah, C.-W., Ong, Y.-S., & Tsang, I. W. (2013). Combating Negative Transfer From Predictive Distribution Differences. IEEE Transactions on Cybernetics, 43(4), 1153-1165.
Series/Report no.: IEEE Transactions on Cybernetics
Abstract: Domain adaptation (DA), which leverages labeled data from related source domains, comes in handy when the label information of the target domain is scarce or unavailable. However, as the source data do not come from the same origin as that of the target domain, the predictive distributions of the source and target domains are likely to differ in reality. At the extreme, the predictive distributions of the source domains can differ completely from that of the target domain. In such case, using the learned source classifier to assist in the prediction of target data can result in prediction performance that is poorer than that with the omission of the source data. This phenomenon is established as negative transfer with impact known to be more severe in the multiclass context. To combat negative transfer due to differing predictive distributions across domains, we first introduce the notion of positive transferability for the assessment of synergy between the source and target domains in their prediction models, and we also propose a criterion to measure the positive transferability between sample pairs of different domains in terms of their prediction distributions. With the new measure, a predictive distribution matching (PDM) regularizer and a PDM framework learn the target classifier by favoring source data with large positive transferability while inferring the labels of target unlabeled data. Extensive experiments are conducted to validate the performance efficacy of the proposed PDM framework using several commonly used multidomain benchmark data sets, including Sentiment, Reuters, and Newsgroup, in the context of both binary-class and multiclass domains. Subsequently, the PDM framework is put to work on a real-world scenario pertaining to water cluster molecule identification. The experimental results illustrate the adverse impact of negative transfer on several state-of-the-art DA methods, whereas the proposed framework exhibits excellent and robust predicti- e performances.
URI: https://hdl.handle.net/10356/81712
http://hdl.handle.net/10220/39657
ISSN: 2168-2267
DOI: 10.1109/TSMCB.2012.2225102
Rights: © 2012 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: [http://dx.doi.org/10.1109/TSMCB.2012.2225102].
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Journal Articles

Files in This Item:
File Description SizeFormat 
Combating Negative Transfer From Predictive0.pdf881.3 kBAdobe PDFThumbnail
View/Open

Google ScholarTM

Check

Altmetric


Plumx

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.