Proceedings

Multi-View Discriminant Transfer Learning

Download BibTeX Cite

Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. Pages 1848-1853.

© 2013 International Joint Conferences on Artificial Intelligence

Abstract

We study to incorporate multiple views of data in a perceptive transfer learning framework and propose a Multi-view Discriminant Transfer (MDT) learning approach for domain adaptation. The main idea is to find the optimal discriminant weight vectors for each view such that the correlation between the two-view projected data is maximized, while both the domain discrepancy and the view disagreement are minimized simultaneously. Furthermore, we analyze MDT theoretically from discriminant analysis perspective to explain the condition and reason, under which the proposed method is not applicable. The analytical results allow us to investigate whether there exist within-view and/or between-view conflicts, and thus provides a deep insight into whether the transfer learning algorithm work properly or not in the view-based problems and the combined learning problem. Experiments show that MDT significantly outperforms the state-of-the-art baselines including some typical multi-view learning approaches in single- or cross-domain.

  1. [Abney, 2002] Steven Abney. Bootstrapping. In Proceedings of ACL, pages 360-367, 2002.
  2. [Belhumeur et al., 1997] P. N. Belhumeur, J. P. Hespanha, D. J. Kriegman. Eigenfaces vs. Fisherfaces: Recognition Us- ing Class Specific Linear Projection. IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI), 19(7):711- 720, 1997.
  3. [Blitzer et al., 2011] John Blitzer, Sham Kakade and Dean P. Foster. Domain Adaptation with Coupled Subspaces. In Proceedings of AISTATS, pages 173-181, 2011.
  4. [Blum and Mitchell, 1998] Avrim Blum and Tom Mitchell. Combining Labeled and Unlabeled Data with Co- Training. In Proceedings of COLT, pages 92-100, 1998.
  5. [Cao et al., 2010] Bin Cao, Sinno Jialin Pan, Yu Zhang, Dit- Yan Yeung, and Qiang Yang. Adaptive transfer learning. In Proceedings of AAAI, 2010.
  6. [Chen et al., 2011] Minmin Chen, Killian Q. Weinberger and John Blitzer. Co-Training for Domain Adaptation. In Pro- ceedings of NIPS, pages 1-9, 2011.
  7. [Collins and Singer, 1999] M. Collins and Y. Singer. Unsu- pervised Models for Named Entity Classification. In Pro- ceedings of EMNLP, pages 100-110, 1999.
  8. [Dasgupta et al., 2001] Sanjoy Dasgupta, Michael L. Littman and David McAllester. PAC Generalization Bounds for Co-Training. In Proceedings of NIPS, pages 375-382, 2001.
  9. [Diethe et al., 2008] Tom Diethe, David R. Hardoon and John Shawe-Taylor. Multiview Fisher Discriminant Anal- ysis. In Proceedings of NIPS Workshop on Learning from Multiple Sources, 2008.
  10. [Duda et al., 2001] R.O. Duda, P.E. Hart, and D.G. Stock. Pattern Classification, second ed. Wiley, 2001.
  11. [Fisher, 1938] R.A. Fisher. The Statistical Utilization of Multiple Measurement. Annals of Eugenics, vol.8, pages 376-386, 1938.
  12. [Gao et al., 2010] Wei Gao, Peng Cai, Kam-Fai Wong, Aoy- ing Zhou. Learning to Rank only using Training Data from related Domain. In Proceedings of SIGIR, pages 162-169, 2010.
  13. [Huang et al., 2006] Jiayuan Huang, Alexander J. Smola, Arthur Gretton, Karsten M. Borgwardt, Bernhard Schölkopf. Correcting Sample Selection Bias by Unla- beled Data. In Proceedings of NIPS, pages 601-608, 2006.
  14. [Joachims, 1999] Thorsten Joachims. Transductive Infer- ence for Text Classification using Support Vector Ma- chines. In Proceedings of ICML, pages 200-209, 1999.
  15. [Martínez and Zhu, 2005] Aleix M. Martínez, Manli Zhu. Where Are Linear Feature Extraction Methods Applica- ble? IEEE Trans. Pattern Analysis and Machine Intelli- gence (PAMI), 27(12):1934-1944, 2005.
  16. [McCallum et al., 2000] Andrew K. McCallum, Kamal Nigam, Jason Rennie and Kristie Seymore. Automating the Construction of Internet Portals with Machine Learn- ing. Information Retrieval, 3(2):127-163, 2000.
  17. [Melzer et al., 2003] Thomas Melzer, Michael Reiter, Horst Bischof. Appearance Models based on Kernel Canon- ical Correlation Analysis. Pattern Recognition (PR), 36(9):1961-1971, 2003.
  18. [Mika et al., 2001] Sebastian Mika, Alexander Smola, Bern- hard Schölkopf. An Improved Training Algorithm for Kernel Fisher Discriminants. In Proceedings of AISTATS, 2001.
  19. [Pan and Yang, 2010] Sinno J. Pan and Qiang Yang. A Sur- vey on Transfer Learning. IEEE Transactions on Knowl- edge and Data Engineering, 22(10):1345-1359, 2010.
  20. [Pan et al., 2011] Sinno Jialin Pan, Ivor W. Tsang, James T. Kwok, Qiang Yang. Domain Adaptation via Transfer Component Analysis. IEEE Transactions on Neural Net- works (TNN), 22(2):199-210, 2011. IJCAI
  21. [Pan et al., 2010] Weike Pan, Evan Wei Xiang, Nathan Nan Liu, Qiang Yang. Transfer Learning in Collaborative Fil- tering for Sparsity Reduction. In Proceedings of AAAI, pages 230-235, 2010.
  22. [Quanz and Huan, 2009] Brian Quanz and Jun Huan. Large Margin Transductive Transfer Learning. In Proceedings of CIKM, pages 1327-1336, 2009.
  23. [Rüping and Scheffer, 2005] Stephan Rüping and Tobias Scheffer. Learning with Multiple Views. In Proceedings of ICML Workshop on Learning with Multiple Views, 2005.
  24. [Salton and Buckley, 1988] G. Salton and C. Buckley. Term- weighting Approaches in Automatic Text Retrieval. Infor- mation Processing & Management, 24(5):513-523, 1988.
  25. [Sarinnapakorn and Kubat, 2007] Kanoksri Sarinnapakorn and Miroslav Kubat. Combining Sub-classifiers in Text Categorization: A DST-Based Solution and a Case Study. IEEE Transactions Knowledge and Data Engineering, 19(12):1638-1651, 2007.
  26. [Yao and Doretto, 2010] Yi Yao and Gianfranco Doretto. Boosting for transfer learning with multiple sources. In Proceedings of CVPR, pages 1855-1862, 2010.
  27. [Zhang et al., 2011] Dan Zhang, Jingrui He, Yan Liu, Luo Si and Richard D. Lawrence. Multi-view Transfer Learning with a Large Margin Approach. In Proceedings of KDD, pages 1208-1216, 2011.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards