Proceedings

Diversity Regularized Machine

Yang Yu, Yu-Feng Li, Zhi-Hua Zhou

Download BibTeX Cite

Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence. Pages 1603-1607.

https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-269

Abstract

Ensemble methods, which train multiple learners for a task, are among the state-of-the-art learning approaches. The diversity of the component learners has been recognized as a key to a good ensemble, and existing ensemble methods try different ways to encourage diversity, mostly by heuristics. In this paper, we propose the diversity regularized machine (DRM) in a mathematical programming framework, which efficiently generates an ensemble of diverse support vector machines (SVMs). Theoretical analysis discloses that the diversity constraint used in DRM can lead to an effective reduction on its hypothesis space complexity, implying that the diversity control in ensemble methods indeed plays a role of regularization as in popular statistical learning approaches. Experiments show that DRM can significantly improve generalization ability and is superior to some state-of-the-art SVM ensemble methods.

Yang Yu, Yu-Feng Li, and Zhi-Hua Zhou. 2011. Diversity Regularized Machine. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI-11. IJCAI, 1603–1607. https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-269
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards