Proceedings

Multi Class Learning with Individual Sparsity

Ben Zion Vatashsky, Koby Crammer

Download BibTeX Cite

Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. Pages 1729-1734.

Abstract

Multi class problems are everywhere. Given an input the goal is to predict one of a few possible classes. Most previous work reduced learning to minimizing the empirical loss over some training set and an additional regularization term, prompting simple models or some other prior knowledge. Many learning regularizations promote sparsity, that is, small models or small number of features, as performed in group LASSO. Yet, such models do not always represent the classes well. In some problems, for each class, there is a small set of features that represents it well, yet the union of these sets is not small. We propose to use other regularizations that promote this type of sparsity, analyze the generalization property of such formulations, and show empirically that indeed, these regularizations not only perform well, but also promote such sparsity structure.

Ben Zion Vatashsky, and Koby Crammer. 2013. Multi Class Learning with Individual Sparsity. In Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence, IJCAI-13. IJCAI, 1729–1734. https://ijcai.org/proceedings/2013/256
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards