Proceedings

Efficient Generalized Conditional Gradient with Gradient Sliding for Composite Optimization

Yiu-ming Cheung, Jian Lou

Download BibTeX Cite

Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence. Special Track on Machine Learning. Pages 3409-3414.

Abstract

Generalized conditional gradient method has regained increasing research interest as an alternative to another popular proximal gradient method for sparse optimization problems. For particular tasks, its low computation cost of linear subproblem evaluation on each iteration leads to superior practical performance. However, the inferior iteration complexity incurs excess number of gradient evaluations, which can counteract the efficiency gained by solving low cost linear subproblem. In this paper, we therefore propose a novel algorithm that requires optimal graduate evaluations as proximal gradient. We also present a refined variant for a type of gauge regularized problem where approximation techniques are allowed to further accelerate linear subproblem computation. Experiments of CUR-like matrix factorization problem with group lasso penalty on four real-world datasets demonstrate the efficiency of the proposed method.

Yiu-ming Cheung, and Jian Lou. 2015. Efficient Generalized Conditional Gradient with Gradient Sliding for Composite Optimization. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI-15. IJCAI, 3409–3414. https://ijcai.org/proceedings/2015/480
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards