{"type":"ScholarlyArticle","title":"Self-Paced Multitask Learning with Shared Knowledge","authors":[{"name":"Keerthiram Murugesan","slug":"keerthiram-murugesan","given":"Keerthiram","family":"Murugesan","affiliation":"Carnegie Mellon University , Pittsburgh , PA , USA"},{"name":"Jaime Carbonell","slug":"jaime-carbonell","given":"Jaime","family":"Carbonell","affiliation":"Carnegie Mellon University , Pittsburgh , PA , USA"}],"abstract":"This paper introduces self-paced task selection to multitask learning, where instances from more closely related tasks are selected in a progression of easier-to-harder tasks, to emulate an effective human education strategy, but applied to multitask machine learning. We develop the mathematical foundation for the approach based on iterative selection of the most appropriate task, learning the task parameters, and updating the shared knowledge, optimizing a new bi-convex loss function.  This proposed method applies quite generally, including to multitask feature learning, multitask learning with alternating structure optimization, etc. Results show that in each of the above formulations self-paced (easier-to-harder) task selection outperforms the baseline version of these methods in all the experiments.","doi":"10.24963/ijcai.2017/351","url":"https://ijcai.org/proceedings/2017/351","pdf":"https://ijcai.org/proceedings/2017/0351.pdf","markdown":"https://ijcai.org/proceedings/2017/351.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/351","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Machine Learning A-R","track":"Main track","number":351,"pages":{"first":2522,"last":2528},"keywords":["Machine Learning: Transfer, Adaptation, Multi-task Learning","Machine Learning: Feature Selection/Construction"],"videos":[],"references":[{"position":1,"raw":"[Agarwal et al., 2010] Arvind Agarwal, Samuel Gerber, and Hal Daume. Learning multiple tasks using manifold regu- larization. In Advances in neural information processing systems, pages 46-54, 2010.","title":"Learning multiple tasks using manifold regularization","authors":"Arvind Agarwal, Samuel Gerber, Hal Daume","year":"2010","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Ando and Zhang, 2005] Rie Kubota Ando and Tong Zhang. A framework for learning predictive structures from multi- ple tasks and unlabeled data. Journal of Machine Learning Research, 6(Nov):1817-1853, 2005.","title":"A framework for learning predictive structures from multiple tasks and unlabeled data","authors":"Rie Kubota, Ando, Tong Zhang","year":"2005","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Argyriou et al., 2008] Andreas Argyriou, Theodoros Evge- niou, and Massimiliano Pontil. Convex multi-task feature learning. Machine Learning, 73(3):243-272, 2008.","title":"Convex multi-task feature learning","authors":"Andreas Argyriou, Theodoros Evgeniou, Massimiliano Pontil","year":"2008","venue":"Machine Learning","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Baxter and others, 2000] Jonathan Baxter et al. A model of inductive bias learning. J. Artif. Intell. Res.(JAIR), 12(149- 198):3, 2000.","title":"A model of inductive bias learning","authors":"Jonathan Baxter","year":"2000","venue":"J. Artif. Intell. Res.(JAIR)","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Caruana, 1997] Rich Caruana. Multitask learning. Machine Learning, 1(28):41-75, 1997.","title":"Multitask learning","authors":"Caruana","year":"1997","venue":"Machine Learning","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Evgeniou and Pontil, 2004] Theodoros Evgeniou and Mas- similiano Pontil. Regularized multi-task learning. In Pro- ceedings of the tenth ACM SIGKDD international con- ference on Knowledge discovery and data mining, pages 109-117. ACM, 2004.","title":"Theodoros Evgeniou and Massimiliano Pontil. Regularized multi-task learning","authors":"Pontil Evgeniou","year":"2004","venue":"Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Evgeniou and Pontil, 2007] A Evgeniou and Massimiliano Pontil. Multi-task feature learning. Advances in neural information processing systems, 19:41, 2007.","title":"A Evgeniou and Massimiliano Pontil. Multi-task feature learning","authors":"Pontil Evgeniou","year":"2007","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Jiang et al., 2015] Lu Jiang, Deyu Meng, Qian Zhao, Shiguang Shan, and Alexander G Hauptmann. Self-paced curriculum learning. In AAAI, volume 2, page 6, 2015.","title":"Self-paced curriculum learning","authors":"Lu Jiang, Deyu Meng, Qian Zhao, Shiguang Shan, Alexander G Hauptmann","year":"2015","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Kang et al., 2011] Zhuoliang Kang, Kristen Grauman, and Fei Sha. Learning with whom to share in multi-task feature learning. In Proceedings of the 28th International Con- ference on Machine Learning (ICML-11), pages 521-528, 2011.","title":"Learning with whom to share in multi-task feature learning","authors":"Kang","year":"2011","venue":"Proceedings of the 28th International Conference on Machine Learning (ICML-11)","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kshirsagar et al., 2013] Meghana Kshirsagar, Jaime Car- bonell, and Judith Klein-Seetharaman. Multitask learn- ing for host-pathogen protein interactions. Bioinformatics, 29(13):i217-i226, 2013.","title":"Multitask learning for host-pathogen protein interactions","authors":"Meghana Kshirsagar, Jaime Carbonell, Judith Klein-Seetharaman","year":"2013","venue":"Bioinformatics","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Kumar and Daume, 2012] Abhishek Kumar and Hal Daume. Learning task grouping and overlap in multi-task learning. In Proceedings of the 29th International Conference on Machine Learning (ICML-12), pages 1383-1390, 2012.","title":"Learning task grouping and overlap in multi-task learning","authors":"Daume Kumar, Abhishek Kumar, Hal Daume","year":"2012","venue":"Proceedings of the 29th International Conference on Machine Learning (ICML-12)","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Kumar et al., 2010] M Pawan Kumar, Benjamin Packer, and Daphne Koller. Self-paced learning for latent variable mod- els. In Advances in Neural Information Processing Systems, pages 1189-1197, 2010.","title":"Self-paced learning for latent variable models","authors":"Benjamin M Pawan Kumar, Daphne Packer, Koller","year":"2010","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Li et al., 2017] Changsheng Li, Fan Wei, Junchi Yan, Weis- han Dong, Qingshan Liu, and Hongyuan Zha. Self-paced multi-task learning. In AAAI, pages 2175-2181, 2017.","title":"Self-paced multi-task learning","authors":"Changsheng Li, Fan Wei, Junchi Yan, Weishan Dong, Qingshan Liu, Hongyuan Zha","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Maurer et al., 2013] Andreas Maurer, Massimiliano Pontil, and Bernardino Romera-Paredes. Sparse coding for mul- titask and transfer learning. In ICML (2), pages 343-351, 2013.","title":"Sparse coding for multitask and transfer learning","authors":"Andreas Maurer, Massimiliano Pontil, Bernardino Romera-Paredes","year":"2013","venue":"ICML (2)","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Murugesan et al., 2016] Keerthiram Murugesan, Hanxiao Liu, Jaime Carbonell, and Yiming Yang. Adaptive smoothed online multi-task learning. In Advances in Neural Information Processing Systems, pages 4296-4304, 2016.","title":"Adaptive smoothed online multi-task learning","authors":"Murugesan","year":"2016","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Pentina et al., 2015] Anastasia Pentina, Viktoriia Sharman- ska, and Christoph H Lampert. Curriculum learning of multiple tasks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 5492- 5500, 2015.","title":"Curriculum learning of multiple tasks","authors":"Anastasia Pentina, Viktoriia Sharmanska, Christoph H Lampert","year":"2015","venue":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Romera-Paredes et al., 2012] Bernardino Romera-Paredes, Andreas Argyriou, Nadia Berthouze, and Massimiliano Pontil. Exploiting unrelated tasks in multi-task learning. In AISTATS, volume 22, pages 951-959, 2012.","title":"Exploiting unrelated tasks in multi-task learning","authors":"Romera-Paredes","year":"2012","venue":"AISTATS","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Ruvolo and Eaton, 2013a] Paul Ruvolo and Eric Eaton. Ac- tive task selection for lifelong machine learning. In AAAI, 2013.","title":"Active task selection for lifelong machine learning","authors":"Eaton Ruvolo, Paul Ruvolo, Eric Eaton","year":"2013","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Ruvolo and Eaton, 2013b] Paul Ruvolo and Eric Eaton. Ella: An efficient lifelong learning algorithm. ICML (1), 28:507- 515, 2013.","title":"Ella: An efficient lifelong learning algorithm","authors":"Eaton Ruvolo, Paul Ruvolo, Eric Eaton","year":"2013","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Weinberger et al., 2009] Kilian Weinberger, Anirban Das- gupta, John Langford, Alex Smola, and Josh Attenberg. Feature hashing for large scale multitask learning. In Pro- ceedings of the 26th Annual International Conference on Machine Learning, pages 1113-1120. ACM, 2009.","title":"Feature hashing for large scale multitask learning","authors":"Kilian Weinberger, Anirban Dasgupta, John Langford, Alex Smola, Josh Attenberg","year":"2009","venue":"Proceedings of the 26th Annual International Conference on Machine Learning","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}