{"type":"ScholarlyArticle","title":"Recovering Accurate Labeling Information from Partially Valid Data for Effective Multi-Label Learning","authors":[{"name":"Ximing Li","slug":"ximing-li","given":"Ximing","family":"Li","affiliation":"College of Computer Science and Technology , Jilin University , China; Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education , Jilin University , China"},{"name":"Yang Wang","slug":"yang-wang","given":"Yang","family":"Wang","affiliation":"Key Laboratory of Knowledge Engineering with Big Data , Ministry of Education , Hefei University of Technology , China; School of Computer Sci & Information Engineering , Hefei University of Technology , China"}],"abstract":"Partial Multi-label Learning (PML) aims to induce the multi-label predictor from datasets with noisy supervision, where each training instance is associated with several candidate labels but only partially valid. To address the noisy issue, the existing PML methods basically recover the ground-truth labels by leveraging the ground-truth confidence of the candidate label, i.e., the likelihood of a candidate label being a ground-truth one. However, they neglect the information from non-candidate labels, which potentially contributes to the ground-truth label recovery. In this paper, we propose to recover the ground-truth labels, i.e., estimating the ground-truth confidences, from the label enrichment, composed of the relevance degrees of candidate labels and irrelevance degrees of non-candidate labels. Upon this observation, we further develop a novel two-stage PML method, namely Partial Multi-Label Learning with Label Enrichment-Recovery (PML3ER), where in the first stage, it estimates the label enrichment with unconstrained label propagation, then jointly learns the ground-truth confidence and multi-label predictor given the label enrichment. Experimental results validate that PML3ER outperforms the state-of-the-art PML methods.","doi":"10.24963/ijcai.2020/191","url":"https://ijcai.org/proceedings/2020/191","pdf":"https://ijcai.org/proceedings/2020/0191.pdf","markdown":"https://ijcai.org/proceedings/2020/191.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/191","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Data Mining","track":"Main track","number":191,"pages":{"first":1373,"last":1380},"keywords":["Data Mining: Classification, Semi-Supervised Learning"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/24910/file_24910.m3u8","length_sec":252,"provider":"hls"}],"references":[{"position":1,"raw":"[Boyd et al., 2011] Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, and Jonathan Eckstein. Distributed opti- mization and statistical learning via the alternating direc- tion method of multipliers. Foundations and Trends in Ma- chine Learning, 3(1):1-122, 2011.","title":"Distributed optimization and statistical learning via the alternating direction method of multipliers","authors":"Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, Jonathan Eckstein","year":"2011","venue":"Foundations and Trends in Machine Learning","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Cai et al., 2010] Jian-Feng Cai, Emmanuel J. Candès, and Zuowei Shen. A singular value thresholding algorithm for matrix completion. SIAM Journal on Optimization, 20(4):1956-1982, 2010.","title":"A singular value thresholding algorithm for matrix completion","authors":"Jian-Feng Cai, Emmanuel J Candès, Zuowei Shen","year":"2010","venue":"SIAM Journal on Optimization","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chen et al., 2014] Yi-Chen Chen, Vishal M. Patel, Rama Chellappa, and P. Jonathon Phillips. Ambiguously labeled learning using dictionaries. IEEE Transactions on Infor- mation Forensics and Security, 9(12):2076-2088, 2014.","title":"Ambiguously labeled learning using dictionaries","authors":"Yi-Chen Chen, M Vishal, Rama Patel, P Chellappa, Jonathon Phillips","year":"2014","venue":"IEEE Transactions on Information Forensics and Security","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen et al., 2018] Ching-Hui Chen, Vishal M. Patel, and Rama Chellappa. Learning from ambiguously labeled face images. IEEE Transactions on Pattern Analysis and Ma- chine Intelligence, 40(7):1653-1667, 2018.","title":"Learning from ambiguously labeled face images","authors":"Ching-Hui Chen, M Vishal, Rama Patel, Chellappa","year":"2018","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cour et al., 2011] Timothee Cour, Benjamin Sapp, and Ben Taskar. Learning from partial labels. Journal of Machine Learning Research, 12:1501-1536, 2011.","title":"Learning from partial labels","authors":"Timothee Cour, Benjamin Sapp, Ben Taskar","year":"2011","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Fang and Zhang, 2019] Jun-Peng Fang and Min-Ling Zhang. Partial multi-label learning via credible label elicitation. In AAAI Conference on Artificial Intelligence, pages 3518-3525, 2019.","title":"Partial multi-label learning via credible label elicitation","authors":"Zhang ; Jun-Peng Fang, Min-Ling Fang, Zhang","year":"2019","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Feng and An, 2018] Lei Feng and Bo An. Leveraging la- tent label distributions for partial label learning. In Inter- national Joint Conference on Artificial Intelligence, pages 2107-2113, 2018.","title":"Leveraging latent label distributions for partial label learning","authors":"Lei Feng, Bo An","year":"2018","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2018/291"},{"position":8,"raw":"[Feng and An, 2019a] Lei Feng and Bo An. Partial label learning by semantic difference maximization. In Inter- national Joint Conference on Artificial Intelligence, pages 2294-2300, 2019.","title":"Partial label learning by semantic difference maximization","authors":"An ; Feng, Lei Feng, Bo An","year":"2019","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2019/318"},{"position":9,"raw":"[Feng and An, 2019b] Lei Feng and Bo An. Partial label learning with self-guided retraining. In AAAI Conference on Artificial Intelligence, pages 3542-3549, 2019.","title":"Partial label learning with self-guided retraining","authors":"An ; Feng, Lei Feng, Bo An","year":"2019","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Gayar et al., 2006] Neamat El Gayar, Friedhelm Schwenker, and Günther Palm. A study of the ro- bustness of kNN classifiers trained using soft labels. In International Conference on Artificial Neural Network in Pattern Recognition, pages 67-80, 2006.","title":"Neamat El Gayar, Friedhelm Schwenker, and Günther Palm. A study of the robustness of kNN classifiers trained using soft labels","authors":"Gayar","year":"2006","venue":"International Conference on Artificial Neural Network in Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Gong et al., 2018] Chen Gong, Tongliang Liu, Yuanyan Tang, Jian Yang, Jie Yang, and Dacheng Tao. A regulariza- tion approach for instance-based superset label learning. IEEE Transactions on Cybernetics, 48(3):967-978, 2018.","title":"A regularization approach for instance-based superset label learning","authors":"Chen Gong, Tongliang Liu, Yuanyan Tang, Jian Yang, Jie Yang, Dacheng Tao","year":"2018","venue":"IEEE Transactions on Cybernetics","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Hou et al., 2016] Peng Hou, Xin Geng, and Min-Ling Zhang. Multi-label manifold learning. In AAAI Confer- ence on Artificial Intelligence, pages 1680-1686, 2016.","title":"Multi-label manifold learning","authors":"Peng Hou, Xin Geng, Min-Ling Zhang","year":"2016","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Jiang et al., 2006] Xiufeng Jiang, Zhang Yi, and Jian Cheng Lv. Fuzzy SVM with a new fuzzy membership func- tion. Neural Computing & Applications, 15(3-4):268-276, 2006.","title":"Fuzzy SVM with a new fuzzy membership function","authors":"Xiufeng Jiang, Zhang Yi, Jian Cheng, Lv","year":"2006","venue":"Neural Computing & Applications","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Li et al., 2015] Yu-Kun Li, Min-Ling Zhang, and Xin Geng. Leveraging implicit relative labeling-importance informa- tion for effective multi-label learning. In IEEE Interna- tional Conference on Data Mining, pages 251-260, 2015.","title":"Leveraging implicit relative labeling-importance information for effective multi-label learning","authors":"Yu-Kun Li, Min-Ling Zhang, Xin Geng","year":"2015","venue":"IEEE International Conference on Data Mining","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Liu and Dietterich, 2012] Li-Ping Liu and Thomas G. Diet- terich. A conditional multinomial mixture model for su- perset label learning. In Neural Information Processing Systems, pages 548-556, 2012.","title":"Dietterich. A conditional multinomial mixture model for superset label learning","authors":"Li-Ping Liu, Thomas G","year":"2012","venue":"Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Sun et al., 2019] Lijuan Sun, Songhe Feng, Tao Wang, Con- gyan Lang, and Yi Jin. Partial multi-label learning with low-rank and sparse decomposition. In AAAI Conference on Artificial Intelligence, pages 5016-5023, 2019.","title":"Partial multi-label learning with low-rank and sparse decomposition","authors":"Lijuan Sun, Songhe Feng, Tao Wang, Congyan Lang, Yi Jin","year":"2019","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Wang et al., 2019] Deng-Bao Wang, Li Li, and Min-Ling Zhang. Adaptive graph guided disambiguation for partial label learning. In ACM SIGKDD Conference on Knowl- edge Discovery and Data Mining, pages 83-91, 2019.","title":"Adaptive graph guided disambiguation for partial label learning","authors":"Deng-Bao Wang, Li Li, Min-Ling Zhang","year":"2019","venue":"ACM SIGKDD Conference on Knowledge Discovery and Data Mining","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Wu and Zhang, 2018] Xuan Wu and Min-Ling Zhang. To- wards enabling binary decomposition for partial label learning. In International Joint Conference on Artificial Intelligence, pages 2868-2874, 2018.","title":"Towards enabling binary decomposition for partial label learning","authors":"Zhang ; ] Wu, Xuan Wu, Min-Ling Zhang","year":"2018","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2018/398"},{"position":19,"raw":"[Xie and Huang, 2018] Ming-Kun Xie and Sheng-Jun Huang. Partial multi-label learning. In AAAI Conference on Artificial Intelligence, pages 4302-4309, 2018.","title":"Partial multi-label learning","authors":"Huang Xie, Ming-Kun Xie, Sheng-Jun Huang","year":"2018","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Xu et al., 2018] Ning Xu, An Tao, and Xin Geng. Label en- hancement for label distribution learning. In International Joint Conference on Artificial Intelligence, pages 2926- 2932, 2018.","title":"Label enhancement for label distribution learning","authors":"Ning Xu, An Tao, Xin Geng","year":"2018","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2018/406"},{"position":21,"raw":"[Yu and Zhang, 2017] Fei Yu and Min-Ling Zhang. Max- imum margin partial label learning. Machine Learning, 106:573-593, 2017.","title":"Maximum margin partial label learning","authors":"Yu, Zhang ; ] Fei Yu, Min-Ling Zhang","year":"2017","venue":"Machine Learning","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Yu et al., 2018] Guoxian Yu, Xia Chen, Carlotta Domeni- coni, Jun Wang, Zhao Li, Zili Zhang, and Xindong Wu. Feature-induced partial multi-label learning. In IEEE International Conference on Data Mining, pages 1398- 1403, 2018.","title":"Feature-induced partial multi-label learning","authors":"Guoxian Yu, Xia Chen, Carlotta Domeniconi, Jun Wang, Zhao Li, Zili Zhang, Xindong Wu","year":"2018","venue":"IEEE International Conference on Data Mining","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Zhang and Wu, 2015] Min-Ling Zhang and Lei Wu. LIFT: Multi-label learning with label-specific features. IEEE Transactions on Pattern Analysis and Machine Intelli- gence, 37(1):107-120, 2015.","title":"LIFT: Multi-label learning with label-specific features","authors":"Wu ; ] Min-Ling Zhang, Lei Zhang, Wu","year":"2015","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Zhang and Zhou, 2007] Min-Ling Zhang and Zhi-Hua Zhou. ML-kNN: A lazy learning approach to multi-label learning. Pattern Recognition, 40(7):2038-2048, 2007.","title":"ML-kNN: A lazy learning approach to multi-label learning","authors":"Zhou ; ] Min-Ling Zhang, Zhi-Hua Zhang, Zhou","year":"2007","venue":"Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Zhang and Zhou, 2014] Min-Ling Zhang and Zhi-Hua Zhou. A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering, 26(8):1819-1837, 2014.","title":"A review on multi-label learning algorithms","authors":"Zhou ; ] Min-Ling Zhang, Zhi-Hua Zhang, Zhou","year":"2014","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Zhang et al., 2017] Min-Ling Zhang, Fei Yu, and Cai- Zhi Tang. Disambiguation-free partial label learning. IEEE Transactions on Knowledge and Data Engineering, 29(10):2155-2167, 2017.","title":"Disambiguation-free partial label learning","authors":"Zhang","year":"2017","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}