{"type":"ScholarlyArticle","title":"Label Enhancement via Joint Implicit Representation Clustering","authors":[{"name":"Yunan Lu","slug":"yunan-lu","given":"Yunan","family":"Lu","affiliation":"School of Computer Science and Engineering , Nanjing University of Science and Technology , China"},{"name":"Weiwei Li","slug":"weiwei-li","given":"Weiwei","family":"Li","affiliation":"College of Computer Science and Technology , Nanjing University of Aeronautics and Astronautics , China"},{"name":"Xiuyi Jia","slug":"xiuyi-jia","given":"Xiuyi","family":"Jia","affiliation":"School of Computer Science and Engineering , Nanjing University of Science and Technology , China"}],"abstract":"Label distribution is an effective label form to portray label polysemy (i.e., the cases that an instance can be described by multiple labels simultaneously). However, the expensive annotating cost of label distributions limits its application to a wider range of practical tasks. Therefore, LE (label enhancement) techniques are extensively studied to solve this problem. Existing LE algorithms mostly estimate label distributions by the instance relation or the label relation. However, they suffer from biased instance relations, limited model capabilities, or suboptimal local label correlations. Therefore, in this paper, we propose a deep generative model called JRC to simultaneously learn and cluster the joint implicit representations of both features and labels, which can be used to improve any existing LE algorithm involving the instance relation or local label correlations. Besides, we develop a novel label distribution recovery module, and then integrate it with JRC model, thus constituting a novel generative label enhancement model that utilizes the learned joint implicit representations and instance clusters in a principled way. Finally, extensive experiments validate our proposal.","doi":"10.24963/ijcai.2023/447","url":"https://ijcai.org/proceedings/2023/447","pdf":"https://ijcai.org/proceedings/2023/0447.pdf","markdown":"https://ijcai.org/proceedings/2023/447.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/447","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Machine Learning","track":"Main Track","number":447,"pages":{"first":4019,"last":4027},"keywords":["Machine Learning: ML: Unsupervised learning","Machine Learning: ML: Multi-label","Machine Learning: ML: Weakly supervised learning"],"videos":[],"references":[{"position":1,"raw":"[Bengio et al., 2013] Yoshua Bengio, Aaron Courville, and Pascal Vincent. Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8):1798-1828, 2013.","title":"Representation learning: A review and new perspectives","authors":"Yoshua Bengio, Aaron Courville, Pascal Vincent","year":"2013","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[El Gayar et al., 2006] Neamat El Gayar, Friedhelm Schwenker, and Günther Palm. A study of the robustness of knn classifiers trained using soft labels. In Artificial Neural Networks in Pattern Recognition, pages 67-80, 2006.","title":"Neamat El Gayar, Friedhelm Schwenker, and Günther Palm. A study of the robustness of knn classifiers trained using soft labels","authors":"El Gayar","year":"2006","venue":"Artificial Neural Networks in Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Gao et al., 2018] Bin-Bin Gao, Hong-Yu Zhou, Jianxin Wu, and Xin Geng. Age estimation using expectation of label distribution learning. In International Joint Conference on Artificial Intelligence, pages 712-718, 2018.","title":"Age estimation using expectation of label distribution learning","authors":"Gao","year":"2018","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2018/99"},{"position":4,"raw":"[Geng et al., 2022] Xin Geng, Renyi Zheng, Jiaqi Lv, and Yu Zhang. Multilabel ranking with inconsistent rankers. IEEE Transactions on Pattern Analysis and Machine In- telligence, 44(9):5211-5224, 2022.","title":"Multilabel ranking with inconsistent rankers","authors":"Xin Geng, Renyi Zheng, Jiaqi Lv, Yu Zhang","year":"2022","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Geng, 2016] Xin Geng. Label distribution learning. IEEE Transactions on Knowledge and Data Engineering, 28(7):1734-1748, 2016.","title":"Label distribution learning","authors":"Xin Geng, Geng","year":"2016","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[He and Jin, 2019] Tao He and Xiaoming Jin. Image emo- tion distribution learning with graph convolutional net- works. In International Conference on Multimedia Re- trieval, page 382-390, 2019.","title":"Xiaoming Jin. Image emotion distribution learning with graph convolutional networks","authors":"Jin ; ] Tao He, He","year":"2019","venue":"International Conference on Multimedia Retrieval","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[He et al., 2016] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. In IEEE Conference on Computer Vision and Pat- tern Recognition, pages 770-778, 2016.","title":"Deep residual learning for image recognition","authors":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun","year":"2016","venue":"IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Hou et al., 2016] Peng Hou, Xin Geng, and Min-Ling Zhang. Multi-label manifold learning. In AAAI Confer- ence on Artificial Intelligence, pages 1680-1686, 2016.","title":"Multi-label manifold learning","authors":"Peng Hou, Xin Geng, Min-Ling Zhang","year":"2016","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Izenman, 2012] Alan Julian Izenman. Introduction to man- ifold learning. Wiley Interdisciplinary Reviews: Computa- tional Statistics, 4(5):439-446, 2012.","title":"Introduction to manifold learning","authors":"Alan Julian, Izenman","year":"2012","venue":"Wiley Interdisciplinary Reviews: Computational Statistics","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Jia et al., 2019] Xiuyi Jia, Xiang Zheng, Weiwei Li, Changqing Zhang, and Zechao Li. Facial emotion distri- bution learning by exploiting low-rank label correlations locally. In IEEE Conference on Computer Vision and Pat- tern Recognition, pages 9841-9850, 2019.","title":"Facial emotion distribution learning by exploiting low-rank label correlations locally","authors":"Xiuyi Jia, Xiang Zheng, Weiwei Li, Changqing Zhang, Zechao Li","year":"2019","venue":"IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Jia et al., 2023] Xiuyi Jia, Yunan Lu, and Fangwen Zhang. Label enhancement by maintaining positive and negative label relation. IEEE Transactions on Knowledge and Data Engineering, 35(2):1708-1720, 2023.","title":"Label enhancement by maintaining positive and negative label relation","authors":"Jia","year":"2023","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Jiang et al., 2006] Xiufeng Jiang, Zhang Yi, and Jian Cheng Lv. Fuzzy svm with a new fuzzy membership function. Neural Computing & Applications, 15(3):268-276, 2006.","title":"Fuzzy svm with a new fuzzy membership function","authors":"Xiufeng Jiang, Zhang Yi, Jian Cheng, Lv","year":"2006","venue":"Neural Computing & Applications","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Jiang et al., 2017] Zhuxi Jiang, Yin Zheng, Huachun Tan, Bangsheng Tang, and Hanning Zhou. Variational deep embedding: An unsupervised and generative approach to clustering. In International Joint Conference on Artificial Intelligence, pages 1965-1972, 2017.","title":"Variational deep embedding: An unsupervised and generative approach to clustering","authors":"Jiang","year":"2017","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2017/273"},{"position":14,"raw":"[Joo et al., 2020] Weonyoung Joo, Wonsung Lee, Sungrae Park, and Il-Chul Moon. Dirichlet variational autoencoder. Pattern Recognition, 107:107514, 2020.","title":"Weonyoung Joo, Wonsung Lee, Sungrae Park, and Il-Chul Moon. Dirichlet variational autoencoder","authors":"Joo","year":"2020","venue":"Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Kingma and Ba, 2015] Diederik Kingma and Jimmy Ba. Adam: A method for stochastic optimization. In Inter- national Conference on Learning Representations, 2015.","title":"Adam: A method for stochastic optimization","authors":"Ba ; ] Diederik Kingma, Jimmy Kingma, Ba","year":"2015","venue":"International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Kingma and Welling, 2014] Diederik P. Kingma and Max Welling. Auto-encoding variational bayes. In Interna- tional Conference on Learning Representations, 2014.","title":"Auto-encoding variational bayes","authors":"P Diederik, Max Kingma, Welling","year":"2014","venue":"International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Li et al., 2019] Guohao Li, Matthias Muller, Ali Thabet, and Bernard Ghanem. Deepgcns: Can gcns go as deep as cnns? In IEEE/CVF International Conference on Com- puter Vision, pages 9267-9276, 2019.","title":"Deepgcns: Can gcns go as deep as cnns?","authors":"Li","year":"2019","venue":"IEEE/CVF International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Liu et al., 2021a] Xinyuan Liu, Jihua Zhu, Zhongyu Li, Zhiqiang Tian, Xiuyi Jia, and Lei Chen. Unified frame- work for learning with label distribution. Information Fu- sion, 75:116-130, 2021.","title":"Unified framework for learning with label distribution","authors":"Liu","year":"2021","venue":"Information Fusion","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Liu et al., 2021b] Xinyuan Liu, Jihua Zhu, Qinghai Zheng, Zhongyu Li, Ruixin Liu, and Jun Wang. Bidirectional loss function for label enhancement and distribution learning. Knowledge-Based System, 213:106690, 2021.","title":"Bidirectional loss function for label enhancement and distribution learning","authors":"Liu","year":"2021","venue":"Knowledge-Based System","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Lu and Jia, 2022] Yunan Lu and Xiuyi Jia. Predicting la- bel distribution from multi-label ranking. In Advances in Neural Information Processing Systems, 2022.","title":"Predicting label distribution from multi-label ranking","authors":"Jia ; ] Yunan Lu, Xiuyi Lu, Jia","year":"2022","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Lu et al., 2023] Yunan Lu, Liang He, Fan Min, Weiwei Li, and Xiuyi Jia. Generative label enhancement with gaus- sian mixture and partial ranking. In AAAI Conference on Artificial Intelligence, 2023.","title":"Generative label enhancement with gaussian mixture and partial ranking","authors":"Yunan Lu, Liang He, Fan Min, Weiwei Li, Xiuyi Jia","year":"2023","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Luo et al., 2021] Jianqiao Luo, Yihan Wang, Yang Ou, Biao He, and Bailin Li. Neighbor-based label distribution learn- ing to model label ambiguity for aerial scene classification. Remote Sensing, 13(4):755, 2021.","title":"Neighbor-based label distribution learning to model label ambiguity for aerial scene classification","authors":"Luo","year":"2021","venue":"Remote Sensing","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Lv et al., 2019] Jiaqi Lv, Ning Xu, Renyi Zheng, and Xin Geng. Weakly supervised multi-label learning via label enhancement. In International Joint Conference on Artifi- cial Intelligence, pages 3101-3107, 2019.","title":"Weakly supervised multi-label learning via label enhancement","authors":"Jiaqi Lv, Ning Xu, Renyi Zheng, Xin Geng","year":"2019","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2019/430"},{"position":24,"raw":"[Peng et al., 2015] Kuan-Chuan Peng, Tsuhan Chen, Amir Sadovnik, and Andrew Gallagher. A mixed bag of emo- tions: Model, predict, and transfer emotion distributions. In IEEE Conference on Computer Vision and Pattern Recognition, pages 860-868, 2015.","title":"A mixed bag of emotions: Model, predict, and transfer emotion distributions","authors":"Kuan-Chuan, Tsuhan Peng, Amir Chen, Andrew Sadovnik, Gallagher","year":"2015","venue":"IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Plackett, 1975] Robin L. Plackett. The analysis of permuta- tions. Applied Statistics, 24(2):193-202, 1975.","title":"The analysis of permutations","authors":"Robin L Plackett","year":"1975","venue":"Applied Statistics","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Ren et al., 2019] Tingting Ren, Xiuyi Jia, Weiwei Li, Lei Chen, and Zechao Li. Label distribution learning with label-specific features. In International Joint Conference on Artificial Intelligence, pages 3318-3324, 2019.","title":"Label distribution learning with label-specific features","authors":"Tingting Ren, Xiuyi Jia, Weiwei Li, Lei Chen, Zechao Li","year":"2019","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2019/460"},{"position":27,"raw":"[Shao et al., 2018] Ruifeng Shao, Xin Geng, and Ning Xu. Multi-label learning with label enhancement. In IEEE In- ternational Conference on Data Mining, pages 437-446, 2018.","title":"Multi-label learning with label enhancement","authors":"Ruifeng Shao, Xin Geng, Ning Xu","year":"2018","venue":"IEEE International Conference on Data Mining","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Shen et al., 2021] Wei Shen, Yiluan Guo, Yan Wang, Kai Zhao, Bo Wang, and Alan Yuille. Deep differentiable ran- dom forests for age estimation. IEEE Transactions on Pat- tern Analysis and Machine Intelligence, 43(2):404-419, 2021.","title":"Deep differentiable random forests for age estimation","authors":"Wei Shen, Yiluan Guo, Yan Wang, Kai Zhao, Bo Wang, Alan Yuille","year":"2021","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Tang et al., 2020] Haoyu Tang, Jihua Zhu, Qinghai Zheng, Jun Wang, Shanmin Pang, and Zhongyu Li. Label en- hancement with sample correlations via low-rank repre- sentation. In AAAI Conference on Artificial Intelligence, pages 5932-5939, 2020.","title":"Label enhancement with sample correlations via low-rank representation","authors":"Haoyu Tang, Jihua Zhu, Qinghai Zheng, Jun Wang, Shanmin Pang, Zhongyu Li","year":"2020","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Wang et al., 2023] Ke Wang, Ning Xu, Miaogen Ling, and Xin Geng. Fast label enhancement for label distribution learning. IEEE Transactions on Knowledge and Data En- gineering, 35(2):1502-1514, 2023.","title":"Fast label enhancement for label distribution learning","authors":"Ke Wang, Ning Xu, Miaogen Ling, Xin Geng","year":"2023","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Wen et al., 2020] Xin Wen, Biying Li, Haiyun Guo, Zhiwei Liu, Guosheng Hu, Ming Tang, and Jinqiao Wang. Adap- tive variance based label distribution learning for facial age estimation. In European Conference on Computer Vision, page 379-395, 2020.","title":"Adaptive variance based label distribution learning for facial age estimation","authors":"Xin Wen, Biying Li, Haiyun Guo, Zhiwei Liu, Guosheng Hu, Ming Tang, Jinqiao Wang","year":"2020","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Wen et al., 2021] Tao Wen, Weiwei Li, Lei Chen, and Xi- uyi Jia. Semi-supervised label enhancement via structured semantic extraction. International Journal of Machine Learning and Cybernetics, 13:1131-1144, 2021.","title":"Semi-supervised label enhancement via structured semantic extraction","authors":"Tao Wen, Weiwei Li, Lei Chen, Xiuyi Jia","year":"2021","venue":"International Journal of Machine Learning and Cybernetics","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Xu et al., 2018] Ning Xu, An Tao, and Xin Geng. Label en- hancement for label distribution learning. In International Joint Conference on Artificial Intelligence, pages 1632- 1643, 2018.","title":"Label enhancement for label distribution learning","authors":"Ning Xu, An Tao, Xin Geng","year":"2018","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2018/406"},{"position":34,"raw":"[Xu et al., 2019] Ning Xu, Jiaqi Lv, and Xin Geng. Partial label learning via label enhancement. In AAAI Conference on Artificial Intelligence, pages 5557-5564, 2019.","title":"Partial label learning via label enhancement","authors":"Ning Xu, Jiaqi Lv, Xin Geng","year":"2019","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Xu et al., 2020] Ning Xu, Jun Shu, Yun-Peng Liu, and Xin Geng. Variational label enhancement. In International Conference on Machine Learning, volume 119, pages 10597-10606, 2020.","title":"Variational label enhancement","authors":"Ning Xu, Jun Shu, Yun-Peng Liu, Xin Geng","year":"2020","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Xu et al., 2021] Ning Xu, Yun-Peng Liu, and Xin Geng. Label enhancement for label distribution learning. IEEE Transactions on Knowledge and Data Engineering, 33:1632-1643, 2021.","title":"Label enhancement for label distribution learning","authors":"Ning Xu, Yun-Peng Liu, Xin Geng","year":"2021","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":"/proceedings/2018/406"},{"position":37,"raw":"[Xu et al., 2023] Ning Xu, Jun Shu, Renyi Zheng, Xin Geng, Deyu Meng, and Min-Ling Zhang. Variational label en- hancement. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(5):6537-6551, 2023.","title":"Variational label enhancement","authors":"Ning Xu, Jun Shu, Renyi Zheng, Xin Geng, Deyu Meng, Min-Ling Zhang","year":"2023","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Yang et al., 2017] Jufeng Yang, Ming Sun, and Xiaoxiao Sun. Learning visual sentiment distributions via aug- mented conditional probability neural network. In AAAI Conference on Artificial Intelligence, pages 224-230, 2017.","title":"Learning visual sentiment distributions via augmented conditional probability neural network","authors":"Jufeng Yang, Ming Sun, Xiaoxiao Sun","year":"2017","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Zhang et al., 2018] Qian-Wen Zhang, Yun Zhong, and Min- Ling Zhang. Feature-induced labeling information enrich- ment for multi-label learning. In AAAI Conference on Ar- tificial Intelligence, pages 4446-4453, 2018.","title":"Feature-induced labeling information enrichment for multi-label learning","authors":"Qian-Wen Zhang, Yun Zhong, Min-Ling Zhang","year":"2018","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Zhang et al., 2021] Min-Ling Zhang, Qian-Wen Zhang, Jun-Peng Fang, Yukun Li, and Xin Geng. Leveraging im- plicit relative labeling-importance information for effec- tive multi-label learning. IEEE Transactions on Knowl- edge and Data Engineering, 33:2057-2070, 2021.","title":"Leveraging implicit relative labeling-importance information for effective multi-label learning","authors":"Zhang","year":"2021","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Zheng et al., 2023] Qinghai Zheng, Jihua Zhu, Haoyu Tang, Xinyuan Liu, Zhongyu Li, and Huimin Lu. Generalized label enhancement with sample correlations. IEEE Trans- actions on Knowledge and Data Engineering, 35(1):482- 495, 2023.","title":"Generalized label enhancement with sample correlations","authors":"Zheng","year":"2023","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}