{"type":"ScholarlyArticle","title":"Contrastive Unlearning: A Contrastive Approach to Machine Unlearning","authors":[{"name":"Hong kyu Lee","slug":"hong-kyu-lee","given":"Hong kyu","family":"Lee","affiliation":""},{"name":"Qiuchen Zhang","slug":"qiuchen-zhang","given":"Qiuchen","family":"Zhang","affiliation":""},{"name":"Carl Yang","slug":"carl-yang","given":"Carl","family":"Yang","affiliation":""},{"name":"Jian Lou","slug":"jian-lou","given":"Jian","family":"Lou","affiliation":""},{"name":"Li Xiong","slug":"li-xiong","given":"Li","family":"Xiong","affiliation":""}],"abstract":"Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model performance is challenging. Existing works mainly exploit input and output space and classification loss, which can result in ineffective unlearning or performance loss.   In addition, they utilize  unlearning or remaining samples ineffectively, sacrificing either unlearning efficacy or efficiency. \r\n    Our main insight is that the direct optimization on the representation space utilizing both unlearning and remaining samples can effectively remove influence of unlearning samples while maintaining representations learned from remaining samples. We propose a contrastive unlearning framework, leveraging the concept of representation learning for more effective unlearning. It removes the influence of unlearning samples by contrasting their embeddings against the remaining samples' embeddings \r\n    so that their embeddings are closer to the embeddings of unseen samples.\r\n    Experiments on a variety of datasets and models on both class unlearning and sample unlearning showed that contrastive unlearning achieves the best unlearning effects and efficiency with the lowest performance loss compared with the state-of-the-art algorithms. In addition, it is generalizable to different contrastive frameworks and other models such as vision-language models. Our main code is available on github.com/Emory-AIMS/Contrastive-Unlearning","doi":"10.24963/ijcai.2025/830","url":"https://ijcai.org/proceedings/2025/830","pdf":"https://ijcai.org/proceedings/2025/0830.pdf","markdown":"https://ijcai.org/proceedings/2025/830.md","bibtex":"https://ijcai.org/proceedings/2025/bibtex/830","volume":{"slug":"2025","title":"Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2025","url":"https://ijcai.org/proceedings/2025/","year":2025,"location":"Montreal, Canada","dates":"16-22 August 2025","editors":"James Kwok","isbn":"978-1-956792-06-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2025"},"section":"Multidisciplinary Topics and Applications","track":"Main Track","number":830,"pages":{"first":7464,"last":7472},"keywords":["Machine Learning: ML: Trustworthy machine learning","Multidisciplinary Topics and Applications: MTA: Security and privacy","Computer Vision: CV: Representation learning","AI Ethics, Trust, Fairness: ETF: Safety and robustness"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}