{"type":"ScholarlyArticle","title":"Differentially Private Pairwise Learning Revisited","authors":[{"name":"Zhiyu Xue","slug":"zhiyu-xue","given":"Zhiyu","family":"Xue","affiliation":""},{"name":"Shaoyang Yang","slug":"shaoyang-yang","given":"Shaoyang","family":"Yang","affiliation":""},{"name":"Mengdi Huai","slug":"mengdi-huai","given":"Mengdi","family":"Huai","affiliation":""},{"name":"Di Wang","slug":"di-wang","given":"Di","family":"Wang","affiliation":""}],"abstract":"Instead of learning with pointwise loss functions, learning with pairwise loss functions (pairwise learning) has received much attention recently as it is more capable of modeling the relative relationship between pairs of samples.   However, most of the existing algorithms for pairwise learning fail to take into consideration the privacy issue in their design.  To address this  issue, previous work studied pairwise learning in the Differential Privacy (DP) model. However, their utilities (population errors) are far from optimal. To address the sub-optimal utility issue, in this paper, we proposed new pure or approximate DP algorithms for pairwise learning. Specifically, under the assumption that the loss functions are Lipschitz, our algorithms could achieve the optimal expected population risk for both strongly convex and general convex cases. We also conduct extensive experiments on real-world datasets to evaluate the proposed algorithms, experimental results support our theoretical analysis and show the priority of our algorithms.","doi":"10.24963/ijcai.2021/446","url":"https://ijcai.org/proceedings/2021/446","pdf":"https://ijcai.org/proceedings/2021/0446.pdf","markdown":"https://ijcai.org/proceedings/2021/446.md","bibtex":"https://ijcai.org/proceedings/2021/bibtex/446","volume":{"slug":"2021","title":"Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2021","url":"https://ijcai.org/proceedings/2021/","year":2021,"location":"Montreal","dates":"19-27 August 2021","editors":"Prof. Zhi-Hua Zhou","isbn":"978-0-9992411-9-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2021"},"section":"Machine Learning","track":"Main Track","number":446,"pages":{"first":3242,"last":3248},"keywords":["Multidisciplinary Topics and Applications: Security and Privacy","Machine Learning: Learning Theory","Machine Learning: Classification"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}