{"type":"ScholarlyArticle","title":"Individual Fairness Revisited: Transferring Techniques from Adversarial Robustness","authors":[{"name":"Samuel Yeom","slug":"samuel-yeom","given":"Samuel","family":"Yeom","affiliation":"Carnegie Mellon University"},{"name":"Matt Fredrikson","slug":"matt-fredrikson","given":"Matt","family":"Fredrikson","affiliation":"Carnegie Mellon University"}],"abstract":"We turn the definition of individual fairness on its head - rather than ascertaining the fairness of a model given a predetermined metric, we find a metric for a given model that satisfies individual fairness. This can facilitate the discussion on the fairness of a model, addressing the issue that it may be difficult to specify a priori a suitable metric. Our contributions are twofold:\r\nFirst, we introduce the definition of a minimal metric and characterize the behavior of models in terms of minimal metrics. Second, for more complicated models, we apply the mechanism of randomized smoothing from adversarial robustness to make them individually fair under a given weighted Lp metric. Our experiments show that adapting the minimal metrics of linear models to more complicated neural networks can lead to meaningful and interpretable fairness guarantees at little cost to utility.","doi":"10.24963/ijcai.2020/61","url":"https://ijcai.org/proceedings/2020/61","pdf":"https://ijcai.org/proceedings/2020/0061.pdf","markdown":"https://ijcai.org/proceedings/2020/61.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/61","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"AI Ethics","track":"Main track","number":61,"pages":{"first":437,"last":443},"keywords":["Machine Learning: Adversarial Machine Learning","AI Ethics: Fairness"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/24204/file_24204.m3u8","length_sec":262,"provider":"hls"}],"references":[{"position":1,"raw":"[Andrzejak et al., 2001] Ralph G Andrzejak, Klaus Lehn- ertz, Florian Mormann, Christoph Rieke, Peter David, and Christian E Elger. Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: Dependence on recording region and brain state. Physical Review E, 64(6):061907, 2001.","title":"Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: Dependence on recording region and brain state","authors":"Klaus Ralph G Andrzejak, Florian Lehnertz, Christoph Mormann, Peter Rieke, Christian E David, Elger","year":"2001","venue":"Physical Review E","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Angwin et al., 2016] Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. Machine bias: There's soft- ware used across the country to predict future criminals. and it's biased against blacks. ProPublica, 2016.","title":"Machine bias: There's software used across the country to predict future criminals. and it's biased against blacks","authors":"Julia Angwin, Jeff Larson, Surya Mattu, Lauren Kirchner","year":"2016","venue":"ProPublica","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Calmon et al., 2017] Flavio Calmon, Dennis Wei, Bhanuki- ran Vinzamuri, Karthikeyan Natesan Ramamurthy, and Kush R Varshney. Optimized pre-processing for discrimi- nation prevention. In Advances in Neural Information Pro- cessing Systems, pages 3992-4001, 2017.","title":"Optimized pre-processing for discrimination prevention","authors":"Flavio Calmon, Dennis Wei, Bhanukiran Vinzamuri, Karthikeyan Natesan Ramamurthy, Kush R Varshney","year":"2017","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Canetti et al., 2019] Ran Canetti, Aloni Cohen, Nishanth Dikkala, Govind Ramnarayan, Sarah Scheffler, and Adam Smith. From soft classifiers to hard decisions: How fair can we be? In ACM Conference on Fairness, Accountabil- ity, and Transparency, pages 309-318, 2019.","title":"From soft classifiers to hard decisions: How fair can we be?","authors":"Ran Canetti, Aloni Cohen, Nishanth Dikkala, Govind Ramnarayan, Sarah Scheffler, Adam Smith","year":"2019","venue":"ACM Conference on Fairness, Accountability, and Transparency","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Chouldechova and Roth, 2018] Alexandra Chouldechova and Aaron Roth. The frontiers of fairness in machine learning. arXiv preprint arXiv:1810.08810, 2018.","title":"The frontiers of fairness in machine learning","authors":"Roth Chouldechova","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[City of Chicago, 2017] City of Chicago. Strategic Sub- ject List. https://data.cityofchicago.org/Public-Safety/ Strategic-Subject-List/4aki-r3np, 2017.","title":"City of Chicago. Strategic Subject List","authors":null,"year":"2017","venue":null,"doi":null,"url":"https://data.cityofchicago.org/Public-Safety/Strategic-Subject-List/4aki-r3np,2017","internal_url":null},{"position":7,"raw":"[Cohen et al., 2019] Jeremy Cohen, Elan Rosenfeld, and Zico Kolter. Certified adversarial robustness via random- ized smoothing. In International Conference on Machine Learning, pages 1310-1320, 2019.","title":"Certified adversarial robustness via randomized smoothing","authors":"Jeremy Cohen, Elan Rosenfeld, Zico Kolter","year":"2019","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Dua and Karra Taniskidou, 2017] Dheeru Dua and Efi Karra Taniskidou. UCI machine learning repository. https://archive.ics.uci.edu/ml, 2017.","title":"Dheeru Dua and Efi Karra Taniskidou. UCI machine learning repository","authors":"Karra Dua, Taniskidou","year":"2017","venue":null,"doi":null,"url":"https://archive.ics.uci.edu/ml,2017","internal_url":null},{"position":9,"raw":"[Dwork et al., 2012] Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. Fairness through awareness. In Innovations in Theoretical Com- puter Science, pages 214-226, 2012.","title":"Fairness through awareness","authors":"Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, Richard Zemel","year":"2012","venue":"Innovations in Theoretical Computer Science","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Equivant, 2019] Equivant. Practitioner's guide to COMPAS core. http://www.equivant.com/wp-content/uploads/ Practitioners-Guide-to-COMPAS-Core-040419.pdf, 2019.","title":"Equivant. Practitioner's guide to COMPAS core","authors":"Equivant","year":"2019","venue":null,"doi":null,"url":"http://www.equivant.com/wp-content/uploads/Practitioners-Guide-to-COMPAS-Core-040419.pdf","internal_url":null},{"position":11,"raw":"[Gillen et al., 2018] Stephen Gillen, Christopher Jung, Michael Kearns, and Aaron Roth. Online learning with an unknown fairness metric. In Advances in Neural Information Processing Systems, pages 2600-2609, 2018.","title":"Online learning with an unknown fairness metric","authors":"Stephen Gillen, Christopher Jung, Michael Kearns, Aaron Roth","year":"2018","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Goodfellow et al., 2015] Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy. Explaining and harnessing adversarial examples. In International Conference on Learning Representations, 2015.","title":"Explaining and harnessing adversarial examples","authors":"Ian J Goodfellow, Jonathon Shlens, Christian Szegedy","year":"2015","venue":"International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Hardt et al., 2016] Moritz Hardt, Eric Price, and Nati Sre- bro. Equality of opportunity in supervised learning. In Ad- vances in Neural Information Processing Systems, pages 3315-3323, 2016.","title":"Equality of opportunity in supervised learning","authors":"Moritz Hardt, Eric Price, Nati Srebro","year":"2016","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Ilvento, 2019] Christina Ilvento. Metric learning for indi- vidual fairness. arXiv preprint arXiv:1906.00250, 2019.","title":"Christina Ilvento. Metric learning for individual fairness","authors":"Ilvento","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Jung et al., 2019] Christopher Jung, Michael Kearns, Seth Neel, Aaron Roth, Logan Stapleton, and Zhiwei Steven Wu. Eliciting and enforcing subjective individual fairness. arXiv preprint arXiv:1905.10660, 2019.","title":"Eliciting and enforcing subjective individual fairness","authors":"Christopher Jung, Michael Kearns, Seth Neel, Aaron Roth, Logan Stapleton, Zhiwei Steven Wu","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Kairouz et al., 2016] Peter Kairouz, Sewoong Oh, and Pramod Viswanath. Extremal mechanisms for local dif- ferential privacy. Journal of Machine Learning Research, 17(1):492-542, 2016.","title":"Extremal mechanisms for local differential privacy","authors":"Kairouz","year":"2016","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Lohia et al., 2019] Pranay K Lohia, Karthikeyan Natesan Ramamurthy, Manish Bhide, Diptikalyan Saha, Kush R Varshney, and Ruchir Puri. Bias mitigation post- processing for individual and group fairness. In IEEE In- ternational Conference on Acoustics, Speech and Signal Processing, pages 2847-2851, 2019.","title":"Bias mitigation postprocessing for individual and group fairness","authors":"Karthikeyan Pranay K Lohia, Manish Natesan Ramamurthy, Diptikalyan Bhide, Kush R Saha, Ruchir Varshney, Puri","year":"2019","venue":"IEEE International Conference on Acoustics, Speech and Signal Processing","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Madras et al., 2018] David Madras, Elliot Creager, Toniann Pitassi, and Richard Zemel. Learning adversarially fair and transferable representations. In International Confer- ence on Machine Learning, pages 3381-3390, 2018.","title":"Learning adversarially fair and transferable representations","authors":"David Madras, Elliot Creager, Toniann Pitassi, Richard Zemel","year":"2018","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Neyman and Pearson, 1933] Jerzy Neyman and Egon Sharpe Pearson. On the problem of the most efficient tests of statistical hypotheses. Philosophical Transactions of the Royal Society of London, 231(694- 706):289-337, 1933.","title":"On the problem of the most efficient tests of statistical hypotheses","authors":"Pearson Neyman, Jerzy Neyman, Egon Sharpe Pearson","year":"1933","venue":"Philosophical Transactions of the Royal Society of London","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Szegedy et al., 2014] Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus. Intriguing properties of neural networks. In International Conference on Learning Representations, 2014.","title":"Intriguing properties of neural networks","authors":"Szegedy","year":"2014","venue":"International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Tan et al., 2019] Zilong Tan, Samuel Yeom, Matt Fredrik- son, and Ameet Talwalkar. Learning fair representa- tions for kernel models. arXiv preprint arXiv:1906.11813, 2019.","title":"Learning fair representations for kernel models","authors":"Zilong Tan, Samuel Yeom, Matt Fredrikson, Ameet Talwalkar","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Yeom and Fredrikson, 2020] Samuel Yeom and Matt Fredrikson. Individual fairness revisited: Transferring techniques from adversarial robustness. arXiv preprint arXiv:2002.07738, 2020.","title":"Individual fairness revisited: Transferring techniques from adversarial robustness","authors":"Fredrikson Yeom, Samuel Yeom, Matt Fredrikson","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Zafar et al., 2017] Muhammad Bilal Zafar, Isabel Valera, Manuel Gomez Rodriguez, and Krishna P Gummadi. Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment. In International Conference on World Wide Web, pages 1171-1180, 2017.","title":"Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment","authors":"Zafar","year":"2017","venue":"International Conference on World Wide Web","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Zemel et al., 2013] Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. Learning fair representa- tions. In International Conference on Machine Learning, pages 325-333, 2013.","title":"Learning fair representations","authors":"Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, Cynthia Dwork","year":"2013","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}