{"type":"ScholarlyArticle","title":"Assessing and Enforcing Fairness in the AI Lifecycle","authors":[{"name":"Roberta Calegari","slug":"roberta-calegari","given":"Roberta","family":"Calegari","affiliation":"ALMA MATER STUDIORUM-Università di Bologna , Italy"},{"name":"Gabriel G. Castañé","slug":"gabriel-g-castane","given":"Gabriel","family":"G. Castañé","affiliation":"Insight SFI Research Centre for Data Analytics , University College Cork , Ireland"},{"name":"Michela Milano","slug":"michela-milano","given":"Michela","family":"Milano","affiliation":"ALMA MATER STUDIORUM-Università di Bologna , Italy"},{"name":"Barry O'Sullivan","slug":"barry-o-sullivan","given":"Barry","family":"O'Sullivan","affiliation":"Insight SFI Research Centre for Data Analytics , University College Cork , Ireland"}],"abstract":"A significant challenge in detecting and mitigating bias is creating a mindset amongst AI developers to address unfairness. The current literature on fairness is broad, and the learning curve to distinguish where to use existing metrics and techniques for bias detection or mitigation is difficult. This survey systematises the state-of-the-art about distinct notions of fairness and relative techniques for bias mitigation according to the AI lifecycle. Gaps and challenges identified during the development of this work are also discussed.","doi":"10.24963/ijcai.2023/735","url":"https://ijcai.org/proceedings/2023/735","pdf":"https://ijcai.org/proceedings/2023/0735.pdf","markdown":"https://ijcai.org/proceedings/2023/735.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/735","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Survey Track","track":"Survey Track","number":735,"pages":{"first":6554,"last":6562},"keywords":["Survey: Humans and AI","Survey: AI Ethics, Trust, Fairness","Survey: Machine Learning"],"videos":[],"references":[{"position":1,"raw":"[Chen et al., 2019] Feldman et al., 2015] Adversarial Feng et al., 2019]","title":"Adversarial Feng et al","authors":"Feldman","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Feng et al., 2019] Learning [","title":"Learning","authors":"Feng","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Adel et al., 2019] Causal","title":"Causal","authors":"Adel","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Kilbertus et al., 2017] Kusner et al., 2017] [Mhasawade and Chunara, 2021]","title":"Mhasawade and Chunara","authors":"Kusner","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Chiappa, 2019] Gupta et al., 2018] [","title":null,"authors":"Gupta","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Calders and Verwer, 2010] [","title":null,"authors":"Verwer Calders","year":"2010","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Kamiran et al., 2010] Relabelling","title":"Relabelling","authors":"Kamiran","year":"2010","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Luong et al., 2011] [Kamiran and Calders, 2012]","title":"Kamiran and Calders","authors":"Luong","year":"2011","venue":null,"doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Wang et al., 2019] Resampling","title":"Resampling","authors":"Wang","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Awasthi et al., 2021] [","title":null,"authors":"Awasthi","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Dwork et al., 2018] [Kamiran and Calders, 2012] Reweighing Calders and Verwer, 2010] [Calders and Verwer, 2010] In-process Adversarial [","title":"Reweighing Calders and Verwer","authors":"Dwork","year":"2010","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Edwards and Storkey, 2015] Learning","title":"Learning","authors":"Storkey Edwards","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Beutel et al., 2017] [Madras et al., 2018]","title":null,"authors":"Beutel","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Feng et al., 2019] Constraint","title":"Constraint","authors":"Feng","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Ignatiev et al., 2020] [","title":null,"authors":"Ignatiev","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Corbett-Davies et al., 2017] Dwork et al., 2012] Optimization [Aïvodji et al., 2021] [","title":"Optimization [Aïvodji et al","authors":"Dwork","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Zafar et al., 2017b] [Louizos et al., 2015]","title":null,"authors":"Zafar","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Woodworth et al., 2017] Goh et al., 2016] [Quadrianto and Sharmanska, 2017]","title":"Quadrianto and Sharmanska","authors":"Goh","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Zafar et al., 2017a] [Detassis et al., 2020] [","title":null,"authors":"Zafar","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Detassis et al., 2020] [","title":null,"authors":"Detassis","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Aïvodji et al., 2021] Agarwal et al., 2018] Regularization","title":"Regularization","authors":"Agarwal","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Kamishima et al., 2012] [","title":null,"authors":"Kamishima","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Bechavod and Ligett, 2017] Liu and Vicente, 2021] [","title":null,"authors":"Vicente Liu","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Pessach and Shmueli, 2021] [Kamiran and Calders, 2012] Reweighing Calders and Verwer, 2010] [Krasanakis et al., 2018] Post-process Calibration [","title":"Post-process Calibration","authors":"Shmueli Pessach","year":"2010","venue":"Reweighing Calders and Verwer","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Pleiss et al., 2017] Relabelling [Kamiran et al., 2010] [","title":"Relabelling [Kamiran et al","authors":"Pleiss","year":"2010","venue":null,"doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Lohia et al., 2019] [Calders and Verwer, 2010] [","title":"Calders and Verwer","authors":"Lohia","year":"2010","venue":null,"doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Lohia et al., 2019] [Kamiran and Calders, 2012]","title":"Kamiran and Calders","authors":"Lohia","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Woodworth et al., 2017] Thresholding","title":"Thresholding","authors":"Woodworth","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Hardt et al., 2016] Woodworth et al., 2017] [","title":null,"authors":"Woodworth","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Dwork et al., 2012] [","title":null,"authors":"Dwork","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Menon and Williamson, 2018] Table 1: Fairness awareness via fairness notions (columns) and related intervention techniques in the AI lifecycle (rows). References","title":"Table 1: Fairness awareness via fairness notions (columns) and related intervention techniques in the AI lifecycle (rows)","authors":"Williamson Menon","year":"2018","venue":"References","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Adel et al., 2019] Tameem Adel, Isabel Valera, Zoubin Ghahramani, and Adrian Weller. One-network adversar- ial fairness. In AAAI, volume 33, pages 2412-2420, 2019.","title":"One-network adversarial fairness","authors":"Tameem Adel, Isabel Valera, Zoubin Ghahramani, Adrian Weller","year":"2019","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Agarwal et al., 2018] Alekh Agarwal, Alina Beygelzimer, Miroslav Dudík, John Langford, and Hanna Wallach. A reductions approach to fair classification. In International Conference on ML, pages 60-69. PMLR, 2018.","title":"A reductions approach to fair classification","authors":"Alekh Agarwal, Alina Beygelzimer, Miroslav Dudík, John Langford, Hanna Wallach","year":"2018","venue":"International Conference on ML","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Aïvodji et al., 2021] Ulrich Aïvodji, Julien Ferry, Sébastien Gambs, Marie-José Huguet, and Mohamed Siala. Fair- corels, an open-source library for learning fair rule lists. In International Conference on Information & Knowledge Management, pages 4665-4669, 2021.","title":"Faircorels, an open-source library for learning fair rule lists","authors":"Aïvodji","year":"2021","venue":"International Conference on Information & Knowledge Management","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Awasthi et al., 2021] Pranjal Awasthi, Alex Beutel, Matthäus Kleindessner, Jamie Morgenstern, and Xuezhi Wang. Evaluating fairness of machine learning mod- els under uncertain and incomplete information. In 2021 ACM Conference on Fairness, Accountability, and Transparency, pages 206-214, 2021.","title":"Evaluating fairness of machine learning models under uncertain and incomplete information","authors":"Pranjal Awasthi, Alex Beutel, Matthäus Kleindessner, Jamie Morgenstern, Xuezhi Wang","year":"2021","venue":"ACM Conference on Fairness, Accountability, and Transparency","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Bacelar, 2021] Marley Bacelar. Monitoring bias and fair- ness in machine learning models: A review. ScienceOpen Preprints, 2021.","title":"Marley Bacelar. Monitoring bias and fairness in machine learning models: A review","authors":"Bacelar","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Bechavod and Ligett, 2017] Yahav Bechavod and Katrina Ligett. Penalizing unfairness in binary classification. arXiv:1707.00044, 2017.","title":"Penalizing unfairness in binary classification","authors":"Ligett Bechavod","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Beutel et al., 2017] Alex Beutel, Jilin Chen, Zhe Zhao, and Ed H Chi. Data decisions and theoretical impli- cations when adversarially learning fair representations. arXiv:1707.00075, 2017.","title":"Data decisions and theoretical implications when adversarially learning fair representations","authors":"Alex Beutel, Jilin Chen, Zhe Zhao, Ed H Chi","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Calders and Verwer, 2010] Toon Calders and Sicco Ver- wer. Three naive bayes approaches for discrimination- free classification. Data mining and knowledge discovery, 21(2):277-292, 2010.","title":"Toon Calders and Sicco Verwer. Three naive bayes approaches for discriminationfree classification","authors":"Verwer Calders","year":"2010","venue":"Data mining and knowledge discovery","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Caton and Haas, 2020] Simon Caton and Christian Haas. Fairness in machine learning: A survey. arXiv:2010.04053, 2020.","title":"Fairness in machine learning: A survey","authors":"Haas Caton, Simon Caton, Christian Haas","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Chen et al., 2019] Jiahao Chen, Nathan Kallus, Xiaojie Mao, Geoffry Svacha, and Madeleine Udell. Fairness un- der unawareness: Assessing disparity when protected class is unobserved. In Conference on fairness, accountability, and transparency, pages 339-348, 2019.","title":"Fairness under unawareness: Assessing disparity when protected class is unobserved","authors":"Chen","year":"2019","venue":"Conference on fairness, accountability, and transparency","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Chiappa, 2019] Silvia Chiappa. Path-specific counterfactual fairness. In AAAI, volume 33, pages 7801-7808, 2019.","title":"Path-specific counterfactual fairness","authors":"Silvia Chiappa","year":"2019","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Chierichetti et al., 2019] Flavio Chierichetti, Ravi Kumar, Silvio Lattanzi, and Sergei Vassilvtiskii. Matroids, match- ings, and fairness. In 22nd Conference on Artificial Intel- ligence and Statistics, pages 2212-2220. PMLR, 2019.","title":"Matroids, matchings, and fairness","authors":"Flavio Chierichetti, Ravi Kumar, Silvio Lattanzi, Sergei Vassilvtiskii","year":"2019","venue":"22nd Conference on Artificial Intelligence and Statistics","doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Corbett-Davies et al., 2017] Sam Corbett-Davies, Emma Pierson, Avi Feller, Sharad Goel, and Aziz Huq. Algorith- mic decision making and the cost of fairness. In 23rd acm sigkdd International Conference on knowledge discovery and data mining, pages 797-806, 2017.","title":"Algorithmic decision making and the cost of fairness","authors":"Corbett-Davies","year":"2017","venue":"23rd acm sigkdd International Conference on knowledge discovery and data mining","doi":null,"url":null,"internal_url":null},{"position":45,"raw":"[Detassis et al., 2020] Fabrizio Detassis, Michele Lombardi, and Michela Milano. Teaching the old dog new tricks: supervised learning with constraints. In NeHuAI@ ECAI, pages 44-51, 2020.","title":"Teaching the old dog new tricks: supervised learning with constraints","authors":"Fabrizio Detassis, Michele Lombardi, Michela Milano","year":"2020","venue":"NeHuAI@ ECAI","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Dwork et al., 2012] Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. Fairness through awareness. In 3 rd innovations in theoretical com- puter science Conference, pages 214-226, 2012.","title":"Fairness through awareness","authors":"Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, Richard Zemel","year":"2012","venue":"3 rd innovations in theoretical computer science Conference","doi":null,"url":null,"internal_url":null},{"position":47,"raw":"[Dwork et al., 2018] Cynthia Dwork, Nicole Immorlica, Adam Tauman Kalai, and Max Leiserson. Decoupled clas- sifiers for group-fair and efficient machine learning. In Conference on fairness, accountability and transparency, pages 119-133. PMLR, 2018.","title":"Decoupled classifiers for group-fair and efficient machine learning","authors":"Cynthia Dwork, Nicole Immorlica, Adam Tauman Kalai, Max Leiserson","year":"2018","venue":"Conference on fairness, accountability and transparency","doi":null,"url":null,"internal_url":null},{"position":48,"raw":"[Edwards and Storkey, 2015] Harrison Edwards and Amos Storkey. Censoring representations with an adversary. arXiv:1511.05897, 2015.","title":"Censoring representations with an adversary","authors":"Storkey Edwards, Harrison Edwards, Amos Storkey","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":49,"raw":"[Feldman et al., 2015] Michael Feldman, Sorelle A Friedler, John Moeller, Carlos Scheidegger, and Suresh Venkata- subramanian. Certifying and removing disparate impact. In 21th ACM International Conference on knowledge dis- covery and data mining, pages 259-268, 2015.","title":"Certifying and removing disparate impact","authors":"Michael Feldman, A Sorelle, John Friedler, Carlos Moeller, Suresh Scheidegger, Venkatasubramanian","year":"2015","venue":"21th ACM International Conference on knowledge discovery and data mining","doi":null,"url":null,"internal_url":null},{"position":50,"raw":"[Feng et al., 2019] Rui Feng, Yang Yang, Yuehan Lyu, Chenhao Tan, Yizhou Sun, and Chunping Wang. Learn- ing fair representations via an adversarial framework. arXiv:1904.13341, 2019.","title":"Learning fair representations via an adversarial framework","authors":"Rui Feng, Yang Yang, Yuehan Lyu, Chenhao Tan, Yizhou Sun, Chunping Wang","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":51,"raw":"[Goh et al., 2016] Gabriel Goh, Andrew Cotter, Maya Gupta, and Michael P Friedlander. Satisfying real-world goals with dataset constraints. Advances in Neural Infor- mation Processing Systems, 29, 2016.","title":"Satisfying real-world goals with dataset constraints","authors":"Gabriel Goh, Andrew Cotter, Maya Gupta, Michael P Friedlander","year":"2016","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":52,"raw":"[Gupta et al., 2018] Maya Gupta, Andrew Cotter, Mahdi Milani Fard, and Serena Wang. Proxy fair- ness. arXiv:1806.11212, 2018.","title":"Proxy fairness","authors":"Maya Gupta, Andrew Cotter, Mahdi Milani Fard, Serena Wang","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":53,"raw":"[Hardt et al., 2016] Moritz Hardt, Eric Price, and Nati Sre- bro. Equality of opportunity in supervised learning. Adv. in neural information processing systems, 29, 2016.","title":"Equality of opportunity in supervised learning","authors":"Moritz Hardt, Eric Price, Nati Srebro","year":"2016","venue":"Adv. in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":54,"raw":"[Heintz et al., 2021] Fredrik Heintz, Michela Milano, and Barry O'Sullivan. Trustworthy AI-Integrating Learning, Optimization and Reasoning. Springer, 2021.","title":"Trustworthy AI-Integrating Learning, Optimization and Reasoning","authors":"Fredrik Heintz, Michela Milano, Barry O' Sullivan","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":55,"raw":"[Howard et al., 2016] Rebecca Howard, Anne Tallontire, Lindsay Stringer, and Rob Marchant. Which \"fairness\", for whom, and why? an empirical analysis of plural notions of fairness in fairtrade carbon projects, using q methodology. Env science & policy, 56:100-109, 2016.","title":"Which \"fairness\", for whom, and why? an empirical analysis of plural notions of fairness in fairtrade carbon projects, using q methodology","authors":"Rebecca Howard, Anne Tallontire, Lindsay Stringer, Rob Marchant","year":"2016","venue":"Env science & policy","doi":null,"url":null,"internal_url":null},{"position":56,"raw":"[Ignatiev et al., 2020] Alexey Ignatiev, Martin C Cooper, Mohamed Siala, Emmanuel Hebrard, and Joao Marques- Silva. Towards formal fairness in machine learning. In CP, pages 846-867. Springer, 2020.","title":"Towards formal fairness in machine learning","authors":"Alexey Ignatiev, Martin C Cooper, Mohamed Siala, Emmanuel Hebrard, Joao Marques-Silva","year":"2020","venue":"CP","doi":null,"url":null,"internal_url":null},{"position":57,"raw":"[Kamiran and Calders, 2012] Faisal Kamiran and Toon Calders. Data preprocessing techniques for classification without discrimination. Knowledge and information systems, 33(1):1-33, 2012.","title":"Faisal Kamiran and Toon Calders. Data preprocessing techniques for classification without discrimination","authors":"Calders Kamiran","year":"2012","venue":"Knowledge and information systems","doi":null,"url":null,"internal_url":null},{"position":58,"raw":"[Kamiran et al., 2010] Faisal Kamiran, Toon Calders, and Mykola Pechenizkiy. Discrimination aware decision tree learning. In 2010 IEEE International Conference on Data Mining, pages 869-874. IEEE, 2010.","title":"Discrimination aware decision tree learning","authors":"Faisal Kamiran, Toon Calders, Mykola Pechenizkiy","year":"2010","venue":"2010 IEEE International Conference on Data Mining","doi":null,"url":null,"internal_url":null},{"position":59,"raw":"[Kamishima et al., 2012] Toshihiro Kamishima, Shotaro Akaho, Hideki Asoh, and Jun Sakuma. Fairness-aware classifier with prejudice remover regularizer. In Joint Eu- ropean Conference on machine learning and knowledge discovery in databases, pages 35-50. Springer, 2012.","title":"Fairness-aware classifier with prejudice remover regularizer","authors":"Toshihiro Kamishima, Shotaro Akaho, Hideki Asoh, Jun Sakuma","year":"2012","venue":"Joint European Conference on machine learning and knowledge discovery in databases","doi":null,"url":null,"internal_url":null},{"position":60,"raw":"[Kilbertus et al., 2017] Niki Kilbertus, Mateo Rojas Carulla, Giambattista Parascandolo, Moritz Hardt, Dominik Janz- ing, and Bernhard Schölkopf. Avoiding discrimination through causal reasoning. Advances in neural information processing systems, 30, 2017.","title":"Avoiding discrimination through causal reasoning","authors":"Niki Kilbertus, Mateo Rojas Carulla, Giambattista Parascandolo, Moritz Hardt, Dominik Janzing, Bernhard Schölkopf","year":"2017","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":61,"raw":"[Krasanakis et al., 2018] Emmanouil Krasanakis, Elefthe- rios Spyromitros-Xioufis, Symeon Papadopoulos, and Yiannis Kompatsiaris. Adaptive sensitive reweighting to mitigate bias in fairness-aware classification. In 2018 WWW Conference, pages 853-862, 2018.","title":"Adaptive sensitive reweighting to mitigate bias in fairness-aware classification","authors":"Emmanouil Krasanakis, Eleftherios Spyromitros-Xioufis, Symeon Papadopoulos, Yiannis Kompatsiaris","year":"2018","venue":"WWW Conference","doi":null,"url":null,"internal_url":null},{"position":62,"raw":"[Kusner et al., 2017] Matt J Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. Counterfactual fairness. Adv. in neural information processing systems, 30, 2017.","title":"Counterfactual fairness","authors":"Matt J Kusner, Joshua Loftus, Chris Russell, Ricardo Silva","year":"2017","venue":"Adv. in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":63,"raw":"[Leavy et al., 2021] Susan Leavy, Eugenia Siapera, and Barry O'Sullivan. Ethical data curation for ai: An ap- proach based on feminist epistemology and critical theo- ries of race. In AAAI/ACM Conference on AI, Ethics, and Society, pages 695-703, 2021.","title":"Ethical data curation for ai: An approach based on feminist epistemology and critical theories of race","authors":"Susan Leavy, Eugenia Siapera, Barry O' Sullivan","year":"2021","venue":"AAAI/ACM Conference on AI, Ethics, and Society","doi":null,"url":null,"internal_url":null},{"position":64,"raw":"[Liu and Vicente, 2021] Suyun Liu and Luis Nunes Vicente. The sharpe predictor for fairness in machine learning. arXiv:2108.06415, 2021.","title":"The sharpe predictor for fairness in machine learning","authors":"Vicente ; Liu, Suyun Liu, Luis Nunes, Vicente","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":65,"raw":"[Lohia et al., 2019] Pranay K Lohia, Karthikeyan Natesan Ramamurthy, Manish Bhide, Diptikalyan Saha, Kush R Varshney, and Ruchir Puri. Bias mitigation post- processing for individual and group fairness. In Interna- tional Conference on acoustics, speech and signal process- ing, pages 2847-2851. IEEE, 2019.","title":"Bias mitigation postprocessing for individual and group fairness","authors":"Karthikeyan Pranay K Lohia, Manish Natesan Ramamurthy, Diptikalyan Bhide, Kush R Saha, Ruchir Varshney, Puri","year":"2019","venue":"International Conference on acoustics, speech and signal processing","doi":null,"url":null,"internal_url":null},{"position":66,"raw":"[Louizos et al., 2015] Christos Louizos, Kevin Swersky, Yu- jia Li, Max Welling, and Richard Zemel. The variational fair autoencoder. arXiv:1511.00830, 2015.","title":"The variational fair autoencoder","authors":"Christos Louizos, Kevin Swersky, Yujia Li, Max Welling, Richard Zemel","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":67,"raw":"[Luong et al., 2011] Binh Thanh Luong, Salvatore Ruggieri, and Franco Turini. k-nn as an implementation of situa- tion testing for discrimination discovery and prevention. In 17th International Conference on Knowledge discovery and data mining, pages 502-510, 2011.","title":"k-nn as an implementation of situation testing for discrimination discovery and prevention","authors":"Thanh Binh, Salvatore Luong, Franco Ruggieri, Turini","year":"2011","venue":"17th International Conference on Knowledge discovery and data mining","doi":null,"url":null,"internal_url":null},{"position":68,"raw":"[Madras et al., 2018] David Madras, Elliot Creager, Toniann Pitassi, and Richard Zemel. Learning adversarially fair and transferable representations. In International Confer- ence on ML, pages 3384-3393. PMLR, 2018.","title":"Learning adversarially fair and transferable representations","authors":"David Madras, Elliot Creager, Toniann Pitassi, Richard Zemel","year":"2018","venue":"International Conference on ML","doi":null,"url":null,"internal_url":null},{"position":69,"raw":"[McCarthy and Narayanan, 2023] Michael B McCarthy and Sundaraparipurnan Narayanan. Fairness-accuracy trade- off: activation function choice in a neural network. AI and Ethics, pages 1-10, 2023.","title":"Fairness-accuracy tradeoff: activation function choice in a neural network","authors":"Narayanan ; Mccarthy, B Michael, Sundaraparipurnan Mccarthy, Narayanan","year":"2023","venue":"AI and Ethics","doi":null,"url":null,"internal_url":null},{"position":70,"raw":"[Mehrabi et al., 2021] Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. A survey on bias and fairness in machine learning. ACM Computing Surveys, 54(6), jul 2021.","title":"A survey on bias and fairness in machine learning","authors":"Mehrabi","year":"2021","venue":"ACM Computing Surveys","doi":null,"url":null,"internal_url":null},{"position":71,"raw":"[Menon and Williamson, 2018] Aditya Krishna Menon and Robert C Williamson. The cost of fairness in binary clas- sification. In Conference on Fairness, Accountability and Transparency, pages 107-118. PMLR, 2018.","title":"The cost of fairness in binary classification","authors":"Aditya, Krishna Menon, Robert C Williamson","year":"2018","venue":"Conference on Fairness, Accountability and Transparency","doi":null,"url":null,"internal_url":null},{"position":72,"raw":"[Mhasawade and Chunara, 2021] Vishwali Mhasawade and Rumi Chunara. Causal multi-level fairness. In AAAI/ACM Conf. on AI, Ethics, and Society, pages 784-794, 2021.","title":"Vishwali Mhasawade and Rumi Chunara. Causal multi-level fairness","authors":"Chunara Mhasawade","year":"2021","venue":"AAAI/ACM Conf. on AI, Ethics, and Society","doi":null,"url":null,"internal_url":null},{"position":73,"raw":"[Pessach and Shmueli, 2021] Dana Pessach and Erez Shmueli. Improving fairness of artificial intelligence algorithms in privileged-group selection bias data settings. Expert Systems with Applications, 185:115667, 2021.","title":"Improving fairness of artificial intelligence algorithms in privileged-group selection bias data settings","authors":"Shmueli Pessach, Dana Pessach, Erez Shmueli","year":"2021","venue":"Expert Systems with Applications","doi":null,"url":null,"internal_url":null},{"position":74,"raw":"[Pessach and Shmueli, 2022] Dana Pessach and Erez Shmueli. A review on fairness in ml. ACM Computing Surveys (CSUR), 55(3):1-44, 2022.","title":"A review on fairness in ml","authors":"Shmueli Pessach, Dana Pessach, Erez Shmueli","year":"2022","venue":"ACM Computing Surveys (CSUR)","doi":null,"url":null,"internal_url":null},{"position":75,"raw":"[Pleiss et al., 2017] Geoff Pleiss, Manish Raghavan, Felix Wu, Jon Kleinberg, and Kilian Q Weinberger. On fairness and calibration. Advances in neural information process- ing systems, 30, 2017.","title":"On fairness and calibration","authors":"Geoff Pleiss, Manish Raghavan, Felix Wu, Jon Kleinberg, Kilian Q Weinberger","year":"2017","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":76,"raw":"[Quadrianto and Sharmanska, 2017] Novi Quadrianto and Viktoriia Sharmanska. Recycling privileged learning and distribution matching for fairness. Advances in Neural In- formation Processing Systems, 30, 2017.","title":"Novi Quadrianto and Viktoriia Sharmanska. Recycling privileged learning and distribution matching for fairness","authors":"Sharmanska Quadrianto","year":"2017","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":77,"raw":"[Robertson and Kesselheim, 2016] Christopher T Robertson and Aaron S Kesselheim. Blinding as a solution to bias: Strengthening biomedical science, forensic science, and law. Academic Press, 2016.","title":"Blinding as a solution to bias: Strengthening biomedical science, forensic science, and law","authors":"T Christopher, Aaron S Robertson, Kesselheim","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":78,"raw":"[Wang et al., 2019] Hao Wang, Berk Ustun, and Flavio Cal- mon. Repairing without retraining: Avoiding disparate impact with counterfactual distributions. In International Conference on ML, pages 6618-6627. PMLR, 2019.","title":"Repairing without retraining: Avoiding disparate impact with counterfactual distributions","authors":"Hao Wang, Berk Ustun, Flavio Calmon","year":"2019","venue":"International Conference on ML","doi":null,"url":null,"internal_url":null},{"position":79,"raw":"[Woodworth et al., 2017] Blake Woodworth, Suriya Gu- nasekar, Mesrob I Ohannessian, and Nathan Srebro. Learning non-discriminatory predictors. In Conference on Learning Theory, pages 1920-1953. PMLR, 2017.","title":"Learning non-discriminatory predictors","authors":"Woodworth","year":"2017","venue":"Conference on Learning Theory","doi":null,"url":null,"internal_url":null},{"position":80,"raw":"[Zafar et al., 2017a] Muhammad B. Zafar, Isabel Valera, Manuel G. Rodriguez, and Krishna P Gummadi. Fairness constraints: Mechanisms for fair classification. In AI and Statistics, pages 962-970. PMLR, 2017.","title":"Fairness constraints: Mechanisms for fair classification","authors":"Zafar","year":"2017","venue":"AI and Statistics","doi":null,"url":null,"internal_url":null},{"position":81,"raw":"[Zafar et al., 2017b] Muhammad Bilal Zafar, Isabel Valera, Manuel G. Rodriguez, and Krishna P Gummadi. Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment. In 26th In- ternational Conference on WWW, pages 1171-1180, 2017.","title":"Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment","authors":"Zafar","year":"2017","venue":"26th International Conference on WWW","doi":null,"url":null,"internal_url":null},{"position":82,"raw":"[Zemel et al., 2013] Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. Learning fair representa- tions. In International Conference on ML, pages 325-333. PMLR, 2013.","title":"Learning fair representations","authors":"Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, Cynthia Dwork","year":"2013","venue":"International Conference on ML","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}