{"type":"ScholarlyArticle","title":"Towards Reducing Biases in Combining Multiple Experts Online","authors":[{"name":"Yi Sun","slug":"yi-sun","given":"Yi","family":"Sun","affiliation":""},{"name":"Iván Ramírez Díaz","slug":"ivan-ramirez-diaz","given":"Iván","family":"Ramírez Díaz","affiliation":""},{"name":"Alfredo Cuesta Infante","slug":"alfredo-cuesta-infante","given":"Alfredo","family":"Cuesta Infante","affiliation":""},{"name":"Kalyan Veeramachaneni","slug":"kalyan-veeramachaneni","given":"Kalyan","family":"Veeramachaneni","affiliation":""}],"abstract":"In many real life situations, including job and loan applications, gatekeepers must make justified and fair real-time decisions about a person’s fitness for a particular opportunity. In this paper, we aim to accomplish approximate group fairness in an online stochastic decision-making process, where the fairness metric we consider is equalized odds. Our work follows from the classical learning-from-experts scheme, assuming a finite set of classifiers (human experts, rules, options, etc) that cannot be modified. We run separate instances of the algorithm for each label class as well as sensitive groups, where the probability of choosing each instance is optimized for both fairness and regret. Our theoretical results show that approximately equalized odds can be achieved without sacrificing much regret. We also demonstrate the performance of the algorithm on real data sets commonly used by the fairness community.","doi":"10.24963/ijcai.2021/416","url":"https://ijcai.org/proceedings/2021/416","pdf":"https://ijcai.org/proceedings/2021/0416.pdf","markdown":"https://ijcai.org/proceedings/2021/416.md","bibtex":"https://ijcai.org/proceedings/2021/bibtex/416","volume":{"slug":"2021","title":"Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2021","url":"https://ijcai.org/proceedings/2021/","year":2021,"location":"Montreal","dates":"19-27 August 2021","editors":"Prof. Zhi-Hua Zhou","isbn":"978-0-9992411-9-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2021"},"section":"Machine Learning","track":"Main Track","number":416,"pages":{"first":3024,"last":3030},"keywords":["Machine Learning: Online Learning","AI Ethics, Trust, Fairness: Fairness"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}