Decision Making with Differential Privacy under a Fairness Lens

Decision Making with Differential Privacy under a Fairness Lens

Cuong Tran, Ferdinando Fioretto, Pascal Van Hentenryck, Zhiyan Yao

Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence
Main Track. Pages 560-566. https://doi.org/10.24963/ijcai.2021/78

Many agencies release datasets and statistics about groups of individuals that are used as input to a number of critical decision processes. To conform with privacy and confidentiality requirements, these agencies are often required to release privacy-preserving versions of the data. This paper studies the release of differentially private datasets and analyzes their impact on some critical resource allocation tasks under a fairness perspective. The paper shows that, when the decisions take as input differentially private data, the noise added to achieve privacy disproportionately impacts some groups over others. The paper analyzes the reasons for these disproportionate impacts and proposes guidelines to mitigate these effects. The proposed approaches are evaluated on critical decision problems that use differentially private census data.
Keywords:
AI Ethics, Trust, Fairness: Fairness
Multidisciplinary Topics and Applications: Security and Privacy
Data Mining: Privacy Preserving Data Mining
Machine Learning: Classification