Proceedings

A Resource-Aware Taxonomy of AI Bias Mitigation Techniques

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Survey Track. Pages 7949-7957.

https://doi.org/10.24963/ijcai.2026/882

Abstract

The literature on AI fairness has grown rapidly, proposing a large number of bias mitigation techniques that are commonly organized into pre-, in-, and post-processing methods. This pipeline-centric view offers an operational, lifecycle-based perspective on where mitigation can be applied. In deployment settings, however, practitioners also face an additional question: whether a mitigation family is applicable given the resources and access rights available in a concrete system.

In this survey, we use resources broadly to denote data access/control, training capability, and deployment-time interface/decision control.

Accordingly, we introduce a resource-aware taxonomy that complements existing taxonomies by classifying AI bias mitigation methods according to the conditions that make them practically implementable. We use this taxonomy to structure and reinterpret existing literature on the topic, highlighting which mitigation families remain feasible under resource constraints.

  1. [Adler et al., 2018] Philip Adler, Casey Falk, Sorelle Friedler, Tionney Nix, Gabriel Rybeck, Carlos Scheideg- ger, Brandon Smith, and Suresh Venkatasubramanian. Auditing black-box models for indirect influence. Knowledge and Information Systems, 54(1), 2018.
  2. [Attanasio et al., 2022] Giuseppe Attanasio, Debora Nozza, Dirk Hovy, and Elena Baralis. Entropy-based attention regularization frees unintended bias mitigation from lists. In Annual Meeting of ACL, pages 1105-1119, 2022.
  3. [Blanzeisky and Cunningham, 2022] William Blanzeisky and Pádraig Cunningham. Using Pareto simulated an- nealing to address algorithmic bias in machine learning. Know. Eng. Review, 37, 2022.
  4. [Borchers et al., 2022] Conrad Borchers, Dalia Gala, Ben- jamin Gilburt, Eduard Oravkin, Wilfried Bounsi, Yuki Asano, and Hannah Kirk. Looking for a handsome carpen- ter! debiasing GPT-3 job advertisements. In 4th Workshop on Gender Bias in Natural Language Processing, pages 212-224, 2022.
  5. [Caton and Haas, 2024] Simon Caton and Christian Haas. Fairness in machine learning: A survey. ACM CSUR, 56(7), April 2024.
  6. [Cotter et al., 2019] Andrew Cotter, Heinrich Jiang, Maya Gupta, Serena Wang, Taman Narayan, Seungil You, and Karthik Sridharan. Optimization with non-differentiable constraints with applications to fairness, recall, churn, and other goals. Journal of ML Research, 20, 2019.
  7. [Ekstrand et al., 2018] Michael Ekstrand, Mucun Tian, Ion Madrazo Azpiazu, Jennifer Ekstrand, Oghenemaro Anuyah, David McNeill, and Maria Soledad Pera. All the cool kids, how do they fit in? Popularity and demographic biases in recommender evaluation and effectiveness. In Conference on fairness, accountability and transparency, pages 172-186. PMLR, 2018. [European Parliament, 2024] European Parliament. Regula- tion (eu) 2024/1689 (Artificial Intelligence Act), 2024.
  8. [Feldman et al., 2015] Michael Feldman, Sorelle Friedler, John Moeller, Carlos Scheidegger, and Suresh Venkata- subramanian. Certifying and removing disparate impact. In 21th ACM SIGKDD international conference on knowl- edge discovery and data mining, pages 259-268, 2015.
  9. [Feng et al., 2019] Rui Feng, Yang Yang, Yuehan Lyu, Chenhao Tan, Yizhou Sun, and Chunping Wang. Learning fair representations via an adversarial framework, 2019.
  10. [Gallegos et al., 2024] Isabel Gallegos, Ryan Rossi, Joe Bar- row, Md Mehrab Tanjim, Sungchul Kim, Franck Dernon- court, Tong Yu, Ruiyi Zhang, and Nesreen Ahmed. Bias and fairness in large language models: A survey. Compu- tational Linguistics, 50(3):1097-1179, 2024.
  11. [Garimella et al., 2022] Aparna Garimella, Rada Mihalcea, and Akhash Amarnath. Demographic-aware language model fine-tuning as a bias mitigation technique. pages 311-319, 2022.
  12. [Ge et al., 2021] Yingqiang Ge, Shuchang Liu, Ruoyuan Gao, Yikun Xian, Yunqi Li, Xiangyu Zhao, Changhua Pei, Fei Sun, Junfeng Ge, Wenwu Ou, et al. Towards long-term fairness in recommendation. In 14th ACM int. conference on web search and data mining, pages 445-453, 2021.
  13. [Gira et al., 2022] Michael Gira, Ruisu Zhang, and Kang- wook Lee. Debiasing pre-trained language models via ef- ficient fine-tuning. In Proceedings of the second workshop on language technology for equality, diversity and inclu- sion, pages 59-69, 2022.
  14. [Grgić-Hlača et al., 2018] Nina Grgić-Hlača, Muham- mad Bilal Zafar, Krishna Gummadi, and Adrian Weller. Beyond Distributive Fairness in Algorithmic Decision Making: Feature Selection for Procedurally Fair Learning. 32(1), 2018.
  15. [Han et al., 2022] Xudong Han, Timothy Baldwin, and Trevor Cohn. Balancing out bias: Achieving fairness through balanced training. In Conf. on empirical methods in NLP, pages 11335-11350, 2022.
  16. [Hasan et al., 2024] Adib Hasan, Ileana Rugina, and Alex Wang. Pruning for protection: Increasing jail- break resistance in aligned llms without fine-tuning. arXiv:2401.10862, 2024.
  17. [Hébert-Johnson et al., 2018] Ursula Hébert-Johnson, Michael Kim, Omer Reingold, and Guy Rothblum. Multicalibration: Calibration for the (computationally- identifiable) masses. In Int. Conf. on ML, pages 1939-1948. PMLR, 2018.
  18. [Hort et al., 2024] Max Hort, Zhenpeng Chen, Jie Zhang, Mark Harman, and Federica Sarro. Bias mitigation for ma- chine learning classifiers: A comprehensive survey. ACM Journal on Responsible Computing, 1(2):1-52, 2024.
  19. [Hossain et al., 2021] Safwan Hossain, Evi Micha, and Nis- arg Shah. Fair algorithms for multi-agent multi-armed bandits. volume 34, pages 24005-24017, 2021.
  20. [Iosifidis et al., 2019] Vasileios Iosifidis, Besnik Fetahu, and Eirini Ntoutsi. FAE: A Fairness-Aware Ensemble Frame- work. In 2019 IEEE international conference on big data (big data), pages 1375-1380. IEEE, 2019.
  21. [Islam et al., 2021] Rashidul Islam, Kamrun Naher Keya, Ziqian Zeng, Shimei Pan, and James Foulds. Debiasing career recommendations with neural fair collaborative fil- tering. In Web Conference 2021, pages 3779-3790, 2021.
  22. [Jiang et al., 2020] Ray Jiang, Aldo Pacchiano, Tom Steple- ton, Heinrich Jiang, and Silvia Chiappa. Wasserstein fair classification. In Conf. Uncertainty in AI 2020. PMLR, 2020.
  23. [Kamiran and Calders, 2012] Faisal Kamiran and Toon Calders. Data preprocessing techniques for classification without discrimination. Knowledge and information systems, 33(1):1-33, 2012.
  24. [Kamishima et al., 2012] Toshihiro Kamishima, Shotaro Akaho, Hideki Asoh, and Jun Sakuma. Fairness-Aware Classifier with Prejudice Remover Regularizer. In Joint European conf. on ML and knowledge discovery in databases, pages 35-50. 2012.
  25. [Kaya et al., 2020] Mesut Kaya, Derek Bridge, and Nava Tintarev. Ensuring fairness in group recommendations by rank-sensitive balancing of relevance. In RecSys 2020, pages 101-110, 2020.
  26. [Kim et al., 2018] Michael Kim, Omer Reingold, and Guy Rothblum. Fairness through computationally-bounded awareness. volume 31, 2018.
  27. [Kusner et al., 2017] Matt J Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. Counterfactual Fairness, 2017. [Lauscher et al., 2021]
  28. Anne Lauscher, Tobias Lueken, and Goran Glavaš. Sustainable modular debiasing of language models. arXiv:2109.03646, 2021.
  29. [Limisiewicz and Mareček, 2022] Tomasz Limisiewicz and David Mareček. Don't forget about pronouns: Remov- ing gender bias in language models without losing factual gender information. In arXiv:2206.10744, 2022.
  30. [Lu et al., 2020] Kaiji Lu, Piotr Mardziel, Fangjing Wu, Preetam Amancharla, and Anupam Datta. Gender bias in neural nlp. LNCS, 12300 LNCS:189-202, 2020.
  31. [Luong et al., 2011] Binh Thanh Luong, Salvatore Ruggieri, and Franco Turini. k-NN as an implementation of situ- ation testing for discrimination discovery and prevention. In 17th ACM SIGKDD int. conf. on Knowledge discovery and data mining, pages 502-510, 2011.
  32. [Maudslay et al., 2019] Rowan Hall Maudslay, Hila Gonen, Ryan Cotterell, and Simone Teufel. It's all in the name: Mitigating gender bias with name-based counterfactual data substitution. arXiv:1909.00871, 2019.
  33. [Menon and Williamson, 2018] Aditya Krishna Menon and Robert Williamson. The cost of fairness in binary clas- sification. In Conference on Fairness, accountability and transparency, pages 107-118. PMLR, 2018.
  34. [Metevier et al., 2019] Blossom Metevier, Stephen Giguere, Sarah Brockman, Ari Kobren, Yuriy Brun, Emma Brun- skill, and Philip Thomas. Offline contextual bandits with high probability fairness guarantees. Advances in neural information processing systems, 32, 2019.
  35. [Nabi and Shpitser, 2018] Razieh Nabi and Ilya Shpitser. Fair Inference on Outcomes. In AAAI conference on ar- tificial intelligence, volume 32, 2018.
  36. [Panda et al., 2022] Swetasudha Panda, Ari Kobren, Michael Wick, and Qinlan Shen. Don't just clean it, proxy clean it: Mitigating bias by proxy in pre-trained models. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 5073-5085, 2022.
  37. [Petrović et al., 2022] Andrija Petrović, Mladen Nikolić, Sandro Radovanović, Boris Delibašić, and Miloš Jo- vanović. FAIR: Fair adversarial instance re-weighting. Neurocomputing, 476:14-37, 2022.
  38. [Pleiss et al., 2017] Geoff Pleiss, Manish Raghavan, Felix Wu, Jon Kleinberg, and Kilian Weinberger. On fairness and calibration. Advances in neural information process- ing systems, 30, 2017.
  39. [Raffel et al., 2020] Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of ML research, 21(140):1-67, 2020.
  40. [Serbos et al., 2017] Dimitris Serbos, Shuyao Qi, Nikos Mamoulis, Evaggelia Pitoura, and Panayiotis Tsaparas. Fairness in package-to-group recommendations. In 26th international conference on world wide web, pages 371- 379, 2017.
  41. [Thakur et al., 2023] Himanshu Thakur, Atishay Jain, Pra- neetha Vaddamanu, Paul Pu Liang, and Louis-Philippe Morency. Language models get a gender makeover: Mitigating gender bias with few-shot data interventions. arXiv:2306.04597, 2023.
  42. [Tokpo and Calders, 2022] Ewoenam Kwaku Tokpo and Toon Calders. Text style transfer for bias mitigation us- ing masked language modeling. arXiv:2201.08643, 2022.
  43. [Wang et al., 2020] Serena Wang, Wenshuo Guo, Harikr- ishna Narasimhan, Andrew Cotter, Maya Gupta, and Michael Jordan. Robust optimization for fairness with noisy protected groups. volume 33, pages 5190-5203, 2020.
  44. [Wang et al., 2021] Lequn Wang, Yiwei Bai, Wen Sun, and Thorsten Joachims. Fairness of exposure in stochastic ban- dits. In Int. Conf. on ML, pages 10686-10696. PMLR, 2021.
  45. [Wang et al., 2023] Yifan Wang, Weizhi Ma, Min Zhang, Yiqun Liu, and Shaoping Ma. A survey on the fairness of recommender systems. ACM Transactions on Information Systems, 41(3):1-43, 2023.
  46. [Xu et al., 2018] Depeng Xu, Shuhan Yuan, Lu Zhang, and Xintao Wu. FairGAN: Fairness-aware generative adver- sarial networks. In IEEE Int. Conf. on Big Data, Big Data 2018, IEEE Int. Conf. on Big Data, Big Data 2018, pages 570-575, 2018.
  47. [Xue et al., 2024] Yuyang Xue, Junyu Yan, Raman Dutt, Fasih Haider, Jingshuai Liu, Steven McDonagh, and Sotirios A Tsaftaris. BMFT: Achieving Fairness via Bias- Based Weight Masking Fine-Tuning. In Workshop on Fair- ness of AI in Medical Imaging, pages 98-108. 2024.
  48. [Zayed et al., 2024] Abdelrahman Zayed, Gonc ¸alo Mordido, Samira Shabanian, Ioana Baldini, and Sarath Chan- dar. Fairness-Aware Structured Pruning in Transformers. 38(20):22484-22492, 2024.
  49. [Zhou et al., 2025] Songqi Zhou, Zeyuan Liu, and Benben Jiang. FairNet: Dynamic Fairness Correction without Per- formance Loss via Contrastive Conditional LoRA, 2025.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards