Reassessing Evaluation Functions in Algorithmic Recourse: An Empirical Study from a Human-Centered Perspective

Reassessing Evaluation Functions in Algorithmic Recourse: An Empirical Study from a Human-Centered Perspective

Tomu Tominaga, Naomi Yamashita, Takeshi Kurashima

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence
Human-Centred AI. Pages 7913-7921. https://doi.org/10.24963/ijcai.2024/876

In this study, we critically examine the foundational premise of algorithmic recourse - a process of generating counterfactual action plans (i.e., recourses) assisting individuals to reverse adverse decisions made by AI systems. The assumption underlying algorithmic recourse is that individuals accept and act on recourses that minimize the gap between their current and desired states. This assumption, however, remains empirically unverified. To address this issue, we conducted a user study with 362 participants and assessed whether minimizing the distance function, a metric of the gap between the current and desired states, indeed prompts them to accept and act upon suggested recourses. Our findings reveal a nuanced landscape: participants' acceptance of recourses did not correlate with the recourse distance. Moreover, participants' willingness to act upon recourses peaked at the minimal recourse distance but was otherwise constant. These findings cast doubt on the prevailing assumption of algorithmic recourse research and signal the need to rethink the evaluation functions to pave the way for human-centered recourse generation.
Keywords:
Humans and AI: HAI: Intelligent user interfaces
Humans and AI: HAI: Human-computer interaction
Humans and AI: HAI: Applications
AI Ethics, Trust, Fairness: ETF: Explainability and interpretability