Proceedings

Human-Centric Behavior-Aware Adaptive Off-Policy Selection

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Human-Centred AI. Pages 7638-7646.

© 2026 International Joint Conferences on Artificial Intelligence

Abstract

In many human-centric environments, such as education and healthcare, the unobservability of human underlying states has been recognized as a key obstacle for understanding individual needs, thus hindering our ability to provide personalized decision-making policies. Several reinforcement learning (RL)-related approaches have been used to facilitate sequential decision-making in these settings, including off-policy selection (OPS), which aids in safely evaluating and selecting optimal policies offline. However, existing OPS algorithms are unsuitable when both the state is unobserved and the setting requires a personalized policy. To address this challenge, we propose a behavior-aware adaptive policy selection framework (HBO) that first captures potentially unique characteristics of the state from human behaviors, and then estimates when and how to intervene with less uncertainty in a timely manner, with bounded error. HBO is evaluated over two real-world human-centric applications, intelligent tutoring and sepsis treatments, where it significantly enhanced participants' long-term course outcomes and survival rates. Broadly, our work enables improved policy personalization in high-stakes domains where extensive evaluation is not possible.

Ge Gao, Aishwarya Mandyam, Joy He-Yueya, Min Chi, and Emma Brunskill. 2026. Human-Centric Behavior-Aware Adaptive Off-Policy Selection. In Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-26. IJCAI, 7638–7646. https://ijcai.org/proceedings/2026/849
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards