---
title: "Human-Centric Behavior-Aware Adaptive Off-Policy Selection"
authors:
  - "Ge Gao"
  - "Aishwarya Mandyam"
  - "Joy He-Yueya"
  - "Min Chi"
  - "Emma Brunskill"
doi: ""
url: "https://ijcai.org/proceedings/2026/849"
pdf: "https://ijcai.org/proceedings/2026/0849.pdf"
venue: "Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence"
year: 2026
pages: "7638-7646"
track: "Human-Centred AI"
keywords:
  - "Human-Centred AI: Agent-based and Multi-agent Systems"
  - "Human-Centred AI: Humans and AI"
  - "Human-Centred AI: Uncertainty in AI"
  - "Human-Centred AI: Multidisciplinary Topics and Applications"
---

# Human-Centric Behavior-Aware Adaptive Off-Policy Selection

Ge Gao, Aishwarya Mandyam, Joy He-Yueya, Min Chi, Emma Brunskill

*Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence*, pages 7638-7646.

## Abstract

In many human-centric environments, such as education and healthcare, the unobservability of human underlying states has been recognized as a key obstacle for understanding individual needs, thus hindering our ability to provide personalized decision-making policies. Several reinforcement learning (RL)-related approaches have been used to facilitate sequential decision-making in these settings, including off-policy selection (OPS), which aids in safely evaluating and selecting optimal policies offline. However, existing OPS algorithms are unsuitable when both the state is unobserved and the setting requires a personalized policy. To address this challenge, we propose a behavior-aware adaptive policy selection framework (HBO) that first captures potentially unique characteristics of the state from human behaviors, and then estimates when and how to intervene with less uncertainty in a timely manner, with bounded error. HBO is evaluated over two real-world human-centric applications, intelligent tutoring and sepsis treatments, where it significantly enhanced participants' long-term course outcomes and survival rates. Broadly, our work enables improved policy personalization in high-stakes domains where extensive evaluation is not possible.
