Proceedings

Partially Observable Reference Policy Programming

Edward Kim, Hanna Kurniawati

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 8536-8543.

https://doi.org/10.24963/ijcai.2025/949

Keywords

  • Planning and Scheduling: PS: Planning under uncertainty
  • Planning and Scheduling: PS: Planning with Incomplete Information
  • Machine Learning: ML: Partially observable reinforcement learning and POMDPs
  • Planning and Scheduling: PS: POMDPs

Abstract

This paper proposes Partially Observable Reference Policy Programming, a novel anytime online approximate POMDP solver which samples meaningful future histories very deeply while simultaneously forcing a gradual policy update. We provide theoretical guarantees for the algorithm’s underlying scheme which say that the performance loss is bounded by the average of the sampling approximation errors rather than the usual maximum; a crucial requirement given the sampling sparsity of online planning. Empirical evaluations on two large-scale problems with dynamically evolving environments—including a helicopter emergency scenario in the Corsica region requiring approximately 150 planning steps—corroborate the theoretical results and indicate that our solver considerably outperforms current online benchmarks.

Edward Kim, and Hanna Kurniawati. 2025. Partially Observable Reference Policy Programming. In Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence, IJCAI-25. IJCAI, 8536–8543. https://doi.org/10.24963/ijcai.2025/949
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards