---
title: "Forward Search Value Iteration for POMDPs"
authors:
  - "Guy Shani"
  - "Ronen I. Brafman"
  - "Solomon Eyal Shimony"
doi: ""
url: "https://ijcai.org/proceedings/2007/421"
pdf: "https://ijcai.org/proceedings/2007/0421.pdf"
venue: "Proceedings of the Twentieth International Joint Conference on Artificial Intelligence"
year: 2007
pages: "2619-2623"
track: ""
keywords:
---

# Forward Search Value Iteration for POMDPs

Guy Shani, Ronen I. Brafman, Solomon Eyal Shimony

*Proceedings of the Twentieth International Joint Conference on Artificial Intelligence*, pages 2619-2623.

## Abstract

Recent scaling up of POMDP solvers towards realistic applications is largely due to point-based methods which quickly converge to an approximate solution for medium-sized problems. Of this family HSVI, which uses trial-based asynchronous value iteration, can handle the largest domains. In this paper we suggest a new algorithm, FSVI, that uses the underlying MDP to traverse the belief space towards rewards, finding sequences of useful backups, and show how it scales up better than HSVI on larger benchmarks.