{"type":"ScholarlyArticle","title":"Emergency Response Optimization using Online Hybrid Planning","authors":[{"name":"Durga Harish Dayapule","slug":"durga-harish-dayapule","given":"Durga Harish","family":"Dayapule","affiliation":"School of EECS , Oregon State University , Corvallis , OR , USA"},{"name":"Aswin Raghavan","slug":"aswin-raghavan","given":"Aswin","family":"Raghavan","affiliation":"SRI International , 201 Washington Rd. Princeton , NJ08540"},{"name":"Prasad Tadepalli","slug":"prasad-tadepalli","given":"Prasad","family":"Tadepalli","affiliation":"School of EECS , Oregon State University , Corvallis , OR , USA"},{"name":"Alan Fern","slug":"alan-fern","given":"Alan","family":"Fern","affiliation":"School of EECS , Oregon State University , Corvallis , OR , USA"}],"abstract":"This paper poses the planning problem faced by the dispatcher responding to urban emergencies as a Hybrid (Discrete and Continuous) State and Action Markov Decision Process (HSA-MDP). We evaluate the performance of three online planning algorithms based on hindsight optimization for HSA- MDPs on real-world emergency data in the city of Corvallis, USA. The approach takes into account and respects the policy constraints imposed by the emergency department. We show that our algorithms outperform a heuristic policy commonly used by dispatchers by significantly reducing the average response time as well as lowering the fraction of unanswered calls. Our results give new insights into the problem such as withholding of resources for future emergencies in some situations.","doi":"10.24963/ijcai.2018/656","url":"https://ijcai.org/proceedings/2018/656","pdf":"https://ijcai.org/proceedings/2018/0656.pdf","markdown":"https://ijcai.org/proceedings/2018/656.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/656","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Planning and Scheduling","track":"Main track","number":656,"pages":{"first":4722,"last":4728},"keywords":["Uncertainty in AI: Sequential Decision Making","Planning and Scheduling: Planning Algorithms","Planning and Scheduling: Applications of Planning"],"videos":[],"references":[{"position":1,"raw":"[Aringhieri et al., 2016] R Aringhieri, ME Bruni, S Khoda- parasti, and JT van Essen. Emergency Medical Services and Beyond: Addressing New Challenges Through a Wide Literature Review. Computers & Operations Research, 2016.","title":"Emergency Medical Services and Beyond: Addressing New Challenges Through a Wide Literature Review","authors":"Aringhieri, S Bruni, Khodaparasti, Van Essen","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Azizan et al., 2013] Mohd Hafiz Azizan, Cheng Siong Lim, Go TL Hatta WALWM, and SS Teoh. Simulation of Emer- gency Medical Services Delivery Performance Based on Real Map. International Journal of Engineering and Tech- nology, 5(3):2620-2627, 2013.","title":"Simulation of Emergency Medical Services Delivery Performance Based on Real Map","authors":"Mohd Hafiz Azizan, Siong Cheng, Lim, T L Go, Walwm Hatta, Teoh","year":"2013","venue":"International Journal of Engineering and Technology","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bélanger et al., 2015] Valérie Bélanger, Angel Ruiz, and Patrick Soriano. Recent Advances in Emergency Medi- cal Services Management. Tech. Rep. CIRRELT-2015-28, CIRRELT, 2015.","title":"Recent Advances in Emergency Medical Services Management","authors":"Valérie Bélanger, Angel Ruiz, Patrick Soriano","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bjarnason et al., 2009] Ronald Bjarnason, Prasad Tadepalli, Alan Fern, and Carl Niedner. Simulation-based optimiza- tion of resource placement and emergency response. In IAAI, 2009.","title":"Simulation-based optimization of resource placement and emergency response","authors":"Ronald Bjarnason, Prasad Tadepalli, Alan Fern, Carl Niedner","year":"2009","venue":"IAAI","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Brotcorne et al., 2003] Luce Brotcorne, Gilbert Laporte, and Frederic Semet. Ambulance Location and Reloca- tion Models. European journal of operational research, 147(3):451-463, 2003.","title":"Ambulance Location and Relocation Models","authors":"Luce Brotcorne, Gilbert Laporte, Frederic Semet","year":"2003","venue":"European journal of operational research","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Chang et al., 2000] H. S. Chang, R. L. Givan, and E. K.P. Chong. Online Scheduling via Sampling. In Proceedings of the Conference on Artificial Intelligence Planning and Scheduling, 2000.","title":"Online Scheduling via Sampling","authors":"H S Chang, R L Givan, E K P Chong","year":"2000","venue":"Proceedings of the Conference on Artificial Intelligence Planning and Scheduling","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Chong et al., 2000] E. K.P. Chong, R. L. Givan, and H. S. Chang. A Framework for Simulation-Based Network Con- trol via Hindsight Optimization. In IEEE CDC '00: IEEE Conference on Decision and Control, 2000.","title":"A Framework for Simulation-Based Network Control via Hindsight Optimization","authors":"E K P Chong, R L Givan, H S Chang","year":"2000","venue":"IEEE CDC '00: IEEE Conference on Decision and Control","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Dean, 2008] Stephen F Dean. Why the Closest Ambu- lance Cannot be Dispatched in an Urban Emergency Med- ical Services System. Prehospital and Disaster Medicine, 23(02):161-165, 2008.","title":"Why the Closest Ambulance Cannot be Dispatched in an Urban Emergency Medical Services System","authors":"Stephen F Dean","year":"2008","venue":"Prehospital and Disaster Medicine","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Goldberg, 2004] Jeffrey B Goldberg. Operations Research Models for the Deployment of Emergency Services Vehi- cles. EMS management Journal, 1(1):20-39, 2004.","title":"Operations Research Models for the Deployment of Emergency Services Vehicles","authors":"B Jeffrey, Goldberg","year":"2004","venue":"EMS management Journal","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Haghani et al., 2004] Ali Haghani, Qiang Tian, and Huijun Hu. Simulation Model for Real-Time Emergency Vehi- cle Dispatching and Routing. Transportation Research Record: Journal of the Transportation Research Board, (1882):176-183, 2004.","title":"Simulation Model for Real-Time Emergency Vehicle Dispatching and Routing","authors":"Ali Haghani, Qiang Tian, Huijun Hu","year":"1882","venue":"Transportation Research Record: Journal of the Transportation Research Board","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Jagtenberg et al., 2015] CJ Jagtenberg, Sandjai Bhulai, and RD van der Mei. An Efficient Heuristic for Real-Time Ambulance Redeployment. Operations Research for Health Care, 4:27-35, 2015.","title":"van der Mei. An Efficient Heuristic for Real-Time Ambulance Redeployment","authors":"Jagtenberg","year":"2015","venue":"Operations Research for Health Care","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Kveton et al., 2006] Branislav Kveton, Milos Hauskrecht, and Carlos Guestrin. Solving Factored MDPs with Hy- brid State and Action Variables. J. Artif. Intell. Res.(JAIR), 27:153-201, 2006.","title":"Solving Factored MDPs with Hybrid State and Action Variables","authors":"Kveton","year":"2006","venue":"J. Artif. Intell. Res.(JAIR)","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Leathrum and Niedner, 2012] Roland Leathrum and Carl Niedner. Corvallis Fire Department Response Time Sim- ulation. 2012.","title":"Roland Leathrum and Carl Niedner","authors":"Niedner Leathrum","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Maxwell et al., 2014] Matthew S Maxwell, Eric Cao Ni, Chaoxu Tong, Shane G Henderson, Huseyin Topaloglu, and Susan R Hunter. A Bound on the Performance of an Optimal Ambulance Redeployment Policy. Operations Research, 62(5):1014-1027, 2014.","title":"A Bound on the Performance of an Optimal Ambulance Redeployment Policy","authors":"Eric Cao Matthew S Maxwell, Chaoxu Ni, Tong, Huseyin Shane G Henderson, Susan R Topaloglu, Hunter","year":"2014","venue":"Operations Research","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[McCormack and Coates, 2015] Richard McCormack and Graham Coates. A Simulation Model to Enable the Opti- mization of Ambulance Fleet Allocation and Base Station Location for Increased Patient Survival. European Journal of Operational Research, 247(1):294-309, 2015.","title":"A Simulation Model to Enable the Optimization of Ambulance Fleet Allocation and Base Station Location for Increased Patient Survival","authors":"Coates Mccormack, Richard Mccormack, Graham Coates","year":"2015","venue":"European Journal of Operational Research","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Raghavan et al., 2012] Aswin Raghavan, Saket Joshi, Alan Fern, Prasad Tadepalli, and Roni Khardon. Planning in Factored Action Spaces with Symbolic Dynamic Program- ming. In Twenty-Sixth AAAI Conference on Artificial In- telligence, 2012.","title":"Planning in Factored Action Spaces with Symbolic Dynamic Programming","authors":"Aswin Raghavan, Saket Joshi, Alan Fern, Prasad Tadepalli, Roni Khardon","year":"2012","venue":"Twenty-Sixth AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Raghavan et al., 2017] Aswin Raghavan, Scott Sanner, Roni Khardon, Prasad Tadepalli, and Alan Fern. Hindsight Optimization for Hybrid State and Action MDPs. 2017.","title":"Hindsight Optimization for Hybrid State and Action MDPs","authors":"Aswin Raghavan, Scott Sanner, Roni Khardon, Prasad Tadepalli, Alan Fern","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Sanner et al., 2012] Scott Sanner, Karina Valdivia Delgado, and Leliane Nunes De Barros. Symbolic Dynamic Pro- gramming for Discrete and Continuous State MDPs. arXiv preprint arXiv:1202.3762, 2012.","title":"Symbolic Dynamic Programming for Discrete and Continuous State MDPs","authors":"Scott Sanner, Karina Valdivia Delgado, Leliane Nunes, De Barros","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Sanner, 2011] S. Sanner. Relational Dynamic Influence Di- agram Language (rddl): Language Description. Unpub- lished ms. Australian National University, 2011.","title":"Relational Dynamic Influence Diagram Language (rddl): Language Description","authors":"S Sanner","year":"2011","venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Vianna et al., 2015] Luis GR Vianna, Leliane N De Barros, and Scott Sanner. Real-Time Symbolic Dynamic Program- ming for Hybrid MDPs. 2015.","title":"Real-Time Symbolic Dynamic Programming for Hybrid MDPs","authors":"Leliane N De Luis Gr Vianna, Scott Barros, Sanner","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Yoon et al., 2008] S. Yoon, A. Fern, R. Givan, and S. Kamb- hampati. Probabilistic Planning via Determinization in Hindsight. In Proceedings of the 23rd national confer- ence on Artificial intelligence, volume 2, pages 1010- 1016, 2008.","title":"Probabilistic Planning via Determinization in Hindsight","authors":"S Yoon, A Fern, R Givan, S Kambhampati","year":"2008","venue":"Proceedings of the 23rd national conference on Artificial intelligence","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}