{"type":"ScholarlyArticle","title":"Model Checking Probabilistic Epistemic Logic for Probabilistic Multiagent Systems","authors":[{"name":"Chen Fu","slug":"chen-fu","given":"Chen","family":"Fu","affiliation":"State Key Laboratory of Computer Science , Institute of Software , Chinese Academy of Sciences; University of Chinese Academy of Sciences"},{"name":"Andrea Turrini","slug":"andrea-turrini","given":"Andrea","family":"Turrini","affiliation":"State Key Laboratory of Computer Science , Institute of Software , Chinese Academy of Sciences"},{"name":"Xiaowei Huang","slug":"xiaowei-huang","given":"Xiaowei","family":"Huang","affiliation":"Department of Computer Science , University of Liverpool"},{"name":"Lei Song","slug":"lei-song","given":"Lei","family":"Song","affiliation":"JD .com"},{"name":"Yuan Feng","slug":"yuan-feng","given":"Yuan","family":"Feng","affiliation":"Centre for Quantum Software and Information , University of Technology Sydney"},{"name":"Lijun Zhang","slug":"lijun-zhang","given":"Lijun","family":"Zhang","affiliation":"State Key Laboratory of Computer Science , Institute of Software , Chinese Academy of Sciences; University of Chinese Academy of Sciences"}],"abstract":"In this work we study the model checking problem for probabilistic multiagent systems with respect to the probabilistic epistemic logic PETL, which can specify both temporal and epistemic properties. We show that under the realistic assumption of uniform schedulers, i.e., the choice of every agent depends only on its observation history, PETL model checking is undecidable. By restricting the class of schedulers to be memoryless schedulers, we show that the problem becomes decidable. More importantly, we design a novel algorithm which reduces the model checking problem into a mixed integer non-linear programming problem, which can then be solved by using an SMT solver. The algorithm has been implemented in an existing model checker and experiments are conducted on examples from the IPPC competitions.","doi":"10.24963/ijcai.2018/661","url":"https://ijcai.org/proceedings/2018/661","pdf":"https://ijcai.org/proceedings/2018/0661.pdf","markdown":"https://ijcai.org/proceedings/2018/661.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/661","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Planning and Scheduling","track":"Main track","number":661,"pages":{"first":4757,"last":4763},"keywords":["Agent-based and Multi-agent Systems: Formal Verification, Validation and Synthesis","Knowledge Representation and Reasoning: Knowledge Representation and Reasoning for Game Playing","Planning and Scheduling: Planning with Incomplete information"],"videos":[],"references":[{"position":1,"raw":"[Alur et al., 2002] Rajeev Alur, Thomas A. Henzinger, and Orna Kupferman. Alternating-time temporal logic. J. ACM, 49(5):672-713, 2002.","title":"Alternating-time temporal logic","authors":"Rajeev Alur, Thomas A Henzinger, Orna Kupferman","year":"2002","venue":"J. ACM","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Baier and Katoen, 2008] Christel Baier and Joost-Pieter Katoen. Principles of Model Checking. The MIT Press, 2008.","title":"Principles of Model Checking","authors":"Christel Baier, Joost-Pieter Katoen","year":"2008","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[de Moura and Bjørner, 2008] Leonardo de Moura and Nikolaj Bjørner. Z3: an efficient SMT solver. In TACAS, volume 4963 of LNCS, pages 337-340, 2008.","title":"Leonardo de Moura and Nikolaj Bjørner. Z3: an efficient SMT solver","authors":"De Moura, Bjørner","year":"2008","venue":"TACAS","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Delgado and Benevides, 2009] Carla A. D. M. Delgado and Mario R. F. Benevides. Verification of epistemic properties in probabilistic multi-agent systems. In MATES, volume 5774 of LNCS, pages 16-28, 2009.","title":"Verification of epistemic properties in probabilistic multi-agent systems","authors":"A D M Carla, Mario R F Delgado, Benevides","year":"2009","venue":"MATES","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Fagin et al., 2004] Ronald Fagin, Joseph Y Halpern, Yoram Moses, and Moshe Vardi. Reasoning about knowledge. MIT press, 2004.","title":"Reasoning about knowledge","authors":"Ronald Fagin, Yoram Joseph Y Halpern, Moshe Moses, Vardi","year":"2004","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Hahn et al., 2014] Ernst Moritz Hahn, Yi Li, Sven Schewe, Andrea Turrini, and Lijun Zhang. IscasMC: A web-based probabilistic model checker. In FM, volume 8442 of LNCS, pages 312-317. Springer, 2014.","title":"IscasMC: A web-based probabilistic model checker","authors":"Hahn","year":"2014","venue":"FM","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Huang and Luo, 2013] Xiaowei Huang and Cheng Luo. A logic of probabilistic knowledge and strategy. In AAMAS, pages 845-852, 2013.","title":"A logic of probabilistic knowledge and strategy","authors":"Xiaowei Huang, Cheng Luo","year":"2013","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Huang and van der Meyden, 2014] Xiaowei Huang and Ron van der Meyden. Symbolic model checking epistemic strategy logic. In AAAI, pages 1426-1432, 2014.","title":"Symbolic model checking epistemic strategy logic","authors":"Van Huang, Xiaowei Der Meyden, Ron Huang, Van Der Meyden","year":"2014","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Huang et al., 2011] Xiaowei Huang, Cheng Luo, and Ron van der Meyden. Symbolic model checking of probabilis- tic knowledge. In TARK, pages 177-186, 2011.","title":"Symbolic model checking of probabilistic knowledge","authors":"Xiaowei Huang, Cheng Luo, Ron Van Der Meyden","year":"2011","venue":"TARK","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Huang et al., 2012] Xiaowei Huang, Kaile Su, and Chenyi Zhang. Probabilistic alternating-time temporal logic of in- complete information and synchronous perfect recall. In AAAI, 2012. [Jamroga and van der Hoek, 2004] Wojciech Jamroga and Wiebe van der Hoek. Agents that know how to play. Fun- dam. Inform., 63(2-3):185-219, 2004.","title":"Probabilistic alternating-time temporal logic of incomplete information and synchronous perfect recall","authors":"Xiaowei Huang, Kaile Su, Chenyi Zhang","year":"2004","venue":"Jamroga and van der Hoek","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Jamroga, 2003] Wojciech Jamroga. Some remarks on alter- nating temporal epistemic logic. In FAMAS, pages 133- 140, 2003.","title":"Some remarks on alternating temporal epistemic logic","authors":"Wojciech Jamroga","year":"2003","venue":"FAMAS","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Jonsson and Larsen, 1991] Bengt Jonsson and Kim Guld- strand Larsen. Specification and refinement of probabilis- tic processes. In LICS, pages 266-277, 1991.","title":"Specification and refinement of probabilistic processes","authors":"Jonsson, Larsen, Bengt Jonsson, Kim Guldstrand Larsen","year":"1991","venue":"LICS","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Kazmierczak et al., 2014] Piotr Kazmierczak, Thomas Ågotnes, and Wojciech Jamroga. Multi-agency is coordi- nation and (limited) communication. In PRIMA, volume 8861 of LNCS, pages 91-106, 2014.","title":"Multi-agency is coordination and (limited) communication","authors":"Piotr Kazmierczak, Thomas Ågotnes, Wojciech Jamroga","year":"2014","venue":"PRIMA","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Kwiatkowska et al., 2011] Marta Kwiatkowska, Gethin Norman, and David Parker. PRISM 4.0: Verification of probabilistic real-time systems. In CAV, volume 6806 of LNCS, pages 585-591, 2011.","title":"PRISM 4.0: Verification of probabilistic real-time systems","authors":"Marta Kwiatkowska, Gethin Norman, David Parker","year":"2011","venue":"CAV","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Lomuscio et al., 2017] Alessio Lomuscio, Hongyang Qu, and Franco Raimondi. MCMAS: an open-source model checker for the verification of multi-agent systems. STTT, 19(1):9-30, 2017.","title":"MCMAS: an open-source model checker for the verification of multi-agent systems","authors":"Alessio Lomuscio, Hongyang Qu, Franco Raimondi","year":"2017","venue":"STTT","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Nair et al., 2005] Ranjit Nair, Pradeep Varakantham, Milind Tambe, and Makoto Yokoo. Networked distributed POMDPs: A synthesis of distributed constraint optimiza- tion and POMDPs. In AAAI, pages 133-139, 2005.","title":"Networked distributed POMDPs: A synthesis of distributed constraint optimization and POMDPs","authors":"Ranjit Nair, Pradeep Varakantham, Milind Tambe, Makoto Yokoo","year":"2005","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Paz, 1971] Azaria Paz. Introduction to probabilistic au- tomata (Computer science and applied mathematics). Academic Press, 1971.","title":"Azaria Paz. Introduction to probabilistic automata (Computer science and applied mathematics","authors":"Paz","year":"1971","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Pynadath and Tambe, 2002] David V. Pynadath and Milind Tambe. The communicative multiagent team decision problem: Analyzing teamwork theories and models. J. Artif. Intell. Res., 16:389-423, 2002.","title":"The communicative multiagent team decision problem: Analyzing teamwork theories and models","authors":"David V Pynadath, Milind Tambe","year":"2002","venue":"J. Artif. Intell. Res","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Rabin, 1963] Michael O. Rabin. Probabilistic automata. In- formation and Control, 6(3):230-245, 1963.","title":"Probabilistic automata","authors":"O Michael, Rabin","year":"1963","venue":"Information and Control","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Schnoor, 2010] Henning Schnoor. Strategic planning for probabilistic games with incomplete information. In AA- MAS, pages 1057-1064, 2010.","title":"Strategic planning for probabilistic games with incomplete information","authors":"Henning Schnoor","year":"2010","venue":"AA-MAS","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Seuken and Zilberstein, 2008] Sven Seuken and Shlomo Zilberstein. Formal models and algorithms for decen- tralized decision making under uncertainty. Autonomous Agents and Multi-Agent Systems, 17(2):190-250, 2008.","title":"Formal models and algorithms for decentralized decision making under uncertainty","authors":"Zilberstein Seuken","year":"2008","venue":"Autonomous Agents and Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Sultan et al., 2014] Khalid Sultan, Jamal Bentahar, Wei Wan, and Faisal Al-Saqqar. Modeling and verifying prob- abilistic multi-agent systems using knowledge and so- cial commitments. Expert Systems with Applications, 41(14):6291 -6304, 2014.","title":"Modeling and verifying probabilistic multi-agent systems using knowledge and social commitments","authors":"Khalid Sultan, Jamal Bentahar, Wei Wan, Faisal Al-Saqqar","year":"2014","venue":"Expert Systems with Applications","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[van der Hoek and Wooldridge, 2002] Wiebe van der Hoek and Michael Wooldridge. Tractable multiagent planning for epistemic goals. In AAMAS, pages 1167-1174, 2002.","title":"Tractable multiagent planning for epistemic goals","authors":"Hoek Van Der, Michael Wooldridge ; Wiebe Van Der Hoek, Wooldridge","year":"2002","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Wan et al., 2013] Wei Wan, Jamal Bentahar, and Ab- dessamad Ben Hamza. Model checking epistemic prob- abilistic logic using probabilistic interpreted systems. Knowledge-Based Systems, 50:279 -295, 2013.","title":"Model checking epistemic probabilistic logic using probabilistic interpreted systems","authors":"Wei Wan, Jamal Bentahar, Abdessamad Ben, Hamza","year":"2013","venue":"Knowledge-Based Systems","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}