{"type":"ScholarlyArticle","title":"Probabilistic Temporal Logic for Reasoning about Bounded Policies","authors":[{"name":"Nima Motamed","slug":"nima-motamed","given":"Nima","family":"Motamed","affiliation":"Utrecht University"},{"name":"Natasha Alechina","slug":"natasha-alechina","given":"Natasha","family":"Alechina","affiliation":"Utrecht University"},{"name":"Mehdi Dastani","slug":"mehdi-dastani","given":"Mehdi","family":"Dastani","affiliation":"Utrecht University"},{"name":"Dragan Doder","slug":"dragan-doder","given":"Dragan","family":"Doder","affiliation":"Utrecht University"},{"name":"Brian Logan","slug":"brian-logan","given":"Brian","family":"Logan","affiliation":"Utrecht University; University of Aberdeen"}],"abstract":"To build a theory of intention revision for agents operating in stochastic environments, we need a logic in which we can explicitly reason about their decision-making policies and those policies' uncertain outcomes. Towards this end, we propose PLBP, a novel probabilistic temporal logic for Markov Decision Processes that allows us to reason about policies of bounded size. The logic is designed so that its expressive power is sufficient for the intended applications, whilst at the same time possessing strong computational properties. We prove that the satisfiability problem for our logic is decidable, and that its model checking problem is PSPACE-complete. This allows us to e.g. algorithmically verify whether an agent's intentions are coherent, or whether a specific policy satisfies safety and/or liveness properties.","doi":"10.24963/ijcai.2023/367","url":"https://ijcai.org/proceedings/2023/367","pdf":"https://ijcai.org/proceedings/2023/0367.pdf","markdown":"https://ijcai.org/proceedings/2023/367.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/367","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Knowledge Representation and Reasoning","track":"Main Track","number":367,"pages":{"first":3296,"last":3303},"keywords":["Agent-based and Multi-agent Systems: MAS: Agent theories and models","Knowledge Representation and Reasoning: KRR: Reasoning about actions"],"videos":[],"references":[{"position":1,"raw":"[Alchourrón et al., 1985] Carlos E. Alchourrón, Peter Gärdenfors, and David Makinson. On the logic of theory change: Partial meet contraction and revision functions. The Journal of Symbolic Logic, 50(2):510-530, 1985.","title":"On the logic of theory change: Partial meet contraction and revision functions","authors":"Carlos E Alchourrón, Peter Gärdenfors, David Makinson","year":"1985","venue":"The Journal of Symbolic Logic","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Aminof et al., 2019] Benjamin Aminof, Marta Kwiatkowska, Bastien Maubert, Aniello Murano, and Sasha Rubin. Probabilistic strategy logic. In Sarit Kraus, editor, Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI-19), pages 32-38, 2019.","title":"Probabilistic strategy logic","authors":"Benjamin Aminof, Marta Kwiatkowska, Bastien Maubert, Aniello Murano, Sasha Rubin","year":"2019","venue":"Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI-19)","doi":null,"url":null,"internal_url":"/proceedings/2019/5"},{"position":3,"raw":"[Artale et al., 2019] Alessandro Artale, Andrea Mazzullo, and Ana Ozaki. Do you need infinite time? In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19, pages 1516-1522. Interna- tional Joint Conferences on Artificial Intelligence Organi- zation, 7 2019.","title":"Do you need infinite time?","authors":"Alessandro Artale, Andrea Mazzullo, Ana Ozaki","year":"2019","venue":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19","doi":null,"url":null,"internal_url":"/proceedings/2019/210"},{"position":4,"raw":"[Aziz et al., 1995] Adnan Aziz, Vigyan Singhal, Felice Balarin, Robert K. Brayton, and Alberto L. Sangiovanni- Vincentelli. It usually works: The temporal logic of stochas- tic systems. In Pierre Wolper, editor, Computer Aided Veri- fication, pages 155-165, Berlin, Heidelberg, 1995. Springer Berlin Heidelberg.","title":"It usually works: The temporal logic of stochastic systems","authors":"Adnan Aziz, Vigyan Singhal, Felice Balarin, Robert K Brayton, Alberto L Sangiovanni-Vincentelli","year":"1995","venue":"Computer Aided Verification","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Bianco and de Alfaro, 1995] Andrea Bianco and Luca de Al- faro. Model checking of probabilistic and nondeterministic systems. In P. S. Thiagarajan, editor, Foundations of Soft- ware Technology and Theoretical Computer Science, pages 499-513, Berlin, Heidelberg, 1995. Springer Berlin Heidel- berg. [Bulling and Jamroga, 2010] Nils Bulling and Wojciech Jam- roga. Verifying agents with memory is harder than it seemed. AI Commun., 23(4):389-403, 2010.","title":"Nils Bulling and Wojciech Jamroga. Verifying agents with memory is harder than it seemed","authors":"De Bianco, ; Alfaro, Luca Bianco, De Alfaro","year":"1995","venue":"Foundations of Software Technology and Theoretical Computer Science","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Canny, 1988] John Canny. Some algebraic and geometric computations in PSPACE. In Proceedings of the Twen- tieth Annual ACM Symposium on Theory of Computing STOC'88, page 460-467. ACM, 1988.","title":"Some algebraic and geometric computations in PSPACE","authors":"John Canny","year":"1988","venue":"Proceedings of the Twentieth Annual ACM Symposium on Theory of Computing STOC'88","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Chang and Keisler, 2012] C. C. Chang and H. Jerome Keisler. Model Theory. Dover Publications, 3 edition, 2012.","title":"Model Theory","authors":"C C Chang, H Jerome Keisler","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Chen and Lu, 2007] Taolue Chen and Jian Lu. Probabilistic alternating-time temporal logic and model checking algo- rithm. In Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007), volume 2, pages 35-39, 2007.","title":"Probabilistic alternating-time temporal logic and model checking algorithm","authors":"Chen, Lu ; ] Taolue Chen, Jian Lu","year":"2007","venue":"Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007)","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Cohen and Levesque, 1990] PR Cohen and HJ Levesque. In- tention is choice with commitment. Artificial intelligence, 1990.","title":"Intention is choice with commitment","authors":"Levesque ; Pr Cohen, H J Cohen, Levesque","year":"1990","venue":"Artificial intelligence","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[De Giacomo and Vardi, 2015] Giuseppe De Giacomo and Moshe Y. Vardi. Synthesis for LTL and LDL on finite traces. In Qiang Yang and Michael J. Wooldridge, edi- tors, Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI 2015, pages 1558-1564. AAAI Press, 2015.","title":"Synthesis for LTL and LDL on finite traces","authors":"De Giacomo, Giuseppe De Vardi, Moshe Y Giacomo, Vardi","year":"2015","venue":"Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI 2015","doi":null,"url":null,"internal_url":"/proceedings/2015/223"},{"position":11,"raw":"[Hansson and Jonsson, 1989] Hans Hansson and Bengt Jon- sson. A framework for reasoning about time and reliabil- ity. In [1989] Proceedings. Real-Time Systems Symposium, pages 102-111, 1989.","title":"A framework for reasoning about time and reliability","authors":"Jonsson Hansson, Hans Hansson, Bengt Jonsson","year":"1989","venue":"Proceedings. Real-Time Systems Symposium","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Hansson and Jonsson, 1994] Hans Hansson and Bengt Jons- son. A logic for reasoning about time and reliability. Formal Aspects of Computing, 6(5):512-535, 1994.","title":"A logic for reasoning about time and reliability","authors":"Jonsson Hansson, Hans Hansson, Bengt Jonsson","year":"1994","venue":"Formal Aspects of Computing","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Huang et al., 2012] Xiaowei Huang, Kaile Su, and Chenyi Zhang. Probabilistic alternating-time temporal logic of incomplete information and synchronous perfect recall. In Jörg Hoffmann and Bart Selman, editors, Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence. AAAI Press, 2012.","title":"Probabilistic alternating-time temporal logic of incomplete information and synchronous perfect recall","authors":"Xiaowei Huang, Kaile Su, Chenyi Zhang","year":"2012","venue":"Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Icard et al., 2010] Thomas Icard, Eric Pacuit, and Yoav Shoham. Joint revision of belief and intention. In Proceed- ings of the Twelfth International Conference on Principles of Knowledge Representation and Reasoning, KR'10, page 572-574. AAAI Press, 2010.","title":"Joint revision of belief and intention","authors":"Thomas Icard, Eric Pacuit, Yoav Shoham","year":"2010","venue":"Proceedings of the Twelfth International Conference on Principles of Knowledge Representation and Reasoning, KR'10","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Jamroga, 2008] Wojciech Jamroga. A temporal logic for markov chains. In Lin Padgham, David C. Parkes, Jörg P. Müller, and Simon Parsons, editors, 7th International Joint Conference on Autonomous Agents and Multiagent Sys- tems (AAMAS 2008), Volume 2, pages 697-704. IFAAMAS, 2008.","title":"A temporal logic for markov chains","authors":"Wojciech Jamroga","year":"2008","venue":"7th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS 2008)","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Puterman, 1994] Martin L. Puterman. Markov Decision Pro- cesses: Discrete Stochastic Dynamic Programming. Wiley Series in Probability and Statistics. Wiley, 1994.","title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","authors":"Martin L Puterman","year":"1994","venue":"Wiley Series in Probability and Statistics","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Rao and Georgeff, 1991] Anand S. Rao and Michael P. Georgeff. Modeling rational agents within a BDI- architecture. In James F. Allen, Richard Fikes, and Erik Sandewall, editors, Proceedings of the 2nd International Conference on Principles of Knowledge Representation and Reasoning (KR'91), pages 473-484.","title":"Modeling rational agents within a BDIarchitecture","authors":"Anand S Rao, Michael P Georgeff","year":null,"venue":"Proceedings of the 2nd International Conference on Principles of Knowledge Representation and Reasoning (KR'91)","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"Morgan Kaufmann, 1991.","title":null,"authors":"Morgan Kaufmann","year":"1991","venue":null,"doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Savitch, 1970] Walter J. Savitch. Relationships between non- deterministic and deterministic tape complexities. Journal of Computer and System Sciences, 4(2):177-192, 1970.","title":"Relationships between nondeterministic and deterministic tape complexities","authors":"J Walter, Savitch","year":"1970","venue":"Journal of Computer and System Sciences","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Shoham, 2009] Yoav Shoham. Logical theories of intention and the database perspective. Journal of Philosophical Logic, 38(6):633-647, 2009.","title":"Logical theories of intention and the database perspective","authors":"Yoav Shoham","year":"2009","venue":"Journal of Philosophical Logic","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[van der Hoek et al., 2007] Wiebe van der Hoek, Wojciech Jamroga, and Michael Wooldridge. Towards a theory of intention revision. Synthese, 155(2):265-290, 2007.","title":"Towards a theory of intention revision","authors":"Hoek Van Der","year":"2007","venue":"Synthese","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[van Ditmarsch et al., 2011] Hans van Ditmarsch, Tiago de Lima, and Emiliano Lorini. Intention change via local as- signments. In Mehdi Dastani, Amal El Fallah Seghrouchni, Jomi Hübner, and João Leite, editors, Languages, Method- ologies, and Development Tools for Multi-Agent Systems, pages 136-151, Berlin, Heidelberg, 2011. Springer.","title":"Intention change via local assignments","authors":"Van Ditmarsch","year":"2011","venue":"Languages, Methodologies, and Development Tools for Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[van Zee et al., 2020] Marc van Zee, Dragan Doder, Leendert van der Torre, Mehdi Dastani, Thomas Icard, and Eric Pacuit. Intention as commitment toward time. Artificial Intelligence, 283, 2020.","title":"Intention as commitment toward time","authors":"Van Zee","year":"2020","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}