{"type":"ScholarlyArticle","title":"Multi-Agent Intention Recognition and Progression","authors":[{"name":"Michael Dann","slug":"michael-dann","given":"Michael","family":"Dann","affiliation":"RMIT University"},{"name":"Yuan Yao","slug":"yuan-yao","given":"Yuan","family":"Yao","affiliation":"University of Nottingham , Ningbo China"},{"name":"Natasha Alechina","slug":"natasha-alechina","given":"Natasha","family":"Alechina","affiliation":"Utrecht University"},{"name":"Brian Logan","slug":"brian-logan","given":"Brian","family":"Logan","affiliation":"Utrecht University; University of Aberdeen"},{"name":"Felipe Meneguzzi","slug":"felipe-meneguzzi","given":"Felipe","family":"Meneguzzi","affiliation":"University of Aberdeen"},{"name":"John Thangarajah","slug":"john-thangarajah","given":"John","family":"Thangarajah","affiliation":"RMIT University"}],"abstract":"For an agent in a multi-agent environment, it is often beneficial to be able to predict what other agents will do next when deciding how to act. Previous work in multi-agent intention scheduling assumes a priori knowledge of the current goals of other agents. In this paper, we present a new approach to multi-agent intention scheduling in which an agent uses online goal recognition to identify the goals currently being pursued by other agents while acting in pursuit of its own goals. We show how online goal recognition can be incorporated into an MCTS-based intention scheduler, and evaluate our approach in a range of scenarios. The results demonstrate that our approach can rapidly recognise the goals of other agents even when they are pursuing multiple goals concurrently, and has similar performance to agents which know the goals of other agents a priori.","doi":"10.24963/ijcai.2023/11","url":"https://ijcai.org/proceedings/2023/11","pdf":"https://ijcai.org/proceedings/2023/0011.pdf","markdown":"https://ijcai.org/proceedings/2023/11.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/11","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Agent-based and Multi-agent Systems","track":"Main Track","number":11,"pages":{"first":91,"last":99},"keywords":["Agent-based and Multi-agent Systems: MAS: Agent theories and models","Planning and Scheduling: PS: Activity and plan recognition"],"videos":[],"references":[{"position":1,"raw":"[Amado et al., 2022] Leonardo Amado, Reuth Mirsky, and Felipe Meneguzzi. Goal recognition as reinforcement learning. In Proceedings of the 36th AAAI Conference on Artificial Intelligence, pages 9644-9651. AAAI Press, 2022.","title":"Goal recognition as reinforcement learning","authors":"Amado","year":"2022","venue":"Proceedings of the 36th AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Amado et al., 2023] Leonardo R. Amado, Ramon F. Pereira, and Felipe Meneguzzi. Robust Neuro-Symbolic Goal and Plan Recognition. In Proceedings of the 37th AAAI Conference on Artificial Intelligence. AAAI Press, 2023.","title":"Robust Neuro-Symbolic Goal and Plan Recognition","authors":"Leonardo R Amado, Ramon F Pereira, Felipe Meneguzzi","year":"2023","venue":"Proceedings of the 37th AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Andreas et al., 2017] Jacob Andreas, Dan Klein, and Sergey Levine. Modular Multitask Reinforcement Learn- ing with Policy Sketches. In Proceedings of the 34th In- ternational Conference on Machine Learning, volume 70, pages 166-175. PMLR, 2017.","title":"Modular Multitask Reinforcement Learning with Policy Sketches","authors":"Jacob Andreas, Dan Klein, Sergey Levine","year":"2017","venue":"Proceedings of the 34th International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Avrahami-Zilberbrand and Kaminka, 2005] Dorit Avrahami-Zilberbrand and Gal A. Kaminka. Fast and Complete Symbolic Plan Recognition. In Pro- ceedings of the 19th International Joint Conference on Artificial Intelligence, pages 653-658. Professional Book Center, 2005.","title":"Fast and Complete Symbolic Plan Recognition","authors":"Avrahami-Zilberbrand, Kaminka, Dorit Avrahami-Zilberbrand, Gal A Kaminka","year":"2005","venue":"Proceedings of the 19th International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2005/154"},{"position":5,"raw":"[Browne et al., 2012] Cameron Browne, Edward Jack Pow- ley, Daniel Whitehouse, Simon M. Lucas, Peter I. Cowl- ing, Philipp Rohlfshagen, Stephen Tavener, Diego Perez Liebana, Spyridon Samothrakis, and Simon Colton. A Sur- vey of Monte Carlo Tree Search Methods. IEEE Trans- actions on Computational Intelligence andAI in games, 4(1):1-43, 2012.","title":"A Survey of Monte Carlo Tree Search Methods","authors":"Cameron Browne, Edward Jack Powley, Daniel Whitehouse, Simon M Lucas, Peter I Cowling, Philipp Rohlfshagen, Stephen Tavener, Diego Perez Liebana, Spyridon Samothrakis, Simon Colton","year":"2012","venue":"IEEE Transactions on Computational Intelligence andAI in games","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Dann et al., 2020] Michael Dann, John Thangarajah, Yuan Yao, and Brian Logan. Intention-Aware Multiagent Scheduling. In Proceedings of the 19th International Con- ference on Autonomous Agents and Multiagent Systems, pages 285-293, 2020.","title":"Intention-Aware Multiagent Scheduling","authors":"Michael Dann, John Thangarajah, Yuan Yao, Brian Logan","year":"2020","venue":"Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Dann et al., 2021] Michael Dann, Yuan Yao, Brian Logan, and John Thangarajah. Multi-Agent Intention Progression with Black Box Agents. In Proceedings of the 30th In- ternational Joint Conference on Artificial Intelligence. IJ- CAI, 2021.","title":"Multi-Agent Intention Progression with Black Box Agents","authors":"Michael Dann, Yuan Yao, Brian Logan, John Thangarajah","year":"2021","venue":"Proceedings of the 30th International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2021/19"},{"position":8,"raw":"[Dann et al., 2022] Michael Dann, Yuan Yao, Natasha Alechina, Brian Logan, and John Thangarajah. Multi- Agent Intention Progression with Reward Machines. In Proceedings of the 31st International Joint Conference on Artificial Intelligence, pages 215-222. IJCAI, 2022.","title":"Multi-Agent Intention Progression with Reward Machines","authors":"Michael Dann, Yuan Yao, Natasha Alechina, Brian Logan, John Thangarajah","year":"2022","venue":"Proceedings of the 31st International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2022/31"},{"position":9,"raw":"[de Silva et al., 2020] Lavindra de Silva, Felipe Meneguzzi, and Brian Logan. BDI Agent Architectures: A Survey. In Proceedings of the 29th International Joint Conference on Artificial Intelligence. IJCAI, 2020.","title":"Lavindra de Silva, Felipe Meneguzzi, and Brian Logan. BDI Agent Architectures: A Survey","authors":"Silva De","year":"2020","venue":"Proceedings of the 29th International Joint Conference on Artificial Intelligence. IJCAI","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Geib and Goldman, 2009] Christopher W. Geib and Robert P. Goldman. A probabilistic plan recognition algo- rithm based on plan tree grammars. Artificial Intelligence, 173(11):1101-1132, 2009.","title":"A probabilistic plan recognition algorithm based on plan tree grammars","authors":"Christopher W Geib, Robert P Goldman","year":"2009","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Hu and Yang, 2008] Derek H. Hu and Qiang Yang. CIGAR: Concurrent and Interleaving Goal and Activity Recogni- tion. In Proceedings of the 23rd AAAI Conference on Ar- tificial Intelligence, pages 1363-1368. AAAI Press, 2008.","title":"CIGAR: Concurrent and Interleaving Goal and Activity Recognition","authors":"Derek H Hu, Qiang Yang","year":"2008","venue":"Proceedings of the 23rd AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Hu et al., 2008] Derek H. Hu, Sinno J. Pan, Vincent W. Zheng, Nathan N. Liu, and Qiang Yang. Real world ac- tivity recognition with multiple goals. In Proceedings of the 10th International Conference on Ubiquitous Comput- ing, pages 30-39. ACM, 2008.","title":"Real world activity recognition with multiple goals","authors":"Derek H Hu, J Sinno, Vincent W Pan, Nathan N Zheng, Qiang Liu, Yang","year":"2008","venue":"Proceedings of the 10th International Conference on Ubiquitous Computing","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Kingma and Ba, 2015] Diederik P. Kingma and Jimmy Ba. Adam: A Method for Stochastic Optimization. In Pro- ceedings of the 3rd International Conference on Learning Representations, 2015.","title":"Adam: A Method for Stochastic Optimization","authors":"P Diederik, Jimmy Kingma, Ba","year":"2015","venue":"Proceedings of the 3rd International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Logan et al., 2017] Brian Logan, John Thangarajah, and Neil Yorke-Smith. Progressing Intention Progresson: A Call for a Goal-Plan Tree Contest. In Proceedings of the 16th International Conference on Autonomous Agents and Multiagent Systems, pages 768-772. IFAAMAS, 2017.","title":"Progressing Intention Progresson: A Call for a Goal-Plan Tree Contest","authors":"Brian Logan, John Thangarajah, Neil Yorke-Smith","year":"2017","venue":"Proceedings of the 16th International Conference on Autonomous Agents and Multiagent Systems","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Masters and Vered, 2021] Peta Masters and Mor Vered. What's the Context? Implicit and Explicit Assumptions in Model-Based Goal Recognition. In Proceedings of the 30th International Joint Conference on Artificial Intelli- gence, pages 4516-4523. IJCAI, 2021.","title":"Peta Masters and Mor Vered. What's the Context? Implicit and Explicit Assumptions in Model-Based Goal Recognition","authors":"Vered Masters","year":"2021","venue":"Proceedings of the 30th International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Meneguzzi and Pereira, 2021] Felipe Meneguzzi and Ra- mon F. Pereira. A Survey on Goal Recognition as Plan- ning. In Proceedings of the 30th International Joint Con- ference on Artificial Intelligence. IJCAI, 2021.","title":"Felipe Meneguzzi and Ramon F. Pereira. A Survey on Goal Recognition as Planning","authors":"Pereira Meneguzzi","year":"2021","venue":"Proceedings of the 30th International Joint Conference on Artificial Intelligence. IJCAI","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Mirsky et al., 2019] Reuth Mirsky, Kobi Gal, Roni Stern, and Meir Kalech. Goal and Plan Recognition Design for Plan Libraries. ACM Trans. Intell. Syst. Technol., 10(2):14:1-14:23, 2019.","title":"Goal and Plan Recognition Design for Plan Libraries","authors":"Reuth Mirsky, Kobi Gal, Roni Stern, Meir Kalech","year":"2019","venue":"ACM Trans. Intell. Syst. Technol","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Mirsky et al., 2022] Reuth Mirsky, Ignacio Carlucho, Ar- rasy Rahman, Elliot Fosong, William Macke, Mohan Srid- haran, Peter Stone, and Stefano V. Albrecht. A Survey of Ad Hoc Teamwork Research. In Procceddings of the 19th European Conference on Multi-Agent Systems, vol- ume 13442, pages 275-293. Springer, 2022.","title":"A Survey of Ad Hoc Teamwork Research","authors":"Reuth Mirsky, Ignacio Carlucho, Arrasy Rahman, Elliot Fosong, William Macke, Mohan Sridharan, Peter Stone, Stefano V Albrecht","year":"2022","venue":"Procceddings of the 19th European Conference on Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Mnih et al., 2015] Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Belle- mare, Alex Graves, Martin A. Riedmiller, Andreas Fid- jeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hass- abis. Human-Level Control Through Deep Reinforcement Learning. Nature, 518(7540):529-533, 2015.","title":"Human-Level Control Through Deep Reinforcement Learning","authors":"Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin A Riedmiller, Andreas Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, Demis Hassabis","year":"2015","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Pozanco et al., 2018] Alberto Pozanco, Yolanda E-Martín, Susana Fernández, and Daniel Borrajo. Counterplanning using Goal Recognition and Landmarks. In Proceedings of the 27th International Joint Conference on Artificial In- telligence, pages 4808-4814. ijcai.org, 2018.","title":"Counterplanning using Goal Recognition and Landmarks","authors":"Alberto Pozanco, Yolanda E -Martín, Susana Fernández, Daniel Borrajo","year":"2018","venue":"Proceedings of the 27th International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2018/668"},{"position":21,"raw":"[Ramírez and Geffner, 2009] Miquel Ramírez and Hector Geffner. Plan Recognition as Planning. In Proceedings of the 21st International Joint Conference on Artificial In- telligence, pages 1778-1783, 2009.","title":"Plan Recognition as Planning","authors":"Geffner Ramírez, Miquel Ramírez, Hector Geffner","year":"2009","venue":"Proceedings of the 21st International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2009/296"},{"position":22,"raw":"[Ramírez and Geffner, 2010] Miguel Ramírez and Hector Geffner. Probabilistic plan recognition using off-the-shelf classical planners. In Proceedings of the 24th AAAI Con- ference on Artificial Intelligence, pages 1121-1126, 2010.","title":"Miguel Ramírez and Hector Geffner. Probabilistic plan recognition using off-the-shelf classical planners","authors":"Geffner Ramírez","year":"2010","venue":"Proceedings of the 24th AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Rao and Georgeff, 1992] Anand S. Rao and Michael P. Georgeff. An Abstract Architecture for Rational Agents. In Proceedings of the 3rd International Conference on Principles of Knowledge Representation and Reasoning, pages 439-449.","title":"An Abstract Architecture for Rational Agents","authors":"Anand S Rao, Michael P Georgeff","year":null,"venue":"Proceedings of the 3rd International Conference on Principles of Knowledge Representation and Reasoning","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"Morgan Kaufmann, 1992.","title":null,"authors":"Morgan Kaufmann","year":"1992","venue":null,"doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Sohrabi et al., 2016] Shirin Sohrabi, Anton V. Riabov, and Octavian Udrea. Plan recognition as planning revisited. In Proceedings of the 25th International Joint Conference on Artificial Intelligence, pages 3258-3264, 2016.","title":"Plan recognition as planning revisited","authors":"Shirin Sohrabi, Anton V Riabov, Octavian Udrea","year":"2016","venue":"Proceedings of the 25th International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2016/461"},{"position":26,"raw":"[Stone et al., 2013] Peter Stone, Gal A. Kaminka, Sarit Kraus, Jeffrey S. Rosenschein, and Noa Agmon. Teaching and leading an ad hoc teammate: Collaboration without pre-coordination. Artificial Intelligence, 203:35-65, 2013.","title":"Teaching and leading an ad hoc teammate: Collaboration without pre-coordination","authors":"Peter Stone, A Gal, Sarit Kaminka, Jeffrey S Kraus, Noa Rosenschein, Agmon","year":"2013","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Thangarajah and Padgham, 2011] John Thangarajah and Lin Padgham. Computationally Effective Reasoning About Goal Interactions. Journal of Automated Reason- ing, 47(1):17-56, 2011.","title":"Computationally Effective Reasoning About Goal Interactions","authors":"Padgham Thangarajah, John Thangarajah, Lin Padgham","year":"2011","venue":"Journal of Automated Reasoning","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Thangarajah et al., 2003] John Thangarajah, Lin Padgham, and Michael Winikoff. Detecting & Avoiding Interference Between Goals in Intelligent Agents. In Proceedings of the 18th International Joint Conference on Artificial Intel- ligence, pages 721-726.","title":"Detecting & Avoiding Interference Between Goals in Intelligent Agents","authors":"John Thangarajah, Lin Padgham, Michael Winikoff","year":null,"venue":"Proceedings of the 18th International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2003/105"},{"position":29,"raw":"Morgan Kaufmann, 2003.","title":null,"authors":"Morgan Kaufmann","year":"2003","venue":null,"doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Waters et al., 2014] Max Waters, Lin Padgham, and Sebas- tian Sardiña. Evaluating Coverage Based Intention Selec- tion. In Proceedings of the 13th International Conference on Autonomous Agents and Multi-agent Systems, pages 957-964. IFAAMAS, 2014.","title":"Evaluating Coverage Based Intention Selection","authors":"Waters","year":"2014","venue":"Proceedings of the 13th International Conference on Autonomous Agents and Multi-agent Systems","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Waters et al., 2015] Max Waters, Lin Padgham, and Sebas- tian Sardiña. Improving domain-independent intention se- lection in BDI systems. Autonomous Agents and Multi- Agent Systems, 29(4):683-717, 2015.","title":"Improving domain-independent intention selection in BDI systems","authors":"Waters","year":"2015","venue":"Autonomous Agents and Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Wu et al., 2023] Di Wu, Yuan Yao, Natasha Alechina, Brian Logan, and John Thangarajah. Intention Progression with Maintenance Goals. In Proceedings of the 22nd Interna- tional Conference on Autonomous Agents and Multiagent Systems, pages 2400-2402. IFAAMAS, 2023.","title":"Intention Progression with Maintenance Goals","authors":"Di Wu, Yuan Yao, Natasha Alechina, Brian Logan, John Thangarajah","year":"2023","venue":"Proceedings of the 22nd International Conference on Autonomous Agents and Multiagent Systems","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Yao and Logan, 2016] Yuan Yao and Brian Logan. Action- Level Intention Selection for BDI Agents. In Proceed- ings of the 15th International Conference on Autonomous Agents and Multiagent Systems, pages 1227-1236.","title":"Action-Level Intention Selection for BDI Agents","authors":"Yuan Yao, Brian Logan","year":null,"venue":"Proceedings of the 15th International Conference on Autonomous Agents and Multiagent Systems","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Yao et al., 2014] Yuan Yao, Brian Logan, and John Thangarajah. Sp-mcts-based intention scheduling for bdi agents. In Proceedings of the 21st European Conference on Artificial Intelligence, pages 1133-1134. IOS Press, 2014.","title":"Sp-mcts-based intention scheduling for bdi agents","authors":"Yuan Yao, Brian Logan, John Thangarajah","year":"2014","venue":"Proceedings of the 21st European Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Yao et al., 2016a] Yuan Yao, Lavindra de Silva, and Brian Logan. Reasoning about the Executability of Goal-Plan Trees. In Proceedings of the 4th International Work- shop on Engineering Multi-Agent Systems, pages 181- 196, 2016.","title":"Reasoning about the Executability of Goal-Plan Trees","authors":"Yao","year":"2016","venue":"Proceedings of the 4th International Workshop on Engineering Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Yao et al., 2016b] Yuan Yao, Brian Logan, and John Thangarajah. Robust Execution of BDI Agent Programs by Exploiting Synergies Between Intentions. In Proceed- ings of the 30th AAAI Conference on Artificial Intelligence, pages 2558-2565. AAAI Press, 2016.","title":"Robust Execution of BDI Agent Programs by Exploiting Synergies Between Intentions","authors":"Yao","year":"2016","venue":"Proceedings of the 30th AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}