{"type":"ScholarlyArticle","title":"Verifying Fault-tolerance in Parameterised Multi-Agent Systems","authors":[{"name":"Panagiotis Kouvaros","slug":"panagiotis-kouvaros","given":"Panagiotis","family":"Kouvaros","affiliation":"Department of Computing Imperial College London , UK; University of Naples \"Federico II\" , Italy"},{"name":"Alessio Lomuscio","slug":"alessio-lomuscio","given":"Alessio","family":"Lomuscio","affiliation":"Department of Computing Imperial College London , UK"}],"abstract":"We develop a technique to evaluate the fault-tolerance of a multi-agent system whose number of agents is unknown at design time. We present a method for injecting a variety of non-ideal behaviours, or faults, studied in the safety-analysis literature into the abstract agent templates that are used to generate an unbounded family of multi-agent systems with different sizes. We define the parameterised fault-tolerance problem as the decision problem of establishing whether any concrete system, in which the ratio of faulty versus non-faulty agents is under a given threshold, satisfies a given temporal-epistemic specification. We put forward a sound and complete technique for solving the problem for the semantical set-up considered. We present an implementation and a case study identifying the threshold under which the alpha swarm aggregation algorithm is robust to faults against its temporal-epistemic specifications.","doi":"10.24963/ijcai.2017/41","url":"https://ijcai.org/proceedings/2017/41","pdf":"https://ijcai.org/proceedings/2017/0041.pdf","markdown":"https://ijcai.org/proceedings/2017/41.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/41","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Agent-based and Multi-agent Systems","track":"Main track","number":41,"pages":{"first":288,"last":294},"keywords":["Multidisciplinary Topics and Applications: Validation and Verification","Agent-based and Multi-agent Systems: Formal verification, validation and synthesis"],"videos":[],"references":[{"position":1,"raw":"[Apt and Kozen, 1986] K.R. Apt and D. C. Kozen. Limits for automatic verification of finite-state concurrent systems. Information Processing Letters, 22(6):307-309, 1986.","title":"Limits for automatic verification of finite-state concurrent systems","authors":"K R Apt, D C Kozen","year":"1986","venue":"Information Processing Letters","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Belardinelli et al., 2016] F Belardinelli, A. Lomuscio, and J. Michaliszyn. Agent-based refinement for predicate abstraction of multi-agent systems. In Proceedings of ECAI16, pages 286-294. IOS Press, 2016.","title":"Agent-based refinement for predicate abstraction of multi-agent systems","authors":"A Belardinelli, J Lomuscio, Michaliszyn","year":"2016","venue":"Proceedings of ECAI16","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bloem et al., 2015] R. Bloem, S. Jacobs, A. Khalimov, I. Konnov, S. Rubin, H. Veith, and J. Widder. Decidabil- ity of Parameterized Verification. Morgan and Claypool Publishers, 2015.","title":"Decidability of Parameterized Verification","authors":"R Bloem, S Jacobs, A Khalimov, I Konnov, S Rubin, H Veith, J Widder","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bordini et al., 2003] R. H. Bordini, M. Fisher, C. Pardavila, and M. Wooldridge. Model checking AgentSpeak. In Pro- ceedings of AAMAS03, pages 409-416. ACM Press, 2003.","title":"Model checking AgentSpeak","authors":"R H Bordini, M Fisher, C Pardavila, M Wooldridge","year":"2003","venue":"Proceedings of AAMAS03","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Bordini et al., 2006] R. H. Bordini, M. Fisher, W. Visser, and M. Wooldridge. Verifying multi-agent programs by model checking. Autonomous Agents and Multi-Agent Sys- tems, 12(2):239-256, 2006.","title":"Verifying multi-agent programs by model checking","authors":"R H Bordini, M Fisher, W Visser, M Wooldridge","year":"2006","venue":"Autonomous Agents and Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Boureanu et al., 2016] I. Boureanu, P. Kouvaros, and A. Lo- muscio. Verifying security properties in unbounded multi- agent systems. In Proceedings of AAMAS16, pages 1209- 1218. IFAAMAS, 2016.","title":"Verifying security properties in unbounded multiagent systems","authors":"Boureanu","year":"2016","venue":"Proceedings of AAMAS16","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Bozzano and Villafiorita, 2007] M. Bozzano and A. Vil- lafiorita. The FSAP/NuSMV-SA safety analysis platform. Software Tools for Technology Transfer, 9(1):5-24, 2007.","title":"The FSAP/NuSMV-SA safety analysis platform","authors":"M Bozzano, A Villafiorita","year":"2007","venue":"Software Tools for Technology Transfer","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Dixon et al., 2012] C. Dixon, A. Winfield, M. Fisher, and C. Zeng. Towards temporal verification of swarm robotic systems. Robotics and Autonomous Systems, 60(11):1429-1441, 2012.","title":"Towards temporal verification of swarm robotic systems","authors":"C Dixon, A Winfield, M Fisher, C Zeng","year":"2012","venue":"Robotics and Autonomous Systems","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Emerson and Namjoshi, 1995] E.A. Emerson and K.S. Namjoshi. Reasoning about rings. In Proceedings of POPL95, pages 85-94. Pearson Education, 1995.","title":"Reasoning about rings","authors":"E A Emerson, K S Namjoshi","year":"1995","venue":"Proceedings of POPL95","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Ezekiel and Lomuscio, 2017] J. Ezekiel and A. Lomuscio. Combining fault injection and model checking to ver- ify fault tolerance, recoverability, and diagnosability in multi-agent systems. Information and Computation, 254(2):167-194, 2017.","title":"Combining fault injection and model checking to verify fault tolerance, recoverability, and diagnosability in multi-agent systems","authors":"J Ezekiel, A Lomuscio","year":"2017","venue":"Information and Computation","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Ezekiel et al., 2011] J. Ezekiel, A. Lomuscio, L. Mol- nar, and S. Veres. Verifying fault tolerance and self- diagnosability of an autonomous underwater vehicle. In Proceedings of IJCAI11, pages 1659-1664. AAAI Press, 2011.","title":"Verifying fault tolerance and selfdiagnosability of an autonomous underwater vehicle","authors":"J Ezekiel, A Lomuscio, L Molnar, S Veres","year":"2011","venue":"Proceedings of IJCAI11","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Fisher et al., 2009] M. Fisher, B. Konev, and A. Lisitsa. Temporal verification of fault-tolerant protocols. In Meth- ods, Models and Tools for Fault Tolerance, pages 44-56. Springer, 2009.","title":"Temporal verification of fault-tolerant protocols","authors":"M Fisher, B Konev, A Lisitsa","year":"2009","venue":"Methods, Models and Tools for Fault Tolerance","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Gammie and van der Meyden, 2004] P. Gammie and R. van der Meyden. MCK: Model checking the logic of knowledge. In Proceedings of CAV04, volume 3114 of LNCS, pages 479-483. Springer, 2004.","title":"MCK: Model checking the logic of knowledge","authors":"P Gammie, R Van Der Meyden","year":"2004","venue":"Proceedings of CAV04","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[John et al., 2013] A. John, I. Konnov, U. Schmid, H. Veith, and J. Widder. Parameterized model checking of fault- tolerant distributed algorithms by abstraction. In For- mal Methods in Computer-Aided Design (FMCAD), 2013, pages 201-209. IEEE, 2013.","title":"Parameterized model checking of faulttolerant distributed algorithms by abstraction","authors":"A John, I Konnov, U Schmid, H Veith, J Widder","year":"2013","venue":"For-mal Methods in Computer-Aided Design (FMCAD)","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Joshi and Heimdahl, 2005] A. Joshi and M. Heimdahl. Model-based safety analysis of simulink models using scade design verifier. In Proceedings of SAFECOMP05, pages 122-135. Springer, 2005.","title":"Model-based safety analysis of simulink models using scade design verifier","authors":"A Joshi, M Heimdahl","year":"2005","venue":"Proceedings of SAFECOMP05","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Kacprzak et al., 2004] M. Kacprzak, A. Lomuscio, and W. Penczek. From bounded to unbounded model checking for temporal epistemic logic. Fundamenta Informaticae, 63(2-3):221-240, 2004.","title":"From bounded to unbounded model checking for temporal epistemic logic","authors":"M Kacprzak, A Lomuscio, W Penczek","year":"2004","venue":"Fundamenta Informaticae","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Kacprzak et al., 2008] M. Kacprzak, W. Nabialek, A. Niewiadomski, W. Penczek, A. Pólrola, M. Szreter, B. Woźna, and A. Zbrzezny. Verics 2007 -a model checker for knowledge and real-time. Fundamenta Informaticae, 85(1):313-328, 2008.","title":"Verics 2007 -a model checker for knowledge and real-time","authors":"M Kacprzak, W Nabialek, A Niewiadomski, W Penczek, A Pólrola, M Szreter, B Woźna, A Zbrzezny","year":"2008","venue":"Fundamenta Informaticae","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Kouvaros and Lomuscio, 2013] P. Kouvaros and A. Lomus- cio. A cutoff technique for the verification of param- eterised interpreted systems with parameterised environ- ments. In Proceedings of IJCAI13, pages 2013-2019. AAAI Press, 2013.","title":"A cutoff technique for the verification of parameterised interpreted systems with parameterised environments","authors":"P Kouvaros, A Lomuscio","year":"2013","venue":"Proceedings of IJCAI13","doi":null,"url":null,"internal_url":"/proceedings/2013/297"},{"position":19,"raw":"[Kouvaros and Lomuscio, 2015a] P. Kouvaros and A. Lo- muscio. A counter abstraction technique for the verifica- tion of robot swarms. In Proceedings of AAAI15, pages 2081-2088. AAAI Press, 2015.","title":"A counter abstraction technique for the verification of robot swarms","authors":"Lomuscio Kouvaros, P Kouvaros, A Lomuscio","year":"2015","venue":"Proceedings of AAAI15","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Kouvaros and Lomuscio, 2015b] P. Kouvaros and A. Lo- muscio. Verifying emergent properties of swarms. In Proceedings of IJCAI15, pages 1083-1089. AAAI Press, 2015.","title":"Verifying emergent properties of swarms","authors":"Lomuscio Kouvaros, P Kouvaros, A Lomuscio","year":"2015","venue":"Proceedings of IJCAI15","doi":null,"url":null,"internal_url":"/proceedings/2015/157"},{"position":21,"raw":"[Kouvaros and Lomuscio, 2016a] P. Kouvaros and A. Lo- muscio. Formal verification of opinion formation in swarms. In Proceedings of AAMAS16, pages 1200-1209.","title":"Formal verification of opinion formation in swarms","authors":"Lomuscio Kouvaros, P Kouvaros, A Lomuscio","year":"2016","venue":"Proceedings of AAMAS16","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"IFAAMAS, 2016.","title":null,"authors":"Ifaamas","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Kouvaros and Lomuscio, 2016b] P. Kouvaros and A. Lo- muscio. Parameterised verification for multi-agent sys- tems. Artificial Intelligence, 234:152-189, 2016.","title":"Parameterised verification for multi-agent systems","authors":"Lomuscio Kouvaros, P Kouvaros, A Lomuscio","year":"2016","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Lomuscio et al., 2010] A. Lomuscio, W. Penczek, and H. Qu. Partial order reduction for model checking in- terleaved multi-agent systems. Fundamenta Informaticae, 101(1-2):71-90, 2010.","title":"Partial order reduction for model checking interleaved multi-agent systems","authors":"A Lomuscio, W Penczek, H Qu","year":"2010","venue":"Fundamenta Informaticae","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Lomuscio et al., 2017] A. Lomuscio, H. Qu, and F. Rai- mondi. MCMAS: A model checker for the verification of multi-agent systems. Software Tools for Technology Trans- fer, 19(1):9-30, 2017.","title":"MCMAS: A model checker for the verification of multi-agent systems","authors":"A Lomuscio, H Qu, F Raimondi","year":"2017","venue":"Software Tools for Technology Transfer","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Meyden and Su, 2004] R. van der Meyden and K. Su. Sym- bolic model checking the knowledge of the dining cryp- tographers. In Proceedings of CSFW04, pages 280-291. IEEE Computer Society, 2004.","title":"Symbolic model checking the knowledge of the dining cryptographers","authors":"R Van Der Meyden, K Su","year":"2004","venue":"Proceedings of CSFW04","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Raimondi and Lomuscio, 2005] F. Raimondi and A. Lo- muscio. Automatic verification of multi-agent systems by model checking via OBDDs. Journal of Applied Logic, 5(2):235-251, 2005.","title":"Automatic verification of multi-agent systems by model checking via OBDDs","authors":"F Raimondi, A Lomuscio","year":"2005","venue":"Journal of Applied Logic","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Winfield et al., 2008] A. Winfield, W. Liu, J. Nembrini, and A. Martinoli. Modelling a wireless connected swarm of mobile robots. Swarm Intelligence, 2(2-4):241-266, 2008.","title":"Modelling a wireless connected swarm of mobile robots","authors":"A Winfield, W Liu, J Nembrini, A Martinoli","year":"2008","venue":"Swarm Intelligence","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}