{"type":"ScholarlyArticle","title":"Verifying Fault-Tolerance in Probabilistic Swarm Systems","authors":[{"name":"Alessio Lomuscio","slug":"alessio-lomuscio","given":"Alessio","family":"Lomuscio","affiliation":"Department of Computing , Imperial College London"},{"name":"Edoardo Pirovano","slug":"edoardo-pirovano","given":"Edoardo","family":"Pirovano","affiliation":"Department of Computing , Imperial College London"}],"abstract":"We present a method for reasoning about fault-tolerance in unbounded robotic swarms. We introduce a novel semantics that accounts for the probabilistic nature of both the swarm and possible malfunctions, as well as the unbounded nature of swarm systems. We define and interpret a variant of probabilistic linear-time temporal logic on the resulting executions, including those arising from faulty behaviour by some of the agents in the swarm. We specify the decision problem of parameterised fault-tolerance, which concerns determining whether a probabilistic specification holds under possibly faulty behaviour. We outline a verification procedure that we implement and use to study a foraging protocol from swarm robotics, and report the experimental results obtained.","doi":"10.24963/ijcai.2020/46","url":"https://ijcai.org/proceedings/2020/46","pdf":"https://ijcai.org/proceedings/2020/0046.pdf","markdown":"https://ijcai.org/proceedings/2020/46.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/46","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Agent-based and Multi-agent Systems","track":"Main track","number":46,"pages":{"first":325,"last":331},"keywords":["Robotics: Multi-Robot Systems","Agent-based and Multi-agent Systems: Agent Theories and Models","Agent-based and Multi-agent Systems: Formal Verification, Validation and Synthesis"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/24698/file_24698.m3u8","length_sec":298,"provider":"hls"}],"references":[{"position":1,"raw":"[Aminof et al., 2016] B. Aminof, A. Murano, S. Rubin, and F. Zuleger. Automatic verification of multi-agent systems in parameterised grid-environments. In Proceedings of AAMAS16, pages 1190-1199. IFAAMAS Press, 2016.","title":"Automatic verification of multi-agent systems in parameterised grid-environments","authors":"B Aminof, A Murano, S Rubin, F Zuleger","year":"2016","venue":"Proceedings of AAMAS16","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Aminof et al., 2018] B. Aminof, S. Rubin, I. Stoilkovska, J. Widder, and F. Zuleger. Parameterized model checking of synchronous distributed algorithms by abstraction. In Proceedings of VMCAI18, pages 1-24. Springer, 2018.","title":"Parameterized model checking of synchronous distributed algorithms by abstraction","authors":"B Aminof, S Rubin, I Stoilkovska, J Widder, F Zuleger","year":"2018","venue":"Proceedings of VMCAI18","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Apt and Kozen, 1986] K.R. Apt and D. C. Kozen. Limits for automatic verification of finite-state concurrent systems. Information Processing Letters, 22(6):307-309, 1986.","title":"Limits for automatic verification of finite-state concurrent systems","authors":"K R Apt, D C Kozen","year":"1986","venue":"Information Processing Letters","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Baier and Katoen, 2008] C. Baier and J. P. Katoen. Princi- ples of Model Checking. The MIT Press, 2008.","title":"Principles of Model Checking","authors":"C Baier, J P Katoen","year":"2008","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Bloem et al., 2015] R. Bloem, S. Jacobs, A. Khalimov, I. Konnov, S. Rubin, H. Veith, and J. Widder. Decidabil- ity of Parameterized Verification. Morgan and Claypool Publishers, 2015.","title":"Decidability of Parameterized Verification","authors":"R Bloem, S Jacobs, A Khalimov, I Konnov, S Rubin, H Veith, J Widder","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Bozzano and Villafiorita, 2007] M. Bozzano and A. Vil- lafiorita. The FSAP/NuSMV-SA safety analysis platform. Software Tools for Technology Transfer, 9(1):5-24, 2007.","title":"The FSAP/NuSMV-SA safety analysis platform","authors":"M Bozzano, A Villafiorita","year":"2007","venue":"Software Tools for Technology Transfer","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Bozzano et al., 2017] M. Bozzano, H. Bruintjes, A. Cimatti, J.-P. Katoen, T. Noll, and S. Tonetta. Formal Methods for Aerospace Systems, pages 133-159. Springer, 2017.","title":"Formal Methods for Aerospace Systems","authors":"M Bozzano, H Bruintjes, A Cimatti, J.-P Katoen, T Noll, S Tonetta","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Campo and Dorigo, 2007] A. Campo and M. Dorigo. Ef- ficient multi-foraging in swarm robotics. In Advances in Artificial Life, pages 696-705. Springer, 2007.","title":"Efficient multi-foraging in swarm robotics","authors":"A Campo, M Dorigo","year":"2007","venue":"Advances in Artificial Life","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Dixon et al., 2012] C. Dixon, A. Winfield, M. Fisher, and C. Zeng. Towards temporal verification of swarm robotic systems. Robotics and Autonomous Systems, 60(11):1429-1441, 2012.","title":"Towards temporal verification of swarm robotic systems","authors":"C Dixon, A Winfield, M Fisher, C Zeng","year":"2012","venue":"Robotics and Autonomous Systems","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Ezekiel and Lomuscio, 2017] J. Ezekiel and A. Lomuscio. Combining fault injection and model checking to ver- ify fault tolerance, recoverability, and diagnosability in multi-agent systems. Information and Computation, 254(2):167-194, 2017.","title":"Combining fault injection and model checking to verify fault tolerance, recoverability, and diagnosability in multi-agent systems","authors":"J Ezekiel, A Lomuscio","year":"2017","venue":"Information and Computation","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Ezekiel et al., 2011] J. Ezekiel, A. Lomuscio, L. Mol- nar, and S. Veres. Verifying fault tolerance and self- diagnosability of an autonomous underwater vehicle. In Proceedings of IJCAI11, pages 1659-1664. AAAI Press, 2011.","title":"Verifying fault tolerance and selfdiagnosability of an autonomous underwater vehicle","authors":"J Ezekiel, A Lomuscio, L Molnar, S Veres","year":"2011","venue":"Proceedings of IJCAI11","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Forejt et al., 2011] V. Forejt, M. Kwiatkowska, G. Norman, and D. Parker. Automated verification techniques for prob- abilistic systems. In Proceedings of SFM11, pages 53- 113. Springer, 2011.","title":"Automated verification techniques for probabilistic systems","authors":"V Forejt, M Kwiatkowska, G Norman, D Parker","year":"2011","venue":"Proceedings of SFM11","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Fournier, 2015] P. Fournier. Parameterized verification of networks of many identical processes. PhD thesis, Univer- sité de Rennes 1, 2015.","title":"Parameterized verification of networks of many identical processes","authors":"P Fournier","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Graham, 2008] D. Graham. Parameterised verification of randomised distributed systems using state-based models. PhD thesis, University of Glasgow, 2008.","title":"Parameterised verification of randomised distributed systems using state-based models","authors":"D Graham","year":"2008","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[John et al., 2013] A. John, I. Konnov, U. Schmid, H. Veith, and J. Widder. Parameterized model checking of fault- tolerant distributed algorithms by abstraction. In Proceed- ings of FMCAD13, pages 201-209. IEEE, 2013.","title":"Parameterized model checking of faulttolerant distributed algorithms by abstraction","authors":"A John, I Konnov, U Schmid, H Veith, J Widder","year":"2013","venue":"Proceedings of FMCAD13","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Kemeny et al., 1976] J. G. Kemeny, J. Laurie Snell, and A. W. Knapp. Denumerable Markov Chains. Graduate Texts in Mathematics. Springer, 1976.","title":"Denumerable Markov Chains","authors":"Kemeny","year":"1976","venue":"Graduate Texts in Mathematics","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Kouvaros and Lomuscio, 2016] P. Kouvaros and A. Lomus- cio. Parameterised verification for multi-agent systems. Artificial Intelligence, 234:152-189, 2016.","title":"Parameterised verification for multi-agent systems","authors":"P Kouvaros, A Lomuscio","year":"2016","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Kouvaros and Lomuscio, 2017] P. Kouvaros and A. Lomus- cio. Verifying fault-tolerance in parameterised multi-agent systems. In Proceedings of IJCAI17, pages 288-294. AAAI Press, 2017.","title":"Verifying fault-tolerance in parameterised multi-agent systems","authors":"P Kouvaros, A Lomuscio","year":"2017","venue":"Proceedings of IJCAI17","doi":null,"url":null,"internal_url":"/proceedings/2017/41"},{"position":19,"raw":"[Kouvaros et al., 2018] P. Kouvaros, A. Lomuscio, and E. Pirovano. Symbolic synthesis of fault-tolerance ratios in parameterised multi-agent systems. In Proceedings of IJCAI-ECAI18, pages 324-330. AAAI Press, 2018.","title":"Symbolic synthesis of fault-tolerance ratios in parameterised multi-agent systems","authors":"P Kouvaros, A Lomuscio, E Pirovano","year":"2018","venue":"Proceedings of IJCAI-ECAI18","doi":null,"url":null,"internal_url":"/proceedings/2018/45"},{"position":20,"raw":"[Kouvaros et al., 2019] P. Kouvaros, A. Lomuscio, E. Pirovano, and H. Punchihewa. Formal verifica- tion of open multi-agent systems. In Proceedings of AAMAS19, pages 179-187. IFAAMAS Press, 2019.","title":"Formal verification of open multi-agent systems","authors":"P Kouvaros, A Lomuscio, E Pirovano, H Punchihewa","year":"2019","venue":"Proceedings of AAMAS19","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Kwiatkowska et al., 2007] M. Kwiatkowska, G. Norman, and D. Parker. Stochastic model checking. In Proceed- ings of SFM11, pages 220-270. Springer, 2007.","title":"Stochastic model checking","authors":"M Kwiatkowska, G Norman, D Parker","year":"2007","venue":"Proceedings of SFM11","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Kwiatkowska et al., 2011] M. Kwiatkowska, G. Norman, and D. Parker. PRISM 4.0: Verification of probabilistic real-time systems. In Proceedings of CAV11, pages 585- 591. Springer, 2011.","title":"PRISM 4.0: Verification of probabilistic real-time systems","authors":"M Kwiatkowska, G Norman, D Parker","year":"2011","venue":"Proceedings of CAV","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Liu and Winfield, 2010] W. Liu and A. Winfield. Modelling and optimisation of adaptive foraging in swarm robotic systems. The International Journal of Robotics Research, 29(14):1743-1760, 2010.","title":"Modelling and optimisation of adaptive foraging in swarm robotic systems","authors":"W Liu, A Winfield","year":"2010","venue":"The International Journal of Robotics Research","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Lomuscio and Pirovano, 2018] A. Lomuscio and E. Pirovano. Verifying emergence of bounded time properties in probabilistic swarm systems. In Proceedings of IJCAI-ECAI18, pages 403-409. AAAI Press, 2018.","title":"Verifying emergence of bounded time properties in probabilistic swarm systems","authors":"Pirovano Lomuscio, ] A Lomuscio, E Pirovano","year":"2018","venue":"Proceedings of IJCAI-ECAI18","doi":null,"url":null,"internal_url":"/proceedings/2018/56"},{"position":25,"raw":"[Lomuscio and Pirovano, 2019] A. Lomuscio and E. Pirovano. A counter abstraction technique for the verification of probabilistic swarm systems. In Proceed- ings of AAMAS19, pages 161-169. IFAAMAS Press, 2019.","title":"A counter abstraction technique for the verification of probabilistic swarm systems","authors":"Pirovano Lomuscio, ] A Lomuscio, E Pirovano","year":"2019","venue":"Proceedings of AAMAS19","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Lomuscio and Pirovano, 2020] A. Lomuscio and E. Pirovano. Parameterised verification of strategic properties in probabilistic multi-agent systems. In Proceedings of AAMAS20. IFAAMAS Press, 2020. To Appear.","title":"Parameterised verification of strategic properties in probabilistic multi-agent systems","authors":"Pirovano Lomuscio, ] A Lomuscio, E Pirovano","year":"2020","venue":"Proceedings of AAMAS20","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[PSV-F, 2020] PSV-F. Probabilistic Swarm Verifier for Faulty systems http://vas.doc.ic.ac.uk/software/psv-f/, 2020.","title":"PSV-F. Probabilistic Swarm Verifier for Faulty systems","authors":"Psv-F","year":"2020","venue":null,"doi":null,"url":"http://vas.doc.ic.ac.uk/software/psv-f/,2020","internal_url":null},{"position":28,"raw":"[Puterman, 1994] M.L. Puterman. Markov Decision Pro- cesses: Discrete Stochastic Dynamic Programming. John Wiley & Sons, Inc., 1994.","title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","authors":"M L Puterman","year":"1994","venue":null,"doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[S ¸ahin, 2005] E. S ¸ahin. Swarm robotics: From sources of inspiration to domains of application. In Proceedings of SAB04, pages 10-20. Springer, 2005.","title":"Swarm robotics: From sources of inspiration to domains of application","authors":"E S ¸ahin","year":"2005","venue":"Proceedings of SAB04","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}