{"type":"ScholarlyArticle","title":"Implementing Theory of Mind on a Robot Using Dynamic Epistemic Logic","authors":[{"name":"Lasse Dissing","slug":"lasse-dissing","given":"Lasse","family":"Dissing","affiliation":"DTU Compute , Denmark"},{"name":"Thomas Bolander","slug":"thomas-bolander","given":"Thomas","family":"Bolander","affiliation":"DTU Compute , Denmark"}],"abstract":"Previous research has claimed dynamic epistemic logic (DEL) to be a suitable formalism for representing essential aspects of a Theory of Mind (ToM) for an autonomous agent. This includes the ability of the formalism to represent the reasoning involved in false-belief tasks of arbitrary order, and hence for autonomous agents based on the formalism to become able to pass such tests. This paper provides evidence for the claims by documenting the implementation of a DEL-based reasoning system on a humanoid robot. Our implementation allows the robot to perform cognitive perspective-taking, in particular to reason about the first- and higher-order beliefs of other agents. We demonstrate how this allows the robot to pass a quite general class of false-belief tasks involving human agents. Additionally, as is briefly illustrated, it allows the robot to proactively provide human agents with relevant information in situations where a system without ToM-abilities would fail. The symbolic grounding problem of turning robotic sensor input into logical action descriptions in DEL is achieved via a perception system based on deep neural networks.","doi":"10.24963/ijcai.2020/224","url":"https://ijcai.org/proceedings/2020/224","pdf":"https://ijcai.org/proceedings/2020/0224.pdf","markdown":"https://ijcai.org/proceedings/2020/224.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/224","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Knowledge Representation and Reasoning","track":"Main track","number":224,"pages":{"first":1615,"last":1621},"keywords":["Robotics: Human Robot Interaction","Knowledge Representation and Reasoning: Reasoning about Knowledge and Belief","Robotics: Social Robots"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/24873/file_24873.m3u8","length_sec":298,"provider":"hls"}],"references":[{"position":1,"raw":"[Arkoudas and Bringsjord, 2008] Konstantine Arkoudas and Selmer Bringsjord. Toward formalizing common-sense psychology: An analysis of the false-belief task. In Pacific Rim International Conference on Artificial Intelligence, pages 17-29. Springer, 2008.","title":"Konstantine Arkoudas and Selmer Bringsjord. Toward formalizing common-sense psychology: An analysis of the false-belief task","authors":"Bringsjord Arkoudas","year":"2008","venue":"Pacific Rim International Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Baltag and Smets, 2008] Alexandru Baltag and Sonja Smets. A qualitative theory of dynamic interactive belief revision. Logic and the foundations of game and decision theory (LOFT 7), 3:9-58, 2008.","title":"A qualitative theory of dynamic interactive belief revision","authors":"Alexandru Baltag, Sonja Smets","year":"2008","venue":"Logic and the foundations of game and decision theory","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Barras, 2009] Colin Barras. Useful, lovable and unbelievably annoying. New Scientist, 204(2738):22-23, 2009.","title":"Useful, lovable and unbelievably annoying","authors":"Colin Barras","year":"2009","venue":"New Scientist","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bolander, 2018] Thomas Bolander. Seeing is believing: For- malising false-belief tasks in dynamic epistemic logic. In Jaakko Hintikka on Knowledge and Game-Theoretical Se- mantics, pages 207-236. Springer, 2018.","title":"Seeing is believing: Formalising false-belief tasks in dynamic epistemic logic","authors":"Thomas Bolander","year":"2018","venue":"Jaakko Hintikka on Knowledge and Game-Theoretical Semantics","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Breazeal et al., 2009] Cynthia Breazeal, Jesse Gray, and Matt Berlin. An embodied cognition approach to mindread- ing skills for socially intelligent robots. The International Journal of Robotics Research, 28(5):656-680, 2009.","title":"An embodied cognition approach to mindreading skills for socially intelligent robots","authors":"Cynthia Breazeal, Jesse Gray, Matt Berlin","year":"2009","venue":"The International Journal of Robotics Research","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Calvanese et al., 2000] Diego Calvanese, Giuseppe De Gia- como, and Maurizio Lenzerini. Answering queries using views over description logics knowledge bases. AAAI/IAAI, 2000:386-391, 2000.","title":"Answering queries using views over description logics knowledge bases","authors":"Calvanese","year":"2000","venue":"AAAI/IAAI","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Cao et al., 2018] Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. OpenPose: Realtime multi-person 2D pose estimation using Part Affinity Fields. arXiv preprint arXiv:1812.08008, 2018.","title":"OpenPose: Realtime multi-person 2D pose estimation using Part Affinity Fields","authors":"Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, Yaser Sheikh","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Dautenhahn, 2007] Kerstin Dautenhahn. Socially intelligent robots: Dimensions of human-robot interaction. Philosoph- ical transactions of the royal society B: Biological sciences, 362(1480):679-704, 2007.","title":"Socially intelligent robots: Dimensions of human-robot interaction","authors":"Kerstin Dautenhahn","year":"2007","venue":"Philosophical transactions of the royal society B: Biological sciences","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Engesser et al., 2017] Thorsten Engesser, Thomas Bolander, Robert Mattmüller, and Bernhard Nebel. Cooperative epis- temic multi-agent planning for implicit coordination. In Proceedings of Methods for Modalities, Electronic Proceed- ings in Theoretical Computer Science, 2017.","title":"Cooperative epistemic multi-agent planning for implicit coordination","authors":"Engesser","year":"2017","venue":"Proceedings of Methods for Modalities, Electronic Proceedings in Theoretical Computer Science","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Flobbe, 2006] Liesbeth Flobbe. Children's development of reasoning about other people's minds. Unpublished Mas- ter's Thesis, University of Groningen, 2006.","title":"Liesbeth Flobbe. Children's development of reasoning about other people's minds","authors":"Flobbe","year":"2006","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[King, 2009] Davis E. King. Dlib-ml: A machine learning toolkit. Journal of Machine Learning Research, 10:1755- 1758, 2009.","title":"Dlib-ml: A machine learning toolkit","authors":"Davis E King","year":"2009","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Lemaignan and Dillenbourg, 2015] Séverin Lemaignan and Pierre Dillenbourg. Mutual modelling in robotics: Inspi- rations for the next steps. In 2015 10th ACM/IEEE Inter- national Conference on Human-Robot Interaction (HRI), pages 303-310. IEEE, 2015.","title":"Mutual modelling in robotics: Inspirations for the next steps","authors":"Dillenbourg Lemaignan, Séverin Lemaignan, Pierre Dillenbourg","year":"2015","venue":"10th ACM/IEEE International Conference on Human-Robot Interaction (HRI)","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Milliez et al., 2014] Grégoire Milliez, Matthieu Warnier, Aurélie Clodic, and Rachid Alami. A framework for endow- ing an interactive robot with reasoning capabilities about perspective-taking and belief management. In The 23rd IEEE international symposium on robot and human inter- active communication, pages 1103-1109. IEEE, 2014.","title":"A framework for endowing an interactive robot with reasoning capabilities about perspective-taking and belief management","authors":"Grégoire Milliez, Matthieu Warnier, Aurélie Clodic, Rachid Alami","year":"2014","venue":"The 23rd IEEE international symposium on robot and human interactive communication","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Mitsunaga et al., 2008] Noriaki Mitsunaga, Zenta Miyashita, Kazuhiko Shinozawa, Takahiro Miyashita, Hiroshi Ishig- uro, and Norihiro Hagita. What makes people accept a robot in a social environment -discussion from six-week study in an office. In 2008 IEEE/RSJ International Confer- ence on Intelligent Robots and Systems, pages 3336-3343. IEEE, 2008.","title":"What makes people accept a robot in a social environment -discussion from six-week study in an office","authors":"Mitsunaga","year":"2008","venue":"IEEE/RSJ International Conference on Intelligent Robots and Systems","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Nematzadeh et al., 2018] Aida Nematzadeh, Kaylee Burns, Erin Grant, Alison Gopnik, and Thomas L Griffiths. Evalu- ating theory of mind in question answering. arXiv preprint arXiv:1808.09352, 2018.","title":"Evaluating theory of mind in question answering","authors":"Nematzadeh","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Nielsen and Jensen, 2019] Martin Carsten Nielsen and Ras- mus Arpe Fogh Jensen. Danspeech. https://github.com/ danspeech/danspeech, 2019.","title":"Danspeech","authors":"Jensen Nielsen, Carsten Nielsen, Rasmus Arpe, Fogh Jensen","year":"2019","venue":null,"doi":null,"url":"https://github.com/danspeech/danspeech,2019","internal_url":null},{"position":17,"raw":"[Olson, 2011] Edwin Olson. AprilTag: A robust and flexible visual fiducial system. In 2011 IEEE International Confer- ence on Robotics and Automation, pages 3400-3407. IEEE, 2011.","title":"AprilTag: A robust and flexible visual fiducial system","authors":"Edwin Olson","year":"2011","venue":"IEEE International Conference on Robotics and Automation","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Premack and Woodruff, 1978] David Premack and Guy Woodruff. Does the chimpanzee have a theory of mind? Behavioral and brain sciences, 1(4):515-526, 1978.","title":"Does the chimpanzee have a theory of mind?","authors":"Woodruff ; ] David Premack, Guy Premack, Woodruff","year":"1978","venue":"Behavioral and brain sciences","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Rabinowitz et al., 2018] Neil C Rabinowitz, Frank Perbet, H Francis Song, Chiyuan Zhang, SM Eslami, and Matthew Botvinick. Machine Theory of Mind. arXiv preprint arXiv:1802.07740, 2018.","title":"Machine Theory of Mind","authors":"Frank Neil C Rabinowitz, Francis Perbet, Chiyuan Song, S M Zhang, Matthew Eslami, Botvinick","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Sindlar et al., 2009] Michal P Sindlar, Mehdi M Dastani, and John-Jules Ch Meyer. BDI-based development of vir- tual characters with a theory of mind. In International Work- shop on Intelligent Virtual Agents, pages 34-41. Springer, 2009.","title":"BDI-based development of virtual characters with a theory of mind","authors":"Mehdi M Michal P Sindlar, John-Jules Ch Dastani, Meyer","year":"2009","venue":"International Workshop on Intelligent Virtual Agents","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Wimmer and Perner, 1983] Heinz Wimmer and Josef Perner. Beliefs about beliefs: Representation and constraining func- tion of wrong beliefs in young children's understanding of deception. Cognition, 13(1):103-128, 1983.","title":"Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children's understanding of deception","authors":"Perner Wimmer, Heinz Wimmer, Josef Perner","year":"1983","venue":"Cognition","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Złotowski et al., 2015] Jakub Złotowski, Diane Proudfoot, Kumar Yogeeswaran, and Christoph Bartneck. Anthro- pomorphism: Opportunities and challenges in human- robot interaction. International Journal of Social Robotics, 7(3):347-360, 2015.","title":"Anthropomorphism: Opportunities and challenges in humanrobot interaction","authors":"Jakub Złotowski, Diane Proudfoot, Kumar Yogeeswaran, Christoph Bartneck","year":"2015","venue":"International Journal of Social Robotics","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}