Mental Models of AI Agents in a Cooperative Game Setting (Extended Abstract)

Gero, Katy Ilonka; Ashktorab, Zahra; Dugan, Casey; Pan, Qian; Johnson, James; Geyer, Werner; Ruiz, Maria; Miller, Sarah; Millen, David R.; Campbell, Murray; Kumaravel, Sadhana; Zhang, Wei

doi:10.24963/ijcai.2021/648

Mental Models of AI Agents in a Cooperative Game Setting (Extended Abstract)

Katy Ilonka Gero, Zahra Ashktorab, Casey Dugan, Qian Pan, James Johnson, Werner Geyer, Maria Ruiz, Sarah Miller, David R. Millen, Murray Campbell, Sadhana Kumaravel, Wei Zhang

Download BibTeX Cite

Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence. Sister Conferences Best Papers. Pages 4770-4774.

https://doi.org/10.24963/ijcai.2021/648

Keywords

Humans and AI: Cognitive Modeling
Humans and AI: Human-Computer Interaction
Humans and AI: Human-AI Collaboration
Heuristic Search and Game Playing: Game Playing

Abstract

As more and more forms of AI become prevalent, it becomes increasingly important to understand how people develop mental models of these systems. In this work we study people's mental models of an AI agent in a cooperative word guessing game. We run a study in which people play the game with an AI agent while ``thinking out loud''; through thematic analysis we identify features of the mental models developed by participants. In a large-scale study we have participants play the game with the AI agent online and use a post-game survey to probe their mental model. We find that those who win more often have better estimates of the AI agent's abilities. We present three components---global knowledge, local knowledge, and knowledge distribution---for modeling AI systems and propose that understanding the underlying technology is insufficient for developing appropriate conceptual models---analysis of behavior is also necessary.

Katy Ilonka Gero, Zahra Ashktorab, Casey Dugan, Qian Pan, James Johnson, Werner Geyer, Maria Ruiz, Sarah Miller, David R. Millen, Murray Campbell, Sadhana Kumaravel, and Wei Zhang. 2021. Mental Models of AI Agents in a Cooperative Game Setting (Extended Abstract). In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21. IJCAI, 4770–4774. https://doi.org/10.24963/ijcai.2021/648

@inproceedings{ijcai2021p648,
  title     = {Mental Models of AI Agents in a Cooperative Game Setting (Extended Abstract)},
  author    = {Gero, Katy Ilonka and Ashktorab, Zahra and Dugan, Casey and Pan, Qian and Johnson, James and Geyer, Werner and Ruiz, Maria and Miller, Sarah and Millen, David R. and Campbell, Murray and Kumaravel, Sadhana and Zhang, Wei},
  booktitle = {Proceedings of the Thirtieth International Joint Conference on
               Artificial Intelligence, {IJCAI-21}},
  publisher = {International Joint Conferences on Artificial Intelligence Organization},
  editor    = {Prof. Zhi-Hua Zhou},
  pages     = {4770--4774},
  year      = {2021},
  month     = {8},
  note      = {Sister Conferences Best Papers},
  doi       = {10.24963/ijcai.2021/648},
  url       = {https://doi.org/10.24963/ijcai.2021/648},
}

TY  - CPAPER
TI  - Mental Models of AI Agents in a Cooperative Game Setting (Extended Abstract)
AU  - Gero, Katy Ilonka
AU  - Ashktorab, Zahra
AU  - Dugan, Casey
AU  - Pan, Qian
AU  - Johnson, James
AU  - Geyer, Werner
AU  - Ruiz, Maria
AU  - Miller, Sarah
AU  - Millen, David R.
AU  - Campbell, Murray
AU  - Kumaravel, Sadhana
AU  - Zhang, Wei
T2  - Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21
PB  - International Joint Conferences on Artificial Intelligence Organization
PY  - 2021
SP  - 4770
EP  - 4774
DO  - 10.24963/ijcai.2021/648
UR  - https://doi.org/10.24963/ijcai.2021/648
ER  -