Proceedings

Interaction Considerations in Learning from Humans

Pallavi Koppol, Henny Admoni, Reid Simmons

Download BibTeX Cite

Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence. Main Track. Pages 283-291.

https://doi.org/10.24963/ijcai.2021/40

Keywords

  • Humans and AI: Human-AI Collaboration
  • Agent-based and Multi-agent Systems: Human-Agent Interaction

Abstract

The ability to learn from large quantities of complex data has led to the development of intelligent agents such as self-driving cars and assistive devices. This data often comes from people via interactions such as labeling, providing rewards and punishments, and giving demonstrations or critiques. However, people's ability to provide high-quality data can be affected by human factors of an interaction, such as induced cognitive load and perceived usability. We show that these human factors differ significantly between interaction types. We first formalize interactions as a Markov Decision Process, and construct a taxonomy of these interactions to identify four archetypes: Showing, Categorizing, Sorting, and Evaluating. We then run a user study across two task domains. Our findings show that Evaluating interactions are more cognitively loading and less usable than the others, and Categorizing and Showing interactions are the least cognitively loading and most usable.

Pallavi Koppol, Henny Admoni, and Reid Simmons. 2021. Interaction Considerations in Learning from Humans. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21. IJCAI, 283–291. https://doi.org/10.24963/ijcai.2021/40
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards