{"type":"ScholarlyArticle","title":"Interaction Considerations in Learning from Humans","authors":[{"name":"Pallavi Koppol","slug":"pallavi-koppol","given":"Pallavi","family":"Koppol","affiliation":""},{"name":"Henny Admoni","slug":"henny-admoni","given":"Henny","family":"Admoni","affiliation":""},{"name":"Reid Simmons","slug":"reid-simmons","given":"Reid","family":"Simmons","affiliation":""}],"abstract":"The ability to learn from large quantities of complex data has led to the development of intelligent agents such as self-driving cars and assistive devices. This data often comes from people via interactions such as labeling, providing rewards and punishments, and giving demonstrations or critiques. However, people's ability to provide high-quality data can be affected by human factors of an interaction, such as induced cognitive load and perceived usability. We show that these human factors differ significantly between interaction types. We first formalize interactions as a Markov Decision Process, and construct a taxonomy of these interactions to identify four archetypes: Showing, Categorizing, Sorting, and Evaluating. We then run a user study across two task domains. Our findings show that Evaluating interactions are more cognitively loading and less usable than the others, and Categorizing and Showing interactions are the least cognitively loading and most usable.","doi":"10.24963/ijcai.2021/40","url":"https://ijcai.org/proceedings/2021/40","pdf":"https://ijcai.org/proceedings/2021/0040.pdf","markdown":"https://ijcai.org/proceedings/2021/40.md","bibtex":"https://ijcai.org/proceedings/2021/bibtex/40","volume":{"slug":"2021","title":"Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2021","url":"https://ijcai.org/proceedings/2021/","year":2021,"location":"Montreal","dates":"19-27 August 2021","editors":"Prof. Zhi-Hua Zhou","isbn":"978-0-9992411-9-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2021"},"section":"Agent-based and Multi-agent Systems","track":"Main Track","number":40,"pages":{"first":283,"last":291},"keywords":["Humans and AI: Human-AI Collaboration","Agent-based and Multi-agent Systems: Human-Agent Interaction"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}