{"type":"ScholarlyArticle","title":"Learning and Communicating the Latent States of Human-Machine Collaboration","authors":[{"name":"Vaibhav V. Unhelkar","slug":"vaibhav-v-unhelkar","given":"Vaibhav V.","family":"Unhelkar","affiliation":"Massachusetts Institute of Technology Cambridge , Massachusetts 02139"},{"name":"Julie A. Shah","slug":"julie-a-shah","given":"Julie A.","family":"Shah","affiliation":"Massachusetts Institute of Technology Cambridge , Massachusetts 02139"}],"abstract":"Artificial agents (both embodied robots and software agents) that interact with humans are increasing at an exceptional rate. Yet, achieving seamless collaboration between artificial agents and humans in the real world remains an active problem. A key challenge is that the agents need to make decisions without complete information about their shared environment and collaborators. For instance, a human-robot team performing a rescue operation after a disaster may not have an accurate map of their surroundings. Even in structured domains, such as manufacturing, a robot might not know the goals or preferences of its human collaborators.\r\n\r\nAlgorithmically, this challenge manifests itself as a problem of decision-making under uncertainty in which the agent has to reason about the latent states of its environment and human collaborator. However, in practice, quantifying this uncertainty (i.e., the state transition function) and even specifying the features (i.e., the relevant states) of human-machine collaboration is difficult. Thus, the objective of this thesis research is to develop novel algorithms that enable artificial agents to learn and reason about the latent states of human-machine collaboration and achieve fluent interaction.","doi":"10.24963/ijcai.2018/838","url":"https://ijcai.org/proceedings/2018/838","pdf":"https://ijcai.org/proceedings/2018/0838.pdf","markdown":"https://ijcai.org/proceedings/2018/838.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/838","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Doctoral Consortium","track":"Doctoral Consortium","number":838,"pages":{"first":5789,"last":5790},"keywords":["Robotics and Vision: Human-Robot Interaction","Uncertainty in AI: Graphical Models","Uncertainty in AI: Sequential Decision Making"],"videos":[],"references":[{"position":1,"raw":"[Albrecht and Stone, 2018] Stefano Albrecht and Peter Stone. Autonomous agents modelling other agents: A comprehensive survey and open problems. Artificial Intelligence, 258:66 -95, 2018.","title":"Autonomous agents modelling other agents: A comprehensive survey and open problems","authors":"Albrecht, Stone, Stefano Albrecht, Peter Stone","year":"2018","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Butchibabu et al., 2016] Abhizna Butchibabu, Christopher Sparano-Huiban, Liz Sonenberg, and Julie Shah. Implicit coordination strategies for effective team communication. Human Factors, 58(4):595-610, 2016.","title":"Implicit coordination strategies for effective team communication","authors":"Butchibabu","year":"2016","venue":"Human Factors","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Jonker et al., 2011] Catholijn M Jonker, M Birna Van Riemsdijk, and Bas Vermeulen. Shared mental models. In COIN, 2011. [Kahneman, 2003]","title":"Shared mental models","authors":"M Catholijn, M Birna Jonker, Bas Van Riemsdijk, Vermeulen","year":"2003","venue":"COIN","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"Daniel Kahneman. Maps of bounded ra- tionality. The American Economic Review, 93(5):1449- 1475, 2003.","title":"Maps of bounded rationality","authors":"Daniel Kahneman","year":"2003","venue":"The American Economic Review","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Roth et al., 2005] Maayan Roth, Reid Simmons, and Manuela Veloso. Reasoning about joint beliefs for execution-time communication decisions. In AAMAS, 2005.","title":"Reasoning about joint beliefs for execution-time communication decisions","authors":"Maayan Roth, Reid Simmons, Manuela Veloso","year":"2005","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Thomaz et al., 2016] Andrea Thomaz, Guy Hoffman, and Maya Cakmak. Computational human-robot interaction. Foundations and Trends in Robotics, 2016.","title":"Computational human-robot interaction","authors":"Andrea Thomaz, Guy Hoffman, Maya Cakmak","year":"2016","venue":"Foundations and Trends in Robotics","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Unhelkar and Shah, 2016] Vaibhav V Unhelkar and Julie A Shah. ConTaCT: deciding to communicate during time- critical collaborative tasks in unknown deterministic do- mains. In AAAI, 2016.","title":"ConTaCT: deciding to communicate during timecritical collaborative tasks in unknown deterministic domains","authors":"V Vaibhav, Julie A Unhelkar, Shah","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Unhelkar et al., 2017] Vaibhav V Unhelkar, X Jessie Yang, and Julie A Shah. Challenges for Communication Decision-Making in Sequential Human-Robot Collabora- tive Tasks. In R:SS workshop on HRI, 2017.","title":"Challenges for Communication Decision-Making in Sequential Human-Robot Collaborative Tasks","authors":"Jessie Vaibhav V Unhelkar, Julie A Yang, Shah","year":"2017","venue":"R:SS workshop on HRI","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Unhelkar et al., 2018] Vaibhav V Unhelkar*, Przemyslaw Lasota* and others. Human-Aware Robotic Assistant for Collaborative Assembly: Integrating Human Motion Pre- diction with Planning in Time. IEEE Robotics and Au- tomation Letters, 2018.","title":"Human-Aware Robotic Assistant for Collaborative Assembly: Integrating Human Motion Prediction with Planning in Time","authors":"* Vaibhav V Unhelkar, Przemyslaw Lasota, * Others","year":"2018","venue":"IEEE Robotics and Automation Letters","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Unhelkar and Shah, 2018] Vaibhav V Unhelkar and Julie A Shah. Learning Models of Sequential Decision-Making without Complete State Specification using Bayesian Non- parametric Inference and Active Querying. CSAIL Tech- nical report, MIT, 2018.","title":"Learning Models of Sequential Decision-Making without Complete State Specification using Bayesian Nonparametric Inference and Active Querying","authors":"V Vaibhav, Julie A Unhelkar, Shah","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Van Gael et al., 2008] Jurgen Van Gael, Yunus Saatci, Yee Whye Teh, and Zoubin Ghahramani. Beam sampling for the infinite hidden Markov model. In ICML, 2008.","title":"Beam sampling for the infinite hidden Markov model","authors":"Van Gael","year":"2008","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Ziebart et al., 2008] Brian D Ziebart, Andrew L Maas, J Andrew Bagnell, and Anind K Dey. Maximum Entropy Inverse Reinforcement Learning. In AAAI, 2008.","title":"Maximum Entropy Inverse Reinforcement Learning","authors":"Brian D Ziebart, Andrew L Maas, J Andrew Bagnell, Anind K Dey","year":"2008","venue":"AAAI","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}