{"type":"ScholarlyArticle","title":"Language to Action: Towards Interactive Task Learning with Physical Agents","authors":[{"name":"Joyce Y. Chai","slug":"joyce-y-chai","given":"Joyce Y.","family":"Chai","affiliation":"Department of Computer Science and Engineering , Michigan State University , East Lansing , MI 48824"},{"name":"Qiaozi Gao","slug":"qiaozi-gao","given":"Qiaozi","family":"Gao","affiliation":"Department of Computer Science and Engineering , Michigan State University , East Lansing , MI 48824"},{"name":"Lanbo She","slug":"lanbo-she","given":"Lanbo","family":"She","affiliation":"Microsoft Cloud & AI , Redmond , WA 98052"},{"name":"Shaohua Yang","slug":"shaohua-yang","given":"Shaohua","family":"Yang","affiliation":"Department of Computer Science and Engineering , Michigan State University , East Lansing , MI 48824"},{"name":"Sari Saba-Sadiya","slug":"sari-saba-sadiya","given":"Sari","family":"Saba-Sadiya","affiliation":"Department of Computer Science and Engineering , Michigan State University , East Lansing , MI 48824"},{"name":"Guangyue Xu","slug":"guangyue-xu","given":"Guangyue","family":"Xu","affiliation":"Department of Computer Science and Engineering , Michigan State University , East Lansing , MI 48824"}],"abstract":"Language communication plays an important role in human learning and knowledge acquisition. With the emergence of a new generation of cognitive robots, empowering these robots to learn directly from human partners becomes increasingly important. This paper gives a brief introduction to interactive task learning where humans can teach physical agents new tasks through natural language communication and action demonstration. It discusses research challenges and opportunities in language and communication grounding that are critical in this process. It further highlights the importance of commonsense knowledge, particularly the very basic physical causality knowledge, in grounding language to perception and action.","doi":"10.24963/ijcai.2018/1","url":"https://ijcai.org/proceedings/2018/1","pdf":"https://ijcai.org/proceedings/2018/0001.pdf","markdown":"https://ijcai.org/proceedings/2018/1.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/1","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Invited Speakers","track":"Invited Speakers","number":1,"pages":{"first":2,"last":9},"keywords":["Natural Language Processing: Natural Language Semantics","Robotics: Human Robot Interaction","Multidisciplinary Topics and Applications: Multidisciplinary Topics and Applications","Humans and AI: Human-AI Collaboration"],"videos":[],"references":[{"position":1,"raw":"[Argall et al., 2009] B. D. Argall, S. Chernova, M. Veloso, and B. Browning. A survey of robot learning from demon- stration. Robotics and autonomous systems, 57(5):469- 483, 2009.","title":"A survey of robot learning from demonstration","authors":"B D Argall, S Chernova, M Veloso, B Browning","year":"2009","venue":"Robotics and autonomous systems","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Artzi and Zettlemoyer, 2013] Y. Artzi and L. Zettlemoyer. Weakly supervised learning of semantic parsers for map- ping instructions to actions. TACL, 1:49-62, 2013.","title":"Weakly supervised learning of semantic parsers for mapping instructions to actions","authors":"Y Artzi, L Zettlemoyer","year":"2013","venue":"TACL","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Arumugam et al., 2017] D. Arumugam, S. Karamcheti, N. Gopalan, L. Wong, and S. Tellex. Accurately and ef- ficiently interpreting human-robot instructions of varying granularities. Robotics: Science and Systems, 2017.","title":"Accurately and efficiently interpreting human-robot instructions of varying granularities","authors":"D Arumugam, S Karamcheti, N Gopalan, L Wong, S Tellex","year":"2017","venue":"Robotics: Science and Systems","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Baker et al., 1998] C. Baker, C. Fillmore, and J. Lowe. The Berkeley FrameNet project. In Proceedings of the Thirty- Sixth Annual Meeting of the Association for Computa- tional Linguistics and Seventeenth International Confer- ence on Computational Linguistics, pages 86-90, San Francisco, California, 1998.","title":"The Berkeley FrameNet project","authors":"C Baker, C Fillmore, J Lowe","year":"1998","venue":"Proceedings of the Thirty-Sixth Annual Meeting of the Association for Computational Linguistics and Seventeenth International Conference on Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cakmak and Thomaz, 2012] M. Cakmak and A. L. Thomaz. Designing robot learners that ask good ques- tions. In ACM/IEEE International Conference on Human-Robot Interaction, pages 17-24, 2012.","title":"Designing robot learners that ask good questions","authors":"M Cakmak, A L Thomaz","year":"2012","venue":"ACM/IEEE International Conference on Human-Robot Interaction","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Chai et al., 2014] J. Y. Chai, L. She, R. Fang, S. Ottar- son, C. Littley, C. Liu, and K. Hanson. Collaborative ef- fort towards common ground in situated human robot dia- logue. In The 9th ACM/IEEE International Conference on Human-Robot Interaction, Bielefeld, Germany, 2014.","title":"Collaborative effort towards common ground in situated human robot dialogue","authors":"J Y Chai, L She, R Fang, S Ottarson, C Littley, C Liu, K Hanson","year":"2014","venue":"The 9th ACM/IEEE International Conference on Human-Robot Interaction","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Chai et al., 2016] J. Y. Chai, R. Fang, C. Liu, and L. She. Collaborative language grounding towards situated human robot dialogue. AI Magazine, 37(4):32-45, 2016.","title":"Collaborative language grounding towards situated human robot dialogue","authors":"J Y Chai, R Fang, C Liu, L She","year":"2016","venue":"AI Magazine","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Chai et al., 2018] J. Y. Chai, M. Cakmak, and C. Sidner. Teaching robots new tasks through natural interaction. In K. A. Gluck and J. E. Laird, editors, Interactive Task Learning: Agents, Robots, and Humans Acquiring New Tasks through Natural Interactions, chapter 9. MIT Press, 2018. (In Press).","title":"Teaching robots new tasks through natural interaction","authors":"J Y Chai, M Cakmak, C Sidner","year":"2018","venue":"Interactive Task Learning: Agents, Robots, and Humans Acquiring New Tasks through Natural Interactions","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Chao et al., 2015] Y. Chao, Z. Wang, R. Mihalcea, and J. Deng. Mining semantic affordances of visual object categories. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 4259-4267, 2015.","title":"Mining semantic affordances of visual object categories","authors":"Y Chao, Z Wang, R Mihalcea, J Deng","year":"2015","venue":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Chen and Mooney, 2011] D. L. Chen and R. J. Mooney. Learning to interpret natural language navigation instruc- tions from observations. In AAAI, 2011.","title":"Learning to interpret natural language navigation instructions from observations","authors":"D L Chen, R J Mooney","year":"2011","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Clark, 1996] H. H. Clark. Using language. Cambridge Uni- versity Press, Cambridge, UK, 1996.","title":"Using language","authors":"H H Clark","year":"1996","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Csibra and Gergely, 2006] G. Csibra and G. Gergely. So- cial learning and social cognition: the case for pedagogy.","title":"Social learning and social cognition: the case for pedagogy","authors":"G Csibra, G Gergely","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"In Y. Munakata and M. H. Johnson, editors, Processes of Changes in Brain and Cognitive Development, pages 1249-274. Oxford University Press, 2006.","title":"Processes of Changes in Brain and Cognitive Development","authors":null,"year":"2006","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Csibra and Gergely, 2009] G. Csibra and G. Gergely. Natu- ral pedagogy. Trends Cogn Sci., 13(4):148-153, 2009.","title":"Natural pedagogy","authors":"G Csibra, G Gergely","year":"2009","venue":"Trends Cogn Sci","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Dixon and Aikhenvald, 2006] R. M. W. Dixon and A.Y. Aikhenvald. Adjective Classes: A Cross-linguistic Typol- ogy. Explorations in Language and Space. Oxford Press, 2006.","title":"Adjective Classes: A Cross-linguistic Typology. Explorations in Language and Space","authors":"R M W Dixon, A Y Aikhenvald","year":"2006","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Fire and Zhu, 2016] A. Fire and S. Zhu. Learning percep- tual causality from video. ACM Transactions on Intelligent Systems and Technology (TIST), 7(2):23, 2016.","title":"Learning perceptual causality from video","authors":"A Fire, S Zhu","year":"2016","venue":"ACM Transactions on Intelligent Systems and Technology (TIST)","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Forbes and Choi, 2017] M. Forbes and Y. Choi. Verb physics: Relative physical knowledge of actions and ob- jects. In Proceedings of the 55th Annual Meeting of the As- sociation for Computational Linguistics (Volume 1: Long Papers), volume 1, pages 266-276, 2017.","title":"Verb physics: Relative physical knowledge of actions and objects","authors":"M Forbes, Y Choi","year":"2017","venue":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Gao et al., 2016] Q. Gao, M. Doering, S. Yang, and J. Y. Chai. Physical causality of action verbs in grounded lan- guage understanding. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL), volume 1, pages 1814-1824, 2016.","title":"Physical causality of action verbs in grounded language understanding","authors":"Q Gao, M Doering, S Yang, J Y Chai","year":"2016","venue":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL)","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Gao et al., 2018] Q. Gao, S. Yang, J. Y. Chai, and L. Van- derwende. What action causes this? towards naive phys- ical action-effect prediction. In Proceedings of the 56th Annual Meeting of the Association for Computational Lin- guistics (ACL), 2018.","title":"What action causes this? towards naive physical action-effect prediction","authors":"Q Gao, S Yang, J Y Chai, L Vanderwende","year":"2018","venue":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL)","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Gibson, 1979] J. J. Gibson. The Ecological Approach to Vi- sual Perception. 1979.","title":"The Ecological Approach to Visual Perception","authors":"J J Gibson","year":"1979","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Gluck and Laird, 2018] K. A. Gluck and J. E. Laird, editors. Interactive Task Learning: Agents, Robots, and Humans Acquiring New Tasks through Natural Interactions. MIT Press, 2018. (In Press).","title":"Interactive Task Learning: Agents, Robots, and Humans Acquiring New Tasks through Natural Interactions","authors":null,"year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Goldman, 2012] A. Goldman. Theory of mind. In The Ox- ford Handbook of Philosophy of Cognitive Science. 2012.","title":"Theory of mind","authors":"A Goldman","year":"2012","venue":"The Oxford Handbook of Philosophy of Cognitive Science","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Harnad, 1990] S. Harnad. The symbol grounding problem. In Physica D 42, pages 335-346, 1990.","title":"The symbol grounding problem","authors":"S Harnad","year":"1990","venue":"Physica D","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Hogg et al., 2009] C. Hogg, U. Kuter, and H. Muñoz-Avila. Learning hierarchical task networks for nondeterministic planning domains. In IJCAI, pages 1708-1714, 2009.","title":"Learning hierarchical task networks for nondeterministic planning domains","authors":"C Hogg, U Kuter, H Muñoz-Avila","year":"2009","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2009/285"},{"position":25,"raw":"[Hovav, 2010] B. Hovav, M.and Levin. Reflections on Man- ner / Result Complementarity. Lexical Semantics, Syntax, and Event Structure, pages 21-38, 2010.","title":"Reflections on Manner / Result Complementarity","authors":"B Hovav, M Levin","year":"2010","venue":"Lexical Semantics, Syntax, and Event Structure","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Kennington and Schlangen, 2015] C. Kennington and D. Schlangen. Simple learning and compositional ap- plication of perceptually grounded word meanings for incremental reference resolution. In Proceedings of the 53rd Annual Meeting of Association for Computational Linguistics (ACL), 2015.","title":"Simple learning and compositional application of perceptually grounded word meanings for incremental reference resolution","authors":"C Kennington, D Schlangen","year":"2015","venue":"Proceedings of the 53rd Annual Meeting of Association for Computational Linguistics (ACL)","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Kress-Gazit et al., 2008] H. Kress-Gazit, G. E. Fainekos, and G. J. Pappas. Translating structured english to robot controllers. Advanced Robotics, 22(12):1343-1359, 2008.","title":"Translating structured english to robot controllers","authors":"H Kress-Gazit, G E Fainekos, G J Pappas","year":"2008","venue":"Advanced Robotics","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Liu et al., 2012] C. Liu, R. Fang, and J. Y. Chai. Towards mediating shared perceptual basis in situated dialogue. In Proceedings of the 13th Annual Meeting of the Special In- terest Group on Discourse and Dialogue, pages 140-149, Seoul, South Korea, 2012.","title":"Towards mediating shared perceptual basis in situated dialogue","authors":"C Liu, R Fang, J Y Chai","year":"2012","venue":"Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Liu et al., 2016] C. Liu, S. Yang, S. Saba-Sadiya, N. Shukla, Y. He, S. Zhu, and J. Y. Chai. Jointly learning grounded task structures from language instruc- tion and visual demonstration. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1482-1492, 2016.","title":"Jointly learning grounded task structures from language instruction and visual demonstration","authors":"C Liu, S Yang, S Saba-Sadiya, N Shukla, Y He, S Zhu, J Y Chai","year":"2016","venue":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Matuszek et al., 2012] C. Matuszek, N. Fitzgerald, L. Zettlemoyer, L. Bo, and D. Fox. A joint model of language and perception for grounded attribute learn- ing. In Proceedings of the 29th International Conference on Machine Learning (ICML-12), pages 1671-1678, 2012.","title":"A joint model of language and perception for grounded attribute learning","authors":"C Matuszek, N Fitzgerald, L Zettlemoyer, L Bo, D Fox","year":"2012","venue":"Proceedings of the 29th International Conference on Machine Learning (ICML-12)","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Misra and Langford, 2017] D. K. Misra and Y. Langford, J.and Artzi. Mapping instructions and visual observations to actions with reinforcement learning. Proceedings of the Conference on Empirical Methods in Natural Language Processing, 2017.","title":"Mapping instructions and visual observations to actions with reinforcement learning","authors":"D K Misra, Y Langford, J Artzi","year":"2017","venue":"Proceedings of the Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Misra et al., 2015] D. K. Misra, K. Tao, P. Liang, and A. Saxena. Environment-driven lexicon induction for high-level instructions. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics, pages 992-1002, 2015.","title":"Environment-driven lexicon induction for high-level instructions","authors":"D K Misra, K Tao, P Liang, A Saxena","year":"2015","venue":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Mitchell et al., 2018] T. Mitchell, S. Garrod, J. Laird, S. Levinson, and K. Koedinger. Framing the problem of in- teractive task learning. In K. A. Gluck and J. E. Laird, ed- itors, Interactive Task Learning: Agents, Robots, and Hu- mans Acquiring New Tasks through Natural Interactions, chapter 2. MIT Press, 2018. (In Press).","title":"Framing the problem of interactive task learning","authors":"T Mitchell, S Garrod, J Laird, S Levinson, K Koedinger","year":"2018","venue":"itors, Interactive Task Learning: Agents, Robots, and Humans Acquiring New Tasks through Natural Interactions","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Mohan and Laird., 2014] S. Mohan and J. E. Laird. Learn- ing goal-oriented hierarchical tasks from situated interac- tive instruction. In Proceedings of the 28th AAAI Confer- ence on Artificial Intelligence, 2014.","title":"Learning goal-oriented hierarchical tasks from situated interactive instruction","authors":"S Mohan, J E Laird","year":"2014","venue":"Proceedings of the 28th AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Mohseni-Kabir et al., 2018] A. Mohseni-Kabir, C. Li, V. Wu, D. Miller, B. Hylak, S. Chernova, D. Berenson, C. Sidner, and C. Rich. Simultaneous learning of hi- erarchy and primitives (slhap) for complex robot tasks. Autonomous Robotics, 2018.","title":"Simultaneous learning of hierarchy and primitives (slhap) for complex robot tasks","authors":"A Mohseni-Kabir, C Li, V Wu, D Miller, B Hylak, S Chernova, D Berenson, C Sidner, C Rich","year":"2018","venue":"Autonomous Robotics","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Palmer et al., 2005] M. Palmer, D. Gildea, and P. Kings- bury. The proposition bank: An annotated corpus of se- mantic roles. Computational linguistics, 31(1):71-106, 2005.","title":"The proposition bank: An annotated corpus of semantic roles","authors":"M Palmer, D Gildea, P Kingsbury","year":"2005","venue":"Computational linguistics","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Pearl, 2009] J. Pearl. Causality: Models, Reasoning, and Inference. Cambridge University Press, 2 edition, 2009.","title":"Causality: Models, Reasoning, and Inference","authors":"J Pearl","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Redmon and Farhadi, 2017] J. Redmon and A. Farhadi. Yolo9000: better, faster, stronger. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.","title":"Yolo9000: better, faster, stronger","authors":"J Redmon, A Farhadi","year":"2017","venue":"Proceedings of the IEEE conference on computer vision and pattern recognition","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Roy, 2005] D. Roy. Grounding words in perception and ac- tion: computational insights. TRENDS in Cognitive Sci- ences, 9(8):389-396, 2005.","title":"Grounding words in perception and action: computational insights","authors":"D Roy","year":"2005","venue":"TRENDS in Cognitive Sciences","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Rybski et al., 2007] P. E. Rybski, K. Yoon, J. Stolarz, and M. M. Veloso. Interactive robot task training through di- alog and demonstration. In The 2nd ACM/IEEE Inter- national Conference onHuman-Robot Interaction (HRI), pages 49-56, 2007.","title":"Interactive robot task training through dialog and demonstration","authors":"P E Rybski, K Yoon, J Stolarz, M M Veloso","year":"2007","venue":"The 2nd ACM/IEEE International Conference onHuman-Robot Interaction (HRI)","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Scheutz et al., 2017] M. Scheutz, E. Krause, B. Oosterveld, T. Frasca, and R. Platt. Spoken instruction-based one-shot object and action learning in a cognitive robotic architec- ture. In Proceedings of the 16th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2017), pages 1378-1386, 2017.","title":"Spoken instruction-based one-shot object and action learning in a cognitive robotic architecture","authors":"M Scheutz, E Krause, B Oosterveld, T Frasca, R Platt","year":"2017","venue":"Proceedings of the 16th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2017)","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[She and Chai, 2016] L. She and J. Y. Chai. Incremental ac- quisition of verb hypothesis space towards physical world interaction. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 108-117, Berlin, Germany, 2016.","title":"Incremental acquisition of verb hypothesis space towards physical world interaction","authors":"L She, J Y Chai","year":"2016","venue":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[She and Chai, 2017] L. She and J. Y. Chai. Interactive learning of grounded verb semantics towards human-robot communication. In Proceedings of the 55th Annual Meet- ing of the Association for Computational Linguistics (Vol- ume 1: Long Papers), pages 1634-1644, 2017.","title":"Interactive learning of grounded verb semantics towards human-robot communication","authors":"L She, J Y Chai","year":"2017","venue":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[She et al., 2014] L. She, S. Yang, Y. Cheng, Y. Jia, J. Y. Chai, and N Xi. Back to the blocks world: Learning new actions through situated human-robot dialogue. In Pro- ceedings of the SIGDIAL 2014 Conference, 2014.","title":"Back to the blocks world: Learning new actions through situated human-robot dialogue","authors":"L She, S Yang, Y Cheng, Y Jia, J Y Chai, Xi","year":"2014","venue":"Proceedings of the SIGDIAL 2014 Conference","doi":null,"url":null,"internal_url":null},{"position":45,"raw":"[Tehrani and Riede, 2008] J. J. Tehrani and F. Riede. To- wards an archeology of pedagogy: Learning, teaching and the generation of material culture traditions. World Ar- chaeol, 40:316-331, 2008.","title":"Towards an archeology of pedagogy: Learning, teaching and the generation of material culture traditions","authors":"J J Tehrani, F Riede","year":"2008","venue":"World Archaeol","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Tellex et al., 2011] T. Tellex, S.and Kollar, S. Dickerson, M. R. Walter, A. G. Banerjee, S..J. Teller, and N. Roy. Un- derstanding natural language commands for robotic navi- gation and mobile manipulation. In AAAI, 2011.","title":"Understanding natural language commands for robotic navigation and mobile manipulation","authors":"T Tellex, S Kollar, S Dickerson, M R Walter, A G Banerjee, S . J Teller, N Roy","year":"2011","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":47,"raw":"[Thomason et al., 2016] J. Thomason, J. Sinapov, M. Svet- lik, P. Stone, and R. J. Mooney. Learning multi-modal grounded linguistic semantics by playing \"i spy\". In Pro- ceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI-16), pages 3477-3483, New York City, 2016.","title":"Learning multi-modal grounded linguistic semantics by playing \"i spy","authors":"J Thomason, J Sinapov, M Svetlik, P Stone, R J Mooney","year":"2016","venue":"Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI-16)","doi":null,"url":null,"internal_url":"/proceedings/2016/491"},{"position":48,"raw":"[Thomaz and Cakmak, 2009] A. L. Thomaz and M. Cak- mak. Learning about objects with human teachers. In Proceedings of the 4th ACM/IEEE International Confer- ence on Human Robot Interaction, HRI '09, pages 15-22, New York, NY, USA, 2009. ACM.","title":"Learning about objects with human teachers","authors":"A L Thomaz, M Cakmak","year":"2009","venue":"Proceedings of the 4th ACM/IEEE International Conference on Human Robot Interaction, HRI '09","doi":null,"url":null,"internal_url":null},{"position":49,"raw":"[Thomaz et al., 2018] A. L. Thomaz, E. Lieven, M. Cakmak, J. Y. Chai, S. Garrod, W. Gray, S. Levinson, A. Paiva, and N. Russwinkel. Interaction for task instruction and learn- ing. In K. A. Gluck and J. E. Laird, editors, Interactive Task Learning: Agents, Robots, and Humans Acquiring New Tasks through Natural Interactions. MIT Press, 2018. (In Press).","title":"Interaction for task instruction and learning","authors":"A L Thomaz, E Lieven, M Cakmak, J Y Chai, S Garrod, W Gray, S Levinson, A Paiva, N Russwinkel","year":"2018","venue":"Interactive Task Learning: Agents, Robots, and Humans Acquiring New Tasks through Natural Interactions","doi":null,"url":null,"internal_url":null},{"position":50,"raw":"[Tomasello, 2003] M. Tomasello. Constructing a Language: A Usage-Based Theory of Language Acquisition. Harvard University Press, 2003.","title":"Constructing a Language: A Usage-Based Theory of Language Acquisition","authors":"M Tomasello","year":"2003","venue":null,"doi":null,"url":null,"internal_url":null},{"position":51,"raw":"[Tomasello, 2008] M. Tomasello. The Origins of Human Communication. MIT Press, 2008.","title":"The Origins of Human Communication","authors":"M Tomasello","year":"2008","venue":null,"doi":null,"url":null,"internal_url":null},{"position":52,"raw":"[Wang et al., 2017] S. I. Wang, S. Ginn, P. Liang, and C. D. Manning. Naturalizing a programming language via inter- active learning. In Association for Computational Linguis- tics (ACL), 2017.","title":"Naturalizing a programming language via interactive learning","authors":"S I Wang, S Ginn, P Liang, C D Manning","year":"2017","venue":"Association for Computational Linguistics (ACL)","doi":null,"url":null,"internal_url":null},{"position":53,"raw":"[Williams and Scheutz, 2018] T. Williams and M. Scheutz. Reference in robotics: A givenness hierarchy theoretic ap- proach. In Jeanette Gundel and Barbara Abbott, editors, The Oxford Handbook of Reference. 2018.","title":"Reference in robotics: A givenness hierarchy theoretic approach","authors":"T Williams, M Scheutz","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":54,"raw":"[Wu et al., 2017] J. Wu, E. Lu, P. Kohli, W. Freeman, and J. Tenenbaum. Learning to see physics via visual de- animation. In Proceedings of the 31th Annual Conference on Neural Information Processing Systems (NIPS), 2017.","title":"Learning to see physics via visual deanimation","authors":"J Wu, E Lu, P Kohli, W Freeman, J Tenenbaum","year":"2017","venue":"Proceedings of the 31th Annual Conference on Neural Information Processing Systems (NIPS)","doi":null,"url":null,"internal_url":null},{"position":55,"raw":"[Yang et al., 2016] S. Yang, Q. Gao, C. Liu, C. Xiong, S. Zhu, and J. Y. Chai. Grounded semantic role labeling. In Proceedings of NAACL, pages 149-159, 2016.","title":"Grounded semantic role labeling","authors":"S Yang, Q Gao, C Liu, C Xiong, S Zhu, J Y Chai","year":"2016","venue":"Proceedings of NAACL","doi":null,"url":null,"internal_url":null},{"position":56,"raw":"[Zellers and Choi, 2017] R. Zellers and Y. Choi. Zero-shot activity recognition with verb attribute induction. In Pro- ceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2017.","title":"Zero-shot activity recognition with verb attribute induction","authors":"R Zellers, Y Choi","year":"2017","venue":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP)","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}