{"type":"ScholarlyArticle","title":"Parsing Natural Language Conversations using Contextual Cues","authors":[{"name":"Shashank Srivastava","slug":"shashank-srivastava","given":"Shashank","family":"Srivastava","affiliation":"Carnegie Mellon University"},{"name":"Amos Azaria","slug":"amos-azaria","given":"Amos","family":"Azaria","affiliation":"Ariel University"},{"name":"Tom Mitchell","slug":"tom-mitchell","given":"Tom","family":"Mitchell","affiliation":"Carnegie Mellon University"}],"abstract":"In this work, we focus on semantic parsing of natural language conversations. Most existing methods for semantic parsing are based on understanding the semantics of a single sentence at a time. However, understanding conversations also requires an understanding of conversational context and discourse structure across sentences. We formulate semantic parsing of conversations as a structured prediction task, incorporating structural features that model the `flow of discourse' across sequences of utterances. We create a dataset for semantic parsing of conversations, consisting of 113 real-life sequences of interactions of human users with an automated email assistant. The data contains 4759 natural language statements paired with annotated logical forms.  Our approach yields significant gains in performance over traditional semantic parsing.","doi":"10.24963/ijcai.2017/571","url":"https://ijcai.org/proceedings/2017/571","pdf":"https://ijcai.org/proceedings/2017/0571.pdf","markdown":"https://ijcai.org/proceedings/2017/571.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/571","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Natural Language Processing","track":"Main track","number":571,"pages":{"first":4089,"last":4095},"keywords":["Machine Learning: Structured Learning","Natural Language Processing: Natural Language Processing","Natural Language Processing: Natural Language Semantics","Natural Language Processing: Tagging, chunking, syntax, and parsing"],"videos":[],"references":[{"position":1,"raw":"[Artzi and Zettlemoyer, 2011] Yoav Artzi and Luke Zettlemoyer. Bootstrapping semantic parsers from conversations. In EMNLP, pages 421-432, 2011.","title":"Bootstrapping semantic parsers from conversations","authors":"Zettlemoyer Artzi, Yoav Artzi, Luke Zettlemoyer","year":"2011","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Artzi and Zettlemoyer, 2013] Yoav Artzi and Luke Zettlemoyer. Weakly supervised learning of semantic parsers for mapping in- structions to actions. Transactions of the Association for Com- putational Linguistics, 1:49-62, 2013.","title":"Weakly supervised learning of semantic parsers for mapping instructions to actions","authors":"Zettlemoyer Artzi, Yoav Artzi, Luke Zettlemoyer","year":"2013","venue":"Transactions of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Artzi et al., 2015] Yoav Artzi, Kenton Lee, and Luke Zettle- moyer. Broad-coverage ccg semantic parsing with AMR. In EMNLP, pages 1699-1710, 2015.","title":"Broad-coverage ccg semantic parsing with AMR","authors":"Yoav Artzi, Kenton Lee, Luke Zettlemoyer","year":"2015","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Azaria et al., 2016] Amos Azaria, Jayant Krishnamurthy, and Tom M Mitchell. Instructable intelligent personal agent. In AAAI, volume 4, 2016.","title":"Instructable intelligent personal agent","authors":"Amos Azaria, Jayant Krishnamurthy, Tom M Mitchell","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Bahdanau et al., 2015] Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. Neural machine translation by jointly learn- ing to align and translate. In Proceedings of the International Conference on Learning Representations (ICLR), 2015.","title":"Neural machine translation by jointly learning to align and translate","authors":"Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio","year":"2015","venue":"Proceedings of the International Conference on Learning Representations (ICLR)","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Bates, 1976] Elizabeth Bates. Language and context : the acqui- sition of pragmatics. Academic Press New York, 1976.","title":"Elizabeth Bates. Language and context : the acquisition of pragmatics","authors":"Bates","year":"1976","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Berant and Liang, 2014] Jonathan Berant and Percy Liang. Se- mantic parsing via paraphrasing. In ACL, 2014.","title":"Semantic parsing via paraphrasing","authors":"Liang Berant, Jonathan Berant, Percy Liang","year":"2014","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Berant et al., 2013] Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. Semantic parsing on freebase from question- answer pairs. In EMNLP, volume 2, page 6, 2013.","title":"Semantic parsing on freebase from questionanswer pairs","authors":"Jonathan Berant, Andrew Chou, Roy Frostig, Percy Liang","year":"2013","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Chambers and Jurafsky, 2008] Nathanael Chambers and Daniel Jurafsky. Unsupervised learning of narrative event chains. In ACL, volume 94305, pages 789-797, 2008.","title":"Unsupervised learning of narrative event chains","authors":"Jurafsky Chambers, Nathanael Chambers, Daniel Jurafsky","year":"2008","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Clarke et al., 2010] James Clarke, Dan Goldwasser, Ming-Wei Chang, and Dan Roth. Driving semantic parsing from the world's response. In CoNLL, pages 18-27. Association for Computational Linguistics, 2010.","title":"Driving semantic parsing from the world's response","authors":"James Clarke, Dan Goldwasser, Ming-Wei Chang, Dan Roth","year":"2010","venue":"CoNLL","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Collins, 2002] Michael Collins. Discriminative training methods for hidden markov models: Theory and experiments with per- ceptron algorithms. In EMNLP, pages 1-8, 2002.","title":"Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms","authors":"Michael Collins","year":"2002","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Goldwasser and Roth, 2014] Dan Goldwasser and Dan Roth. Learning from natural instructions. Machine learning, 94(2):205-232, 2014.","title":"Learning from natural instructions","authors":"Roth ; Goldwasser, Dan Goldwasser, Dan Roth","year":"2014","venue":"Machine learning","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Gulwani and Marron, 2014] Sumit Gulwani and Mark Marron. Nlyze: Interactive programming by natural language for spread- sheet data analysis and manipulation. In SIGMOD, 2014.","title":"Nlyze: Interactive programming by natural language for spreadsheet data analysis and manipulation","authors":"Sumit Gulwani, Mark Marron","year":"2014","venue":"SIGMOD","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Higashinaka et al., 2003] Ryuichiro Higashinaka, Mikio Nakano, and Kiyoaki Aikawa. Corpus-based discourse understanding in spoken dialogue systems. In ACL, pages 240-247, 2003.","title":"Corpus-based discourse understanding in spoken dialogue systems","authors":"Ryuichiro Higashinaka, Mikio Nakano, Kiyoaki Aikawa","year":"2003","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Kamp and Reyle, 1993] Hans Kamp and Uwe Reyle. From Dis- course to Logic: Introduction to Model-theoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory. Studies in Linguistics and Philosophy. Springer, 1993.","title":"From Discourse to Logic: Introduction to Model-theoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory","authors":"Reyle Kamp, Hans Kamp, Uwe Reyle","year":"1993","venue":"Studies in Linguistics and Philosophy","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Kate et al., 2005] Rohit J Kate, Yuk Wah Wong, and Raymond J Mooney. Learning to transform natural to formal languages. In Proceedings of the National Conference on Artificial Intelli- gence, volume 20, page 1062, 2005.","title":"Learning to transform natural to formal languages","authors":"Yuk Wah Rohit J Kate, Raymond J Wong, Mooney","year":"2005","venue":"Proceedings of the National Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Krishnamurthy and Kollar, 2013] Jayant Krishnamurthy and Thomas Kollar. Jointly learning to parse and perceive: Con- necting natural language to the physical world. Transactions of Association for Computational Linguistics, 2013.","title":"Jointly learning to parse and perceive: Connecting natural language to the physical world","authors":"Kollar Krishnamurthy, Jayant Krishnamurthy, Thomas Kollar","year":"2013","venue":"Transactions of Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Krishnamurthy and Mitchell, 2012] Jayant Krishnamurthy and Tom M Mitchell. Weakly supervised training of semantic parsers. In EMNLP-CoNLL, pages 754-765, 2012.","title":"Weakly supervised training of semantic parsers","authors":"Jayant Krishnamurthy, Tom M Mitchell","year":"2012","venue":"EMNLP-CoNLL","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Krishnamurthy, 2016] Jayant Krishnamurthy. Probabilistic mod- els for learning a semantic parser lexicon. In NAACL-HLT, pages 606-616, 2016.","title":"Probabilistic models for learning a semantic parser lexicon","authors":"Jayant Krishnamurthy","year":"2016","venue":"NAACL-HLT","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Kwiatkowski et al., 2010] Tom Kwiatkowski, Luke Zettlemoyer, Sharon Goldwater, and Mark Steedman. Inducing probabilistic ccg grammars from logical form with higher-order unification. In EMNLP, pages 1223-1233, 2010.","title":"Inducing probabilistic ccg grammars from logical form with higher-order unification","authors":"Kwiatkowski","year":"2010","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Kwiatkowski et al., 2013] Tom Kwiatkowski, Eunsol Choi, Yoav Artzi, and Luke S Zettlemoyer. Scaling semantic parsers with on-the-fly ontology matching. In ACL, 2013.","title":"Scaling semantic parsers with on-the-fly ontology matching","authors":"Kwiatkowski","year":"2013","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Larsson and Traum, 2000] Staffan Larsson and David R. Traum. Information state and dialogue management in the trindi dia- logue move engine toolkit. Nat. Lang. Eng., pages 323-340, 2000.","title":"Information state and dialogue management in the trindi dialogue move engine toolkit","authors":"Traum Larsson, Staffan Larsson, David R Traum","year":"2000","venue":"Nat. Lang. Eng","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Liang et al., 2013] Percy Liang, Michael I Jordan, and Dan Klein. Learning dependency-based compositional semantics. Computational Linguistics, 39:389-446, 2013.","title":"Learning dependency-based compositional semantics","authors":"Percy Liang, Michael I Jordan, Dan Klein","year":"2013","venue":"Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Matuszek et al., 2012] Cynthia Matuszek, Nicholas FitzGerald, Luke Zettlemoyer, Liefeng Bo, and Dieter Fox. A joint model of language and perception for grounded attribute learning. arXiv preprint arXiv:1206.6423, 2012.","title":"A joint model of language and perception for grounded attribute learning","authors":"Cynthia Matuszek, Nicholas Fitzgerald, Luke Zettlemoyer, Liefeng Bo, Dieter Fox","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Pasupat and Liang, 2015] Panupong Pasupat and Percy Liang. Compositional semantic parsing on semi-structured tables. arXiv preprint arXiv:1508.00305, 2015.","title":"Panupong Pasupat and Percy Liang. Compositional semantic parsing on semi-structured tables","authors":"Liang Pasupat","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Pichotta and Mooney, 2015] Karl Pichotta and Raymond J Mooney. Learning statistical scripts with LSTM recurrent neu- ral networks. In AAAI, 2015.","title":"Learning statistical scripts with LSTM recurrent neural networks","authors":"Mooney Pichotta, Karl Pichotta, Raymond J Mooney","year":"2015","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Schank and Abelson, 1977] Roger C Schank and Robert P Abel- son. Scripts, plans, goals and understanding: an inquiry into human knowledge structures. Erlbaum, 1977.","title":"Scripts, plans, goals and understanding: an inquiry into human knowledge structures","authors":"C Roger, Robert P Schank, Abelson","year":"1977","venue":null,"doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Searle, 1969] John R. Searle. Speech Acts: An Essay in the Phi- losophy of Language. Cambridge University Press, 1969.","title":"Speech Acts: An Essay in the Philosophy of Language","authors":"John R Searle","year":"1969","venue":null,"doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Srivastava et al., 2013] Shashank Srivastava, Dirk Hovy, and Ed- uard H Hovy. A walk-based semantically enriched tree kernel over distributed word representations. In EMNLP, 2013.","title":"A walk-based semantically enriched tree kernel over distributed word representations","authors":"Shashank Srivastava, Dirk Hovy, Eduard H Hovy","year":"2013","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Steedman and Baldridge, 2011] Mark Steedman and Jason Baldridge. Combinatory categorial grammar, 2011.","title":"Combinatory categorial grammar","authors":"Mark Steedman, Jason Baldridge","year":"2011","venue":null,"doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Van Dijk, 1980] Teun Adrianus Van Dijk. Text and context: Ex- plorations in the semantics and pragmatics of discourse. Nordic Journal of Linguistics, 2, 1980.","title":"Text and context: Explorations in the semantics and pragmatics of discourse","authors":"; Van Dijk, Adrianus Teun, Van Dijk","year":"1980","venue":"Nordic Journal of Linguistics","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Wang et al., 2015] Yushi Wang, Jonathan Berant, and Percy Liang. Building a semantic parser overnight. In ACL, 2015.","title":"Building a semantic parser overnight","authors":"Yushi Wang, Jonathan Berant, Percy Liang","year":"2015","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Williams et al., 2013] Jason Williams, Antoine Raux, Deepak Ramachandran, and Alan Black. The dialog state tracking chal- lenge. In SIGDIAL, pages 404-413, 2013.","title":"The dialog state tracking challenge","authors":"Jason Williams, Antoine Raux, Deepak Ramachandran, Alan Black","year":"2013","venue":"SIGDIAL","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Wong and Mooney, 2007] Yuk Wah Wong and Raymond J Mooney. Learning synchronous grammars for semantic pars- ing with lambda calculus. In ACL, volume 45, page 960, 2007.","title":"Learning synchronous grammars for semantic parsing with lambda calculus","authors":"Mooney ; ] Wong, Wah Yuk, Raymond J Wong, Mooney","year":"2007","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Zelle and Mooney, 1996] John M Zelle and Raymond J Mooney. Learning to parse database queries using inductive logic pro- gramming. In Proceedings of the national conference on artifi- cial intelligence, pages 1050-1055, 1996.","title":"Learning to parse database queries using inductive logic programming","authors":"M John, Raymond J Zelle, Mooney","year":"1996","venue":"Proceedings of the national conference on artificial intelligence","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Zettlemoyer and Collins, 2005] Luke S. Zettlemoyer and Michael Collins. Learning to map sentences to logical form: Structured classification with probabilistic categorial grammars. In UAI '05, pages 658-666, 2005.","title":"Learning to map sentences to logical form: Structured classification with probabilistic categorial grammars","authors":"Collins Zettlemoyer, Luke S Zettlemoyer, Michael Collins","year":"2005","venue":"UAI '05","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Zettlemoyer and Collins, 2007] Luke S Zettlemoyer and Michael Collins. Online learning of relaxed ccg grammars for parsing to logical form. In EMNLP-CoNLL, pages 678-687, 2007.","title":"Online learning of relaxed ccg grammars for parsing to logical form","authors":"Collins ; Zettlemoyer, S Luke, Michael Zettlemoyer, Collins","year":"2007","venue":"EMNLP-CoNLL","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Zettlemoyer and Collins, 2009] Luke S. Zettlemoyer and Michael Collins. Learning context-dependent mappings from sentences to logical form. In EMNLP-AFNLP, ACL '09, pages 976-984, 2009.","title":"Learning context-dependent mappings from sentences to logical form","authors":"Collins Zettlemoyer, Luke S Zettlemoyer, Michael Collins","year":"2009","venue":"EMNLP-AFNLP, ACL '09","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}