{"type":"ScholarlyArticle","title":"Teaching Machines to Ask Questions","authors":[{"name":"Kaichun Yao","slug":"kaichun-yao","given":"Kaichun","family":"Yao","affiliation":"University of the Chinese Academy of Sciences"},{"name":"Libo Zhang","slug":"libo-zhang","given":"Libo","family":"Zhang","affiliation":"Institute of Software Chinese Academy of Sciences"},{"name":"Tiejian Luo","slug":"tiejian-luo","given":"Tiejian","family":"Luo","affiliation":"University of the Chinese Academy of Sciences"},{"name":"Lili Tao","slug":"lili-tao","given":"Lili","family":"Tao","affiliation":"University of the West of England"},{"name":"Yanjun Wu","slug":"yanjun-wu","given":"Yanjun","family":"Wu","affiliation":"Institute of Software Chinese Academy of Sciences"}],"abstract":"We propose a novel neural network model that aims to generate diverse and human-like natural language questions. Our model not only directly captures the variability in possible questions by using a latent variable, but also generates certain types of questions by introducing an additional observed variable. We deploy our model in the generative adversarial network (GAN) framework and modify the discriminator which not only allows evaluating the question authenticity, but predicts the question type. Our model is trained and evaluated on a question-answering dataset SQuAD, and the experimental results shown the proposed model is able to generate diverse and readable questions with the specific attribute.","doi":"10.24963/ijcai.2018/632","url":"https://ijcai.org/proceedings/2018/632","pdf":"https://ijcai.org/proceedings/2018/0632.pdf","markdown":"https://ijcai.org/proceedings/2018/632.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/632","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Natural Language Processing","track":"Main track","number":632,"pages":{"first":4546,"last":4552},"keywords":["Natural Language Processing: Question Answering","Natural Language Processing: Natural Language Generation","Machine Learning: Deep Learning","Natural Language Processing: Natural Language Processing"],"videos":[],"references":[{"position":1,"raw":"[Bahdanau et al., 2014] Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. Neural machine transla- tion by jointly learning to align and translate. CoRR, abs/1409.0473, 2014.","title":"Neural machine translation by jointly learning to align and translate","authors":"Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bowman et al., 2016] Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, Andrew M. Dai, Rafal Józefowicz, and Samy Bengio. Generating sentences from a continuous space. In SIGNLL, pages 10-21, 2016.","title":"Generating sentences from a continuous space","authors":"R Samuel, Luke Bowman, Oriol Vilnis, Andrew M Vinyals, Rafal Dai, Samy Józefowicz, Bengio","year":"2016","venue":"SIGNLL","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chali and Hasan, 2015] Yllias Chali and Sadid A. Hasan. Towards topic-to-question generation. Computational Lin- guistics, 41(1):1-20, 2015.","title":"Yllias Chali and Sadid A. Hasan. Towards topic-to-question generation","authors":"Hasan Chali","year":"2015","venue":"Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen et al., 2015] Xinlei Chen, Hao Fang, Tsung-Yi Lin, Ramakrishna Vedantam, Saurabh Gupta, Piotr Dollár, and C. Lawrence Zitnick. Microsoft COCO captions: Data collection and evaluation server. CoRR, 2015.","title":"Microsoft COCO captions: Data collection and evaluation server","authors":"Xinlei Chen, Hao Fang, Tsung-Yi Lin, Ramakrishna Vedantam, Saurabh Gupta, Piotr Dollár, C Lawrence Zitnick","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cho et al., 2014] Kyunghyun Cho, Bart van Merrienboer, C ¸aglar Gülc ¸ehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In EMNLP, pages 1724-1734, 2014.","title":"Learning phrase representations using RNN encoder-decoder for statistical machine translation","authors":"Cho","year":"2014","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Colby et al., 1971] Kenneth Mark Colby, Sylvia Weber, and Franklin Dennis Hilf. Artificial paranoia. Artif. Intell., 2(1):1-25, 1971.","title":"Artificial paranoia","authors":"Kenneth Mark, Colby, Sylvia Weber, Franklin Dennis Hilf","year":"1971","venue":"Artif. Intell","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Du et al., 2017] Xinya Du, Junru Shao, and Claire Cardie. Learning to ask: Neural question generation for reading comprehension. In ACL, pages 1342-1352, 2017.","title":"Learning to ask: Neural question generation for reading comprehension","authors":"Du","year":"2017","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Goodfellow et al., 2014] Ian J. Goodfellow, Jean Pouget- Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron C. Courville, and Yoshua Bengio. Generative adversarial nets. In NIPS, 2014.","title":"Generative adversarial nets","authors":"Ian J Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron C Courville, Yoshua Bengio","year":"2014","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Graves, 2013] Alex Graves. Generating sequences with re- current neural networks. CoRR, 2013.","title":"Generating sequences with recurrent neural networks","authors":"Alex Graves","year":"2013","venue":"CoRR","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Heilman and Smith, 2010] Michael Heilman and Noah A. Smith. Good question! statistical ranking for question generation. In NAACL, pages 609-617, 2010.","title":"Good question! statistical ranking for question generation","authors":"Smith ; Heilman, Michael Heilman, Noah A Smith","year":"2010","venue":"NAACL","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Heilman, 2011] Michael Heilman. Automatic factual ques- tion generation from text. Carnegie Mellon University, 2011.","title":"Automatic factual question generation from text","authors":"Michael Heilman","year":"2011","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Hochreiter and Schmidhuber, 1997] Sepp Hochreiter and Jurgen Schmidhuber. Long short-term memory. Neural Computation, 9(8):1735-1780, 1997.","title":"Long short-term memory","authors":"Schmidhuber Hochreiter, Sepp Hochreiter, Jurgen Schmidhuber","year":"1997","venue":"Neural Computation","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Hu et al., 2017] Zhiting Hu, Zichao Yang, Xiaodan Liang, Ruslan Salakhutdinov, and Eric P. Xing. Controllable text generation. CoRR, abs/1703.00955, 2017.","title":"Controllable text generation","authors":"Zhiting Hu, Zichao Yang, Xiaodan Liang, Ruslan Salakhutdinov, Eric P Xing","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Kingma and Welling, 2013] Diederik P. Kingma and Max Welling. Auto-encoding variational bayes. CoRR, abs/1312.6114, 2013.","title":"Auto-encoding variational bayes","authors":"P Diederik, Max Kingma, Welling","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Li et al., 2017a] Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc'Aurelio Ranzato, and Jason Weston. Learn- ing through dialogue interactions by asking questions. 2017.","title":"Learning through dialogue interactions by asking questions","authors":"Li","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Li et al., 2017b] Jiwei Li, Will Monroe, Tianlin Shi, Sébastien Jean, Alan Ritter, and Dan Jurafsky. Adversarial learning for neural dialogue generation. In EMNLP, 2017.","title":"Adversarial learning for neural dialogue generation","authors":"Li","year":"2017","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Luong et al., 2015] Thang Luong, Hieu Pham, and Christo- pher D. Manning. Effective approaches to attention-based neural machine translation. In EMNLP, 2015.","title":"Effective approaches to attention-based neural machine translation","authors":"Thang Luong, Hieu Pham, Christopher D Manning","year":"2015","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Odena et al., 2017] Augustus Odena, Christopher Olah, and Jonathon Shlens. Conditional image synthesis with auxil- iary classifier gans. In ICML, pages 2642-2651, 2017.","title":"Conditional image synthesis with auxiliary classifier gans","authors":"Odena","year":"2017","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Pennington et al., 2014] Jeffrey Pennington, Richard Socher, and Christopher D. Manning. Glove: Global vectors for word representation. In EMNLP, pages 1532-1543, 2014.","title":"Glove: Global vectors for word representation","authors":"Jeffrey Pennington, Richard Socher, Christopher D Manning","year":"2014","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Rajpurkar et al., 2016] Pranav Rajpurkar, Jian Zhang, Kon- stantin Lopyrev, and Percy Liang. Squad: 100, 000+ ques- tions for machine comprehension of text. In EMNLP, pages 2383-2392, 2016.","title":"Squad: 100, 000+ questions for machine comprehension of text","authors":"Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, Percy Liang","year":"2016","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Rezende et al., 2014] Danilo Jimenez Rezende, Shakir Mo- hamed, and Daan Wierstra. Stochastic backpropagation and approximate inference in deep generative models. In ICML, pages 1278-1286, 2014.","title":"Stochastic backpropagation and approximate inference in deep generative models","authors":"Danilo Jimenez Rezende, Shakir Mohamed, Daan Wierstra","year":"2014","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Schuster and Paliwal, 1997] Mike Schuster and Kuldip K. Paliwal. Bidirectional recurrent neural networks. IEEE Trans. Signal Processing, 45(11):2673-2681, 1997.","title":"Bidirectional recurrent neural networks","authors":"Mike Schuster, Kuldip K Paliwal","year":"1997","venue":"IEEE Trans. Signal Processing","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[See et al., 2017] Abigail See, Peter J. Liu, and Christo- pher D. Manning. Get to the point: Summarization with pointer-generator networks. In ACL, 2017.","title":"Get to the point: Summarization with pointer-generator networks","authors":"Abigail See, Peter J Liu, Christopher D Manning","year":"2017","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Serban et al., 2016] Iulian Vlad Serban, Alberto García- Durán, C ¸aglar Gülc ¸ehre, Sungjin Ahn, Sarath Chandar, Aaron C. Courville, and Yoshua Bengio. Generating fac- toid questions with recurrent neural networks: The 30m factoid question-answer corpus. In ACL, 2016.","title":"Generating factoid questions with recurrent neural networks: The 30m factoid question-answer corpus","authors":"Iulian Vlad Serban, Alberto García-Durán, C ¸aglar Gülc ¸ehre, Sungjin Ahn, Sarath Chandar, Aaron C Courville, Yoshua Bengio","year":"2016","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Sohn et al., 2015] Kihyuk Sohn, Honglak Lee, and Xinchen Yan. Learning structured output representation using deep conditional generative models. In NIPS, 2015.","title":"Learning structured output representation using deep conditional generative models","authors":"Sohn","year":"2015","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Sutton et al., 1999] Richard S. Sutton, David A. McAllester, Satinder P. Singh, and Yishay Mansour. Policy gradient methods for reinforcement learning with function approximation. In NIPS, 1999.","title":"Policy gradient methods for reinforcement learning with function approximation","authors":"Richard S Sutton, David A Mcallester, P Satinder, Yishay Singh, Mansour","year":"1999","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Yu et al., 2016] Lantao Yu, Weinan Zhang, Jun Wang, and Yong Yu. Seqgan: Sequence generative adversarial nets with policy gradient. 2016.","title":"Seqgan: Sequence generative adversarial nets with policy gradient","authors":"Lantao Yu, Weinan Zhang, Jun Wang, Yong Yu","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Yuan et al., 2017] Xingdi Yuan, Tong Wang, C ¸aglar Gülc ¸ehre, Alessandro Sordoni, Philip Bachman, Saizheng Zhang, Sandeep Subramanian, and Adam Trischler. Machine comprehension by text-to-text neural question generation. In Proceedings of the 2nd Workshop on Representation Learning for NLP, pages 15-25, 2017.","title":"Machine comprehension by text-to-text neural question generation","authors":"Yuan","year":"2017","venue":"Proceedings of the 2nd Workshop on Representation Learning for NLP","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Zhao et al., 2017] Tiancheng Zhao, Ran Zhao, and Maxine Eskénazi. Learning discourse-level diversity for neural di- alog models using conditional variational autoencoders. In ACL, pages 654-664, 2017.","title":"Learning discourse-level diversity for neural dialog models using conditional variational autoencoders","authors":"Zhao","year":"2017","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Zhou et al., 2017] Qingyu Zhou, Nan Yang, Furu Wei, Chuanqi Tan, Hangbo Bao, and Ming Zhou. Neural ques- tion generation from text: A preliminary study. In NLPCC, pages 662-671, 2017.","title":"Neural question generation from text: A preliminary study","authors":"Qingyu Zhou, Nan Yang, Furu Wei, Chuanqi Tan, Hangbo Bao, Ming Zhou","year":"2017","venue":"NLPCC","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}