{"type":"ScholarlyArticle","title":"Smarter Response with Proactive Suggestion: A New Generative Neural Conversation Paradigm","authors":[{"name":"Rui Yan","slug":"rui-yan","given":"Rui","family":"Yan","affiliation":"Institute of Computer Science and Technology (ICST) , Peking University; Beijing Institute of Big Data Research"},{"name":"Dongyan Zhao","slug":"dongyan-zhao","given":"Dongyan","family":"Zhao","affiliation":"Institute of Computer Science and Technology (ICST) , Peking University; Beijing Institute of Big Data Research"}],"abstract":"Conversational systems are becoming more and more promising by playing an important role in human-computer communications. A conversational system is supposed to be intelligent to enable human-like interactions. The long-term goal of smart human-computer conversations is challenging and heavily driven by data. Thanks to the prosperity of Web 2.0, a large volume of conversational data become available to establish human-computer conversational systems. Given a human issued message, namely a query, a traditional conversational system would provide a response after proper training of how to respond like humans. In this paper, we propose a new paradigm for neural generative conversations: smarter response with a suggestion is provided given the query. We assume that the new conversation mode which proactively introduces contents as next utterances, keeping user actively engaged. To address the task, we propose a novel integrated model to handle both the response generation and the suggestion generation. From the experimental results, we verify the effectiveness of the new neural generative conversation paradigm.","doi":"10.24963/ijcai.2018/629","url":"https://ijcai.org/proceedings/2018/629","pdf":"https://ijcai.org/proceedings/2018/0629.pdf","markdown":"https://ijcai.org/proceedings/2018/629.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/629","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Natural Language Processing","track":"Main track","number":629,"pages":{"first":4525,"last":4531},"keywords":["Natural Language Processing: Natural Language Generation","Natural Language Processing: Dialogue"],"videos":[],"references":[{"position":1,"raw":"[Arevalo et al., 2017] John Arevalo, Thamar Solorio, and et al. Gated multimodal units for information fusion. arXiv preprint arXiv:1702.01992, 2017.","title":"Gated multimodal units for information fusion","authors":"Arevalo","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Gu et al., 2016] Jiatao Gu, Zhengdong Lu, Hang Li, and Victor OK Li. Incorporating copying mechanism in sequence-to-sequence learning. pages 1631-1640, 2016.","title":"Incorporating copying mechanism in sequence-to-sequence learning","authors":"Gu","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Hu et al., 2014] Baotian Hu, Zhengdong Lu, Hang Li, and Qingcai Chen. Convolutional neural network architectures for matching natural language sentences. In NIPS, pages 2042-2050, 2014.","title":"Convolutional neural network architectures for matching natural language sentences","authors":"Baotian Hu, Zhengdong Lu, Hang Li, Qingcai Chen","year":"2014","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Ji et al., 2014] Zongcheng Ji, Zhengdong Lu, and Hang Li. An information retrieval approach to short text conversa- tion. CoRR, abs/1408.6988, 2014.","title":"An information retrieval approach to short text conversation","authors":"Ji","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Li and Xu, 2014] Hang Li and Jun Xu. Semantic matching in search. Foundations and Trends in Information Re- trieval, 8:89, 2014.","title":"Semantic matching in search","authors":"Li, Xu, Hang Li, Jun Xu","year":"2014","venue":"Foundations and Trends in Information Retrieval","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Li et al., 2016a] Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. A diversity-promoting objective function for neural conversation models. In NAACL'16, pages 110-119, 2016.","title":"A diversity-promoting objective function for neural conversation models","authors":"Li","year":"2016","venue":"NAACL'16","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Li et al., 2016b] Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. A persona-based neural conversation model. In ACL'16, pages 994-1003, 2016.","title":"A persona-based neural conversation model","authors":"Li","year":"2016","venue":"ACL'16","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Li et al., 2016c] Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, and Dan Jurafsky. Deep reinforce- ment learning for dialogue generation. In EMNLP'16, pages 1192-1202, 2016.","title":"Deep reinforcement learning for dialogue generation","authors":"Li","year":"2016","venue":"EMNLP'16","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Li et al., 2016d] Xiang Li, Lili Mou, Rui Yan, and Ming Zhang. Stalematebreaker: A proactive content-introducing approach to automatic human-computer conversation. In IJCAI'16, pages 2845-2851, 2016.","title":"Stalematebreaker: A proactive content-introducing approach to automatic human-computer conversation","authors":"Li","year":"2016","venue":"IJCAI'16","doi":null,"url":null,"internal_url":"/proceedings/2016/404"},{"position":10,"raw":"[Li et al., 2017] Jiwei Li, Will Monroe, Tianlin Shi, Alan Ritter, and Dan Jurafsky. Adversarial learning for neural dialogue generation. In EMNLP'17, pages 2157-2169, 2017.","title":"Adversarial learning for neural dialogue generation","authors":"Jiwei Li, Will Monroe, Tianlin Shi, Alan Ritter, Dan Jurafsky","year":"2017","venue":"EMNLP'17","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Libovickỳ and Helcl, 2017] Jindřich Libovickỳ and Jindřich Helcl. Attention strategies for multi-source sequence-to-sequence learning. In ACL'17, pages 196-202, 2017.","title":"Attention strategies for multi-source sequence-to-sequence learning","authors":"Helcl Libovickỳ, Jindřich Libovickỳ, Jindřich Helcl","year":"2017","venue":"ACL'17","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Lu and Li, 2013] Zhengdong Lu and Hang Li. A deep architecture for matching short texts. In NIPS, pages 1367-1375, 2013.","title":"A deep architecture for matching short texts","authors":"Li ; Lu, Zhengdong Lu, Hang Li","year":"2013","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Mou et al., 2016] Lili Mou, Yiping Song, Rui Yan, Ge Li, Lu Zhang, and Zhi Jin. Sequence to backward and forward sequences: A content-introducing approach to generative short-text conversation. In COLING'16, pages 3349- 3358, 2016.","title":"Sequence to backward and forward sequences: A content-introducing approach to generative short-text conversation","authors":"Lili Mou, Yiping Song, Rui Yan, Ge Li, Lu Zhang, Zhi Jin","year":"2016","venue":"COLING'16","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Palangi et al., 2015] Hamid Palangi, Li Deng, and et al. Deep sentence embedding using the long short term mem- ory network: Analysis and application to information retrieval. arXiv:1502.06922, 2015.","title":"Deep sentence embedding using the long short term memory network: Analysis and application to information retrieval","authors":"Hamid Palangi, Li Deng","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Serban et al., 2016] Iulian V Serban, Alessandro Sordoni, Yoshua Bengio, Aaron Courville, and Joelle Pineau. Building end-to-end dialogue systems using generative hierarchical neural network models. In AAAI'16, pages 3776-3783, 2016.","title":"Building end-to-end dialogue systems using generative hierarchical neural network models","authors":"Alessandro Iulian V Serban, Yoshua Sordoni, Aaron Bengio, Joelle Courville, Pineau","year":"2016","venue":"AAAI'16","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Shang et al., 2015] Lifeng Shang, Zhengdong Lu, and Hang Li. Neural responding machine for short-text conversation. In ACL-IJCNLP'15, pages 1577-1586, 2015.","title":"Neural responding machine for short-text conversation","authors":"Lifeng Shang, Zhengdong Lu, Hang Li","year":"2015","venue":"ACL-IJCNLP'15","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Song et al., 2018] Yiping Song, Rui Yan, Yansong Feng, Yaoyuan Zhang, Dongyan Zhao, and Ming Zhang. To- wards a neural conversation model with diversity net using determinantal point processes. In AAAI'18, 2018.","title":"Towards a neural conversation model with diversity net using determinantal point processes","authors":"Yiping Song, Rui Yan, Yansong Feng, Yaoyuan Zhang, Dongyan Zhao, Ming Zhang","year":"2018","venue":"AAAI'18","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Sordoni et al., 2015] Alessandro Sordoni, Michel Galley, and et al. A neural network approach to context-sensitive generation of conversational responses. In NAACL'15, pages 196-205, 2015.","title":"A neural network approach to context-sensitive generation of conversational responses","authors":"Alessandro Sordoni, Michel Galley","year":"2015","venue":"NAACL'15","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Sutskever et al., 2014] Ilya Sutskever, Oriol Vinyals, and Quoc VV Le. Sequence to sequence learning with neural networks. In NIPS, pages 3104-3112, 2014.","title":"Le. Sequence to sequence learning with neural networks","authors":"Sutskever","year":"2014","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Tao et al., 2018] Chongyang Tao, Lili Mou, Dongyan Zhao, and Rui Yan. Ruber: An unsupervised method for automatic evaluation of open-domain dialog systems. In AAAI'18, 2018.","title":"Ruber: An unsupervised method for automatic evaluation of open-domain dialog systems","authors":"Tao","year":"2018","venue":"AAAI'18","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Tian et al., 2017] Zhiliang Tian, Rui Yan, Lili Mou, Yiping Song, Yansong Feng, and Dongyan Zhao. How to make contexts more useful? an empirical study to context-aware neural conversation models. In ACL'17, pages 231-236, 2017.","title":"How to make contexts more useful? an empirical study to context-aware neural conversation models","authors":"Zhiliang Tian, Rui Yan, Lili Mou, Yiping Song, Yansong Feng, Dongyan Zhao","year":"2017","venue":"ACL'17","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Walker et al., 2001] Marilyn A. Walker, Rebecca Passon- neau, and Julie E. Boland. Quantitative and qualitative evaluation of darpa communicator spoken dialogue sys- tems. In ACL, pages 515-522, 2001.","title":"Quantitative and qualitative evaluation of darpa communicator spoken dialogue systems","authors":"Marilyn A Walker, Rebecca Passonneau, Julie E Boland","year":"2001","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Wan et al., 2016] Shengxian Wan, Yanyan Lan, Jiafeng Guo, Jun Xu, Liang Pang, and Xueqi Cheng. A deep ar- chitecture for semantic matching with multiple positional sentence representations. In AAAI'16, pages 2835-2841, 2016.","title":"A deep architecture for semantic matching with multiple positional sentence representations","authors":"Shengxian Wan, Yanyan Lan, Jiafeng Guo, Jun Xu, Liang Pang, Xueqi Cheng","year":"2016","venue":"AAAI'16","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Wang et al., 2013] Hao Wang, Zhengdong Lu, Hang Li, and Enhong Chen. A dataset for research on short-text conversations. In EMNLP'13, pages 935-945, 2013.","title":"A dataset for research on short-text conversations","authors":"Hao Wang, Zhengdong Lu, Hang Li, Enhong Chen","year":"2013","venue":"EMNLP'13","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Williams et al., 2013] Jason Williams, Antoine Raux, Deepak Ramachandran, and Alan Black. The dialog state tracking challenge. In SIGDIAL, pages 404-413, 2013.","title":"The dialog state tracking challenge","authors":"Jason Williams, Antoine Raux, Deepak Ramachandran, Alan Black","year":"2013","venue":"SIGDIAL","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Xing et al., 2016] Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, and Wei-Ying Ma. Topic aug- mented neural response generation with a joint attention mechanism. arXiv preprint arXiv:1606.08340, 2016.","title":"Topic augmented neural response generation with a joint attention mechanism","authors":"Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, Wei-Ying Ma","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Yan et al., 2016a] Rui Yan, Yiping Song, and Hua Wu. Learning to respond with deep neural networks for retrieval-based human-computer conversation system. In SIGIR'16, pages 55-64, 2016.","title":"Learning to respond with deep neural networks for retrieval-based human-computer conversation system","authors":"Yan","year":"2016","venue":"SIGIR'16","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Yan et al., 2016b] Rui Yan, Yiping Song, Xiangyang Zhou, and Hua Wu. Shall i be your chat companion?: Towards an online human-computer conversation system. In CIK- M'16, pages 649-658, 2016.","title":"Shall i be your chat companion?: Towards an online human-computer conversation system","authors":"Yan","year":"2016","venue":"CIK-M'16","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Yan et al., 2017] Rui Yan, Dongyan Zhao, and Weinan E. Joint learning of response ranking and next utterance suggestion in human-computer conversation system. In SIGIR'17, pages 685-694, 2017.","title":"Joint learning of response ranking and next utterance suggestion in human-computer conversation system","authors":"Rui Yan, Dongyan Zhao, Weinan E","year":"2017","venue":"SIGIR'17","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Yao et al., 2017] Lili Yao, Yaoyuan Zhang, Yansong Feng, Dongyan Zhao, and Rui Yan. Towards implicit content- introducing for generative short-text conversation systems. In EMNLP'17, pages 2190-2199, 2017.","title":"Towards implicit contentintroducing for generative short-text conversation systems","authors":"Lili Yao, Yaoyuan Zhang, Yansong Feng, Dongyan Zhao, Rui Yan","year":"2017","venue":"EMNLP'17","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Yoshino and Kawahara, 2015] Koichiro Yoshino and Tat- suya Kawahara. News navigation system based on proac- tive dialogue strategy. In Natural Language Dialog Sys- tems and Intelligent Assistants, pages 15-25. 2015.","title":"News navigation system based on proactive dialogue strategy","authors":"Kawahara ; Suya Yoshino, Kawahara","year":"2015","venue":"Natural Language Dialog Systems and Intelligent Assistants","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Zhou et al., 2016] Xiangyang Zhou, Daxiang Dong, Hua Wu, Shiqi Zhao, Dianhai Yu, Hao Tian, Xuan Liu, and Rui Yan. Multi-view response selection for human-computer conversation. In EMNLP'16, pages 372-381, 2016.","title":"Multi-view response selection for human-computer conversation","authors":"Zhou","year":"2016","venue":"EMNLP'16","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Zoph and Knight, 2016] Barret Zoph and Kevin Knight. Multi-source neural translation. In NAACL'16, pages 30- 34, 2016.","title":"Multi-source neural translation","authors":"Knight Zoph, Barret Zoph, Kevin Knight","year":"2016","venue":"NAACL'16","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}