{"type":"ScholarlyArticle","title":"Adversarial Oracular Seq2seq Learning for Sequential Recommendation","authors":[{"name":"Pengyu Zhao","slug":"pengyu-zhao","given":"Pengyu","family":"Zhao","affiliation":"School of EECS , Peking University , Beijing , China"},{"name":"Tianxiao Shui","slug":"tianxiao-shui","given":"Tianxiao","family":"Shui","affiliation":"School of EECS , Peking University , Beijing , China"},{"name":"Yuanxing Zhang","slug":"yuanxing-zhang","given":"Yuanxing","family":"Zhang","affiliation":"School of EECS , Peking University , Beijing , China"},{"name":"Kecheng Xiao","slug":"kecheng-xiao","given":"Kecheng","family":"Xiao","affiliation":"School of EECS , Peking University , Beijing , China"},{"name":"Kaigui Bian","slug":"kaigui-bian","given":"Kaigui","family":"Bian","affiliation":"School of EECS , Peking University , Beijing , China"}],"abstract":"Recently, sequential recommendation has become a significant demand for many real-world applications, where the recommended items would be displayed to users one after another and the order of the displays influences the satisfaction of users. An extensive number of models have been developed for sequential recommendation by recommending the next items with the highest scores based on the user histories while few efforts have been made on identifying the transition dependency and behavior continuity in the recommended sequences. In this paper, we introduce the Adversarial Oracular Seq2seq learning for sequential Recommendation (AOS4Rec), which formulates the sequential recommendation as a seq2seq learning problem to portray time-varying interactions in the recommendation, and exploits the oracular learning and adversarial learning to enhance the recommendation quality. We examine the performance of AOS4Rec over RNN-based and Transformer-based recommender systems on two large datasets from real-world applications and make comparisons with state-of-the-art methods. Results indicate the accuracy and efficiency of AOS4Rec, and further analysis verifies that AOS4Rec has both robustness and practicability for real-world scenarios.","doi":"10.24963/ijcai.2020/264","url":"https://ijcai.org/proceedings/2020/264","pdf":"https://ijcai.org/proceedings/2020/0264.pdf","markdown":"https://ijcai.org/proceedings/2020/264.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/264","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Knowledge Representation and Reasoning","track":"Main track","number":264,"pages":{"first":1905,"last":1911},"keywords":["Multidisciplinary Topics and Applications: Recommender Systems","Machine Learning: Recommender Systems","Knowledge Representation and Reasoning: Preference Modelling and Preference-Based Reasoning"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/24624/file_24624.m3u8","length_sec":278,"provider":"hls"}],"references":[{"position":1,"raw":"[Arjovsky et al., 2017] Martin Arjovsky, Soumith Chintala, and Léon Bottou. Wasserstein generative adversarial net- works. In ICML, pages 214-223, 2017.","title":"Wasserstein generative adversarial networks","authors":"Arjovsky","year":"2017","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bharadhwaj et al., 2018] Homanga Bharadhwaj, Homin Park, and Brian Y Lim. Recgan: Recurrent generative ad- versarial networks for recommendation systems. In Rec- Sys, pages 372-376. ACM, 2018.","title":"Recgan: Recurrent generative adversarial networks for recommendation systems","authors":"Bharadhwaj","year":"2018","venue":"Rec-Sys","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Goodfellow et al., 2014] Ian Goodfellow, Jean Pouget- Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Gen- erative adversarial nets. In NIPS, pages 2672-2680, 2014.","title":"Generative adversarial nets","authors":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio","year":"2014","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Gumbel, 1948] Emil Julius Gumbel. Statistical theory of extreme values and some practical applications: a series of lectures, volume 33. US Government Printing Office, 1948.","title":"Statistical theory of extreme values and some practical applications: a series of lectures","authors":"Emil Julius Gumbel, Gumbel","year":"1948","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[He et al., 2018] Xiangnan He, Zhankui He, Xiaoyu Du, and Tat-Seng Chua. Adversarial personalized ranking for rec- ommendation. In SIGIR, pages 355-364. ACM, 2018.","title":"Adversarial personalized ranking for recommendation","authors":"He","year":"2018","venue":"SIGIR","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Hidasi and Karatzoglou, 2018] Balázs Hidasi and Alexan- dros Karatzoglou. Recurrent neural networks with top-k gains for session-based recommendations. In CIKM, pages 843-852. ACM, 2018.","title":"Balázs Hidasi and Alexandros Karatzoglou. Recurrent neural networks with top-k gains for session-based recommendations","authors":"Karatzoglou Hidasi","year":"2018","venue":"CIKM","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Kang and McAuley, 2018] Wang-Cheng Kang and Julian McAuley. Self-attentive sequential recommendation. In 2018 ICDM, pages 197-206. IEEE, 2018.","title":"Self-attentive sequential recommendation","authors":"Wang-Cheng Kang, Julian Mcauley","year":"2018","venue":"ICDM","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Konda and Tsitsiklis, 2000] Vijay R Konda and John N Tsitsiklis. Actor-critic algorithms. In NIPS, pages 1008- 1014, 2000.","title":"Actor-critic algorithms","authors":"R Vijay, John N Konda, Tsitsiklis","year":"2000","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Li et al., 2017a] Jing Li, Pengjie Ren, Zhumin Chen, Zhaochun Ren, Tao Lian, and Jun Ma. Neural atten- tive session-based recommendation. In Proceedings of the 2017 ACM CIKM, pages 1419-1428. ACM, 2017.","title":"Neural attentive session-based recommendation","authors":"Li","year":"2017","venue":"Proceedings of the 2017 ACM CIKM","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Li et al., 2017b] Jiwei Li, Will Monroe, Tianlin Shi, Sébastien Jean, Alan Ritter, and Dan Jurafsky. Adversarial learning for neural dialogue generation. In EMNLP, 2017.","title":"Adversarial learning for neural dialogue generation","authors":"Li","year":"2017","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Papineni et al., 2002] Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. Bleu: a method for automatic evaluation of machine translation. In ACL, pages 311-318. Association for Computational Linguis- tics, 2002.","title":"Bleu: a method for automatic evaluation of machine translation","authors":"Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu","year":"2002","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Ranzato et al., 2015] Marc'Aurelio Ranzato, Sumit Chopra, Michael Auli, and Wojciech Zaremba. Sequence level training with recurrent neural networks. arXiv preprint arXiv:1511.06732, 2015.","title":"Sequence level training with recurrent neural networks","authors":"Ranzato","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Ren et al., 2019] Pengjie Ren, Zhumin Chen, Jing Li, Zhaochun Ren, Jun Ma, and Maarten de Rijke. Repeat- net: A repeat aware neural recommendation machine for session-based recommendation. In Proceedings of the AAAI, volume 33, pages 4806-4813, 2019.","title":"Repeatnet: A repeat aware neural recommendation machine for session-based recommendation","authors":"Ren","year":"2019","venue":"Proceedings of the AAAI","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Rendle et al., 2009] Steffen Rendle, Christoph Freuden- thaler, Zeno Gantner, and Lars Schmidt-Thieme. Bpr: Bayesian personalized ranking from implicit feedback. In UAI, pages 452-461. AUAI Press, 2009.","title":"Bpr: Bayesian personalized ranking from implicit feedback","authors":"Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, Lars Schmidt-Thieme","year":"2009","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Sun and Qian, 2019] Ke Sun and Tieyun Qian. Seq2seq translation model for sequential recommendation. arXiv preprint arXiv:1912.07274, 2019.","title":"Seq2seq translation model for sequential recommendation","authors":"Qian ; Sun, Ke Sun, Tieyun Qian","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Sun et al., 2019] Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. Bert4rec: Sequen- tial recommendation with bidirectional encoder represen- tations from transformer. In CIKM, 2019.","title":"Bert4rec: Sequential recommendation with bidirectional encoder representations from transformer","authors":"Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, Peng Jiang","year":"2019","venue":"CIKM","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Sutskever et al., 2014] Ilya Sutskever, Oriol Vinyals, and Quoc V Le. Sequence to sequence learning with neural networks. In NIPS, pages 3104-3112, 2014.","title":"Quoc V Le. Sequence to sequence learning with neural networks","authors":"Sutskever","year":"2014","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Tang and Wang, 2018] Jiaxi Tang and Ke Wang. Person- alized top-n sequential recommendation via convolutional sequence embedding. In WSDM, pages 565-573. ACM, 2018.","title":"Personalized top-n sequential recommendation via convolutional sequence embedding","authors":"Wang ; ] Jiaxi Tang, Ke Tang, Wang","year":"2018","venue":"WSDM","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. In NIPS, pages 5998-6008, 2017.","title":"Attention is all you need","authors":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, Illia Polosukhin","year":"2017","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Wang et al., 2017] Jun Wang, Lantao Yu, Weinan Zhang, Yu Gong, Yinghui Xu, Benyou Wang, Peng Zhang, and Dell Zhang. Irgan: A minimax game for unifying gener- ative and discriminative information retrieval models. In SIGIR, pages 515-524. ACM, 2017.","title":"Irgan: A minimax game for unifying generative and discriminative information retrieval models","authors":"Jun Wang, Lantao Yu, Weinan Zhang, Yu Gong, Yinghui Xu, Benyou Wang, Peng Zhang, Dell Zhang","year":"2017","venue":"SIGIR","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Williams, 1992] Ronald J Williams. Simple statistical gradient-following algorithms for connectionist reinforce- ment learning. Machine learning, 8(3-4):229-256, 1992.","title":"Simple statistical gradient-following algorithms for connectionist reinforcement learning","authors":"Williams Ronald","year":"1992","venue":"Machine learning","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Wu et al., 2019] Qiong Wu, Yong Liu, Chunyan Miao, Bin- qiang Zhao, Yin Zhao, and Lu Guan. Pd-gan: adversarial learning for personalized diversity-promoting recommen- dation. In Proceedings of the 28th IJCAI, pages 3870- 3876. AAAI Press, 2019.","title":"Pd-gan: adversarial learning for personalized diversity-promoting recommendation","authors":"Qiong Wu, Yong Liu, Chunyan Miao, Binqiang Zhao, Yin Zhao, Lu Guan","year":"2019","venue":"Proceedings of the 28th IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2019/537"},{"position":23,"raw":"[Xu et al., 2019] Chengfeng Xu, Pengpeng Zhao, Yanchi Liu, Victor S Sheng, Jiajie Xu, Fuzhen Zhuang, Junhua Fang, and Xiaofang Zhou. Graph contextualized self- attention network for session-based recommendation. In Proc. 28th IJCAI, pages 3940-3946, 2019.","title":"Graph contextualized selfattention network for session-based recommendation","authors":"Xu","year":"2019","venue":"Proc. 28th IJCAI","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Yu et al., 2017] Lantao Yu, Weinan Zhang, Jun Wang, and Yong Yu. Seqgan: Sequence generative adversarial nets with policy gradient. In AAAI, 2017.","title":"Seqgan: Sequence generative adversarial nets with policy gradient","authors":"Lantao Yu, Weinan Zhang, Jun Wang, Yong Yu","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Yu et al., 2019] Lu Yu, Chuxu Zhang, Shangsong Liang, and Xiangliang Zhang. Multi-order attentive ranking model for sequential recommendation. In AAAI, 2019.","title":"Multi-order attentive ranking model for sequential recommendation","authors":"Lu Yu, Chuxu Zhang, Shangsong Liang, Xiangliang Zhang","year":"2019","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Zhang et al., 2019] Wen Zhang, Yang Feng, Fandong Meng, Di You, and Qun Liu. Bridging the gap between training and inference for neural machine translation. In ACL, 2019.","title":"Bridging the gap between training and inference for neural machine translation","authors":"Wen Zhang, Yang Feng, Fandong Meng, Di You, Qun Liu","year":"2019","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Zhang et al., 2020] Yuanxing Zhang, Pengyu Zhao, Yushuo Guan, Lin Chen, Kaigui Bian, Lingyang Song, Bin Cui, and Xiaoming Li. Preference-aware mask for session- based recommendation with bidirectional transformer. In Proceedings of ICASSP, pages 3412-3416, 2020.","title":"Preference-aware mask for sessionbased recommendation with bidirectional transformer","authors":"Yuanxing Zhang, Pengyu Zhao, Yushuo Guan, Lin Chen, Kaigui Bian, Lingyang Song, Bin Cui, Xiaoming Li","year":"2020","venue":"Proceedings of ICASSP","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Zhou et al., 2019] Fan Zhou, Ruiyang Yin, Kunpeng Zhang, Goce Trajcevski, Ting Zhong, and Jin Wu. Adversarial point-of-interest recommendation. In WWW, pages 3462- 34618. ACM, 2019.","title":"Adversarial point-of-interest recommendation","authors":"Fan Zhou, Ruiyang Yin, Kunpeng Zhang, Goce Trajcevski, Ting Zhong, Jin Wu","year":"2019","venue":"WWW","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}