{"type":"ScholarlyArticle","title":"Neural Tensor Model for Learning Multi-Aspect Factors in Recommender Systems","authors":[{"name":"Huiyuan Chen","slug":"huiyuan-chen","given":"Huiyuan","family":"Chen","affiliation":"Department of Computer and Data Sciences , Case Western Reserve University"},{"name":"Jing Li","slug":"jing-li","given":"Jing","family":"Li","affiliation":"Department of Computer and Data Sciences , Case Western Reserve University"}],"abstract":"Recommender systems often involve multi-aspect factors. For example, when shopping for shoes online, consumers usually look through their  images, ratings, and product's reviews before making their decisions.  To learn multi-aspect factors, many context-aware models have been developed based on tensor factorizations. However, existing models assume multilinear structures in the tensor data, thus failing to capture   nonlinear feature interactions. To fill this gap, we propose a novel nonlinear tensor machine, which combines deep neural networks and tensor algebra to capture nonlinear interactions among multi-aspect factors. We further consider adversarial learning to assist the training of our model. Extensive experiments demonstrate the effectiveness of the proposed model.","doi":"10.24963/ijcai.2020/339","url":"https://ijcai.org/proceedings/2020/339","pdf":"https://ijcai.org/proceedings/2020/0339.pdf","markdown":"https://ijcai.org/proceedings/2020/339.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/339","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Machine Learning","track":"Main track","number":339,"pages":{"first":2449,"last":2455},"keywords":["Multidisciplinary Topics and Applications: Recommender Systems","Machine Learning: Recommender Systems","Machine Learning: Tensor and Matrix Methods","Machine Learning: Deep Learning"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/25281/file_25281.m3u8","length_sec":301,"provider":"hls"}],"references":[{"position":1,"raw":"[Acar et al., 2011] Evrim Acar, Tamara G Kolda, and Daniel M Dunlavy. All-at-once optimization for coupled matrix and tensor factorizations. Computing Research Repository (CORR), 2011.","title":"All-at-once optimization for coupled matrix and tensor factorizations","authors":"Evrim Acar, Tamara G Kolda, Daniel M Dunlavy","year":"2011","venue":"Computing Research Repository","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bhargava et al., 2015] Preeti Bhargava, Thomas Phan, Jiayu Zhou, and Juhan Lee. Who, what, when, and where: Multi-dimensional collaborative recommendations using tensor factorization on sparse user-generated data. In WWW, 2015.","title":"Who, what, when, and where: Multi-dimensional collaborative recommendations using tensor factorization on sparse user-generated data","authors":"Preeti Bhargava, Thomas Phan, Jiayu Zhou, Juhan Lee","year":"2015","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Catherine and Cohen, 2017] Rose Catherine and William Cohen. Transnets: Learning to transform for recommendation. In Rec- Sys, 2017.","title":"Transnets: Learning to transform for recommendation","authors":"Catherine, Cohen, Rose Catherine, William Cohen","year":"2017","venue":"Rec-Sys","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen and Li, 2017] Huiyuan Chen and Jing Li. Learning multi- ple similarities of users and items in recommender systems. In ICDM, 2017.","title":"Learning multiple similarities of users and items in recommender systems","authors":"Chen, Li ; ] Huiyuan Chen, Jing Li","year":"2017","venue":"ICDM","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Chen and Li, 2018] Huiyuan Chen and Jing Li. Drugcom: Syn- ergistic discovery of drug combinations using tensor decomposi- tion. In ICDM, 2018.","title":"Drugcom: Synergistic discovery of drug combinations using tensor decomposition","authors":"Chen, Li ; ] Huiyuan Chen, Jing Li","year":"2018","venue":"ICDM","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Chen and Li, 2019] Huiyuan Chen and Jing Li. Adversarial ten- sor factorization for context-aware recommendation. In RecSys, 2019.","title":"Adversarial tensor factorization for context-aware recommendation","authors":"Chen, Li ;, Huiyuan Chen, Jing Li","year":"2019","venue":"RecSys","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Cheng et al., 2016] Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et al. Wide & deep learning for recommender systems. In DLRS, 2016.","title":"Wide & deep learning for recommender systems","authors":"Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir","year":"2016","venue":"DLRS","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Cohen et al., 2016] Nadav Cohen, Or Sharir, and Amnon Shashua. On the expressive power of deep learning: A tensor analysis. In COLT, 2016.","title":"On the expressive power of deep learning: A tensor analysis","authors":"Nadav Cohen, Or Sharir, Amnon Shashua","year":"2016","venue":"COLT","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Fang et al., 2015] Xiaomin Fang, Rong Pan, Guoxiang Cao, Xi- uqiang He, and Wenyuan Dai. Personalized tag recommendation through nonlinear tensor factorization using gaussian kernel. In AAAI, 2015.","title":"Personalized tag recommendation through nonlinear tensor factorization using gaussian kernel","authors":"Xiaomin Fang, Rong Pan, Guoxiang Cao, Xiuqiang He, Wenyuan Dai","year":"2015","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Goodfellow et al., 2014] Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. In NeurIPS, 2014.","title":"Generative adversarial nets","authors":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio","year":"2014","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[He and McAuley, 2016] Ruining He and Julian McAuley. Vbpr: visual bayesian personalized ranking from implicit feedback. In AAAI, 2016.","title":"Ruining He and Julian McAuley. Vbpr: visual bayesian personalized ranking from implicit feedback","authors":"Mcauley He","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[He et al., 2016] Ruining He, Chen Fang, Zhaowen Wang, and Ju- lian McAuley. Vista: A visually, socially, and temporally-aware model for artistic recommendation. In RecSys, 2016.","title":"Vista: A visually, socially, and temporally-aware model for artistic recommendation","authors":"Ruining He, Chen Fang, Zhaowen Wang, Julian Mcauley","year":"2016","venue":"RecSys","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[He et al., 2017] Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. Neural collaborative filtering. In WWW, 2017.","title":"Neural collaborative filtering","authors":"He","year":"2017","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[He et al., 2018] Xiangnan He, Xiaoyu Du, Xiang Wang, Feng Tian, Jinhui Tang, and Tat-Seng Chua. Outer product-based neu- ral collaborative filtering. In IJCAI, 2018.","title":"Outer product-based neural collaborative filtering","authors":"He","year":"2018","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2018/308"},{"position":15,"raw":"[Jia et al., 2014] Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadar- rama, and Trevor Darrell. Caffe: Convolutional architecture for fast feature embedding. In MM, 2014.","title":"Caffe: Convolutional architecture for fast feature embedding","authors":"Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, Trevor Darrell","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Karatzoglou et al., 2010] Alexandros Karatzoglou, Xavier Ama- triain, Linas Baltrunas, and Nuria Oliver. Multiverse recommen- dation: n-dimensional tensor factorization for context-aware col- laborative filtering. In RecSys, 2010.","title":"Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering","authors":"Alexandros Karatzoglou, Xavier Amatriain, Linas Baltrunas, Nuria Oliver","year":"2010","venue":"RecSys","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Kim et al., 2016] Donghyun Kim, Chanyoung Park, Jinoh Oh, Sungyoung Lee, and Hwanjo Yu. Convolutional matrix factor- ization for document context-aware recommendation. In RecSys, 2016.","title":"Convolutional matrix factorization for document context-aware recommendation","authors":"Donghyun Kim, Chanyoung Park, Jinoh Oh, Sungyoung Lee, Hwanjo Yu","year":"2016","venue":"RecSys","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Kim, 2014] Yoon Kim. Convolutional neural networks for sen- tence classification. In EMNLP, 2014.","title":"Convolutional neural networks for sentence classification","authors":"Yoon Kim","year":"2014","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Kingma and Ba, 2015] Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. In ICLR, 2015.","title":"Adam: A method for stochastic optimization","authors":"P Diederik, Jimmy Kingma, Ba","year":"2015","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Kolda and Bader, 2009] Tamara G Kolda and Brett W Bader. Ten- sor decompositions and applications. SIAM review, 51(3):455- 500, 2009.","title":"Tensor decompositions and applications","authors":"G Tamara, Brett W Kolda, Bader","year":"2009","venue":"SIAM review","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Lebedev et al., 2015] Vadim Lebedev, Yaroslav Ganin, Mak- sim Rakhuba, Ivan Oseledets, and Victor Lempitsky. Speeding-up convolutional neural networks using fine-tuned cp-decomposition. In ICLR, 2015.","title":"Speeding-up convolutional neural networks using fine-tuned cp-decomposition","authors":"Vadim Lebedev, Yaroslav Ganin, Maksim Rakhuba, Ivan Oseledets, Victor Lempitsky","year":"2015","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Liu et al., 2019] Hanpeng Liu, Yaguang Li, Michael Tsang, and Yan Liu. Costco: A neural tensor completion model for sparse tensors. In KDD, 2019.","title":"Costco: A neural tensor completion model for sparse tensors","authors":"Liu","year":"2019","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Novikov et al., 2015] Alexander Novikov, Dmitrii Podoprikhin, Anton Osokin, and Dmitry P Vetrov. Tensorizing neural net- works. In NeurIPS, 2015.","title":"Tensorizing neural networks","authors":"Alexander Novikov, Dmitrii Podoprikhin, Anton Osokin, Dmitry P Vetrov","year":"2015","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Socher et al., 2013] Richard Socher, Danqi Chen, Christopher D Manning, and Andrew Ng. Reasoning with neural tensor net- works for knowledge base completion. In NeurIPS, 2013.","title":"Reasoning with neural tensor networks for knowledge base completion","authors":"Richard Socher, Danqi Chen, Christopher D Manning, Andrew Ng","year":"2013","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Srivastava et al., 2014] Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research, 15(1):1929-1958, 2014.","title":"Dropout: a simple way to prevent neural networks from overfitting","authors":"Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, Ruslan Salakhutdinov","year":"2014","venue":"The journal of machine learning research","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Wang et al., 2017] Jun Wang, Lantao Yu, Weinan Zhang, Yu Gong, Yinghui Xu, Benyou Wang, Peng Zhang, and Dell Zhang. Irgan: A minimax game for unifying generative and discriminative information retrieval models. In SIGIR, 2017.","title":"Irgan: A minimax game for unifying generative and discriminative information retrieval models","authors":"Jun Wang, Lantao Yu, Weinan Zhang, Yu Gong, Yinghui Xu, Benyou Wang, Peng Zhang, Dell Zhang","year":"2017","venue":"SIGIR","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Wang et al., 2018a] Peifeng Wang, Shuangyin Li, and Rong Pan. Incorporating gan for negative sampling in knowledge represen- tation learning. In AAAI, 2018.","title":"Incorporating gan for negative sampling in knowledge representation learning","authors":"Wang","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Wang et al., 2018b] Qinyong Wang, Hongzhi Yin, Zhiting Hu, Defu Lian, Hao Wang, and Zi Huang. Neural memory stream- ing recommender networks with adversarial training. In KDD, 2018.","title":"Neural memory streaming recommender networks with adversarial training","authors":"Wang","year":"2018","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Wu et al., 2019] Xian Wu, Baoxu Shi, Yuxiao Dong, Chao Huang, and Nitesh V Chawla. Neural tensor factorization for temporal interaction learning. In WSDM, 2019.","title":"Neural tensor factorization for temporal interaction learning","authors":"Xian Wu, Baoxu Shi, Yuxiao Dong, Chao Huang, Nitesh V Chawla","year":"2019","venue":"WSDM","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Xu et al., 2012] Zenglin Xu, Feng Yan, and Yuan Qi. Infinite tucker decomposition: Nonparametric bayesian models for mul- tiway data analysis. In ICML, 2012.","title":"Infinite tucker decomposition: Nonparametric bayesian models for multiway data analysis","authors":"Xu","year":"2012","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Yu et al., 2018] Wenhui Yu, Huidi Zhang, Xiangnan He, Xu Chen, Li Xiong, and Zheng Qin. Aesthetic-based clothing recommen- dation. In WWW, 2018.","title":"Aesthetic-based clothing recommendation","authors":"Wenhui Yu, Huidi Zhang, Xiangnan He, Xu Chen, Li Xiong, Zheng Qin","year":"2018","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Zhang et al., 2017] Yongfeng Zhang, Qingyao Ai, Xu Chen, and W Bruce Croft. Joint representation learning for top-n recom- mendation with heterogeneous information sources. In CIKM, 2017.","title":"Joint representation learning for top-n recommendation with heterogeneous information sources","authors":"Yongfeng Zhang, Qingyao Ai, Xu Chen, Bruce Croft","year":"2017","venue":"CIKM","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Zhe et al., 2016] Shandian Zhe, Kai Zhang, Pengyuan Wang, Kuang-chih Lee, Zenglin Xu, Yuan Qi, and Zoubin Ghahramani. Distributed flexible nonlinear tensor factorization. In NeurIPS, 2016.","title":"Distributed flexible nonlinear tensor factorization","authors":"Zhe","year":"2016","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Zheng et al., 2017] Lei Zheng, Vahid Noroozi, and Philip S Yu. Joint deep modeling of users and items using reviews for recom- mendation. In WSDM, 2017.","title":"Joint deep modeling of users and items using reviews for recommendation","authors":"Lei Zheng, Vahid Noroozi, Philip S Yu","year":"2017","venue":"WSDM","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}