{"type":"ScholarlyArticle","title":"Tensor Decomposition with Missing Indices","authors":[{"name":"Yuto Yamaguchi","slug":"yuto-yamaguchi","given":"Yuto","family":"Yamaguchi","affiliation":"†AIST , Japan"},{"name":"Kohei Hayashi","slug":"kohei-hayashi","given":"Kohei","family":"Hayashi","affiliation":"†AIST , Japan"}],"abstract":"How can we decompose a data tensor if the indices are partially missing?Tensor decomposition is a fundamental tool to analyze the tensor data.Suppose, for example, we have a 3rd-order tensor X where each element Xijk takes 1 if user i posts word j at location k on Twitter.Standard tensor decomposition expects all the indices are observed but, in some tweets, location k can be missing.In this paper, we study a tensor decomposition problem where the indices (i, j, or k) of some observed elements are partially missing.Towards the problem, we propose a probabilistic tensor decomposition model that handles missing indices as latent variables.To infer them, we derive an algorithm based on stochastic variational inference, which enables to leverage the information from the incomplete data scalably. The experiments on both synthetic and real datasets show that the proposed method achieves higher accuracy in the tensor completion task than baselines that cannot handle missing indices.","doi":"10.24963/ijcai.2017/449","url":"https://ijcai.org/proceedings/2017/449","pdf":"https://ijcai.org/proceedings/2017/0449.pdf","markdown":"https://ijcai.org/proceedings/2017/449.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/449","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Machine Learning S-Z","track":"Main track","number":449,"pages":{"first":3217,"last":3223},"keywords":["Machine Learning: Unsupervised Learning","Machine Learning: Relational Learning"],"videos":[],"references":[{"position":1,"raw":"[Acar et al., 2011a] Evrim Acar, Daniel M Dunlavy, Tamara G Kolda, and Morten Mørup. Scalable tensor factorizations for incomplete data. Chemometrics and Intelligent Laboratory Systems, 106(1):41-56, 2011.","title":"Scalable tensor factorizations for incomplete data","authors":"Acar","year":"2011","venue":"Chemometrics and Intelligent Laboratory Systems","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Acar et al., 2011b] Evrim Acar, Tamara G Kolda, and Daniel M Dunlavy. All-at-once optimization for cou- pled matrix and tensor factorizations. arXiv preprint arXiv:1105.3422, 2011.","title":"All-at-once optimization for coupled matrix and tensor factorizations","authors":"Acar","year":"2011","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Carroll and Chang, 1970] J Douglas Carroll and Jih-Jie Chang. Analysis of individual differences in multidi- mensional scaling via an n-way generalization of \"eckart- young\" decomposition. Psychometrika, 35(3):283-319, 1970.","title":"Analysis of individual differences in multidimensional scaling via an n-way generalization of \"eckartyoung\" decomposition","authors":"Carroll, Chang ;, ], Douglas Carroll, Jih-Jie Chang","year":"1970","venue":"Psychometrika","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Cheng et al., 2010] Zhiyuan Cheng, James Caverlee, and Kyumin Lee. You are where you tweet: a content-based approach to geo-locating twitter users. In CIKM, pages 759-768, 2010.","title":"You are where you tweet: a content-based approach to geo-locating twitter users","authors":"Zhiyuan Cheng, James Caverlee, Kyumin Lee","year":"2010","venue":"CIKM","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Chu and Ghahramani, 2009] Wei Chu and Zoubin Ghahra- mani. Probabilistic models for incomplete multi- dimensional arrays. In AISTATS, pages 89-96, 2009.","title":"Probabilistic models for incomplete multidimensional arrays","authors":"Chu, Ghahramani, Wei Chu, Zoubin Ghahramani","year":"2009","venue":"AISTATS","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Fawcett, 2006] Tom Fawcett. An introduction to roc analy- sis. Pattern recognition letters, 27(8):861-874, 2006.","title":"Tom Fawcett. An introduction to roc analysis","authors":"Fawcett","year":"2006","venue":"Pattern recognition letters","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Franz et al., 2009] Thomas Franz, Antje Schultz, Sergej Sizov, and Steffen Staab. Triplerank: Ranking semantic web data by tensor decomposition. In International se- mantic web conference, pages 213-228. Springer, 2009.","title":"Triplerank: Ranking semantic web data by tensor decomposition","authors":"Thomas Franz, Antje Schultz, Sergej Sizov, Steffen Staab","year":"2009","venue":"International semantic web conference","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Gupta et al., 2011] Maya R Gupta, Yihua Chen, et al. The- ory and use of the em algorithm. Foundations and Trends R in Signal Processing, 4(3):223-296, 2011.","title":"Theory and use of the em algorithm","authors":"Yihua Maya R Gupta, Chen","year":"2011","venue":"Foundations and Trends R in Signal Processing","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Harshman, 1970] Richard A Harshman. Foundations of the parafac procedure: Models and conditions for an\" explana- tory\" multi-modal factor analysis. 1970.","title":"Foundations of the parafac procedure: Models and conditions for an\" explanatory\" multi-modal factor analysis","authors":"Richard A Harshman","year":"1970","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Jain and Oh, 2014] Prateek Jain and Sewoong Oh. Prov- able tensor factorization with missing data. In Advances in Neural Information Processing Systems, pages 1431- 1439, 2014.","title":"Provable tensor factorization with missing data","authors":"Prateek Jain, Sewoong Oh","year":"2014","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Jeon et al., 2016] Inah Jeon, Evangelos E Papalexakis, Christos Faloutsos, Lee Sael, and U Kang. Mining billion- scale tensors: algorithms and discoveries. The VLDB Jour- nal, 25(4):519-544, 2016.","title":"Mining billionscale tensors: algorithms and discoveries","authors":"Inah Jeon, Evangelos E Papalexakis, Christos Faloutsos, Lee Sael, Kang","year":"2016","venue":"The VLDB Journal","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Kolda and Bader, 2009] Tamara G Kolda and Brett W Bader. Tensor decompositions and applications. SIAM review, 51(3):455-500, 2009.","title":"Tensor decompositions and applications","authors":"G Tamara, Brett W Kolda, Bader","year":"2009","venue":"SIAM review","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Kolda and Sun, 2008] Tamara G Kolda and Jimeng Sun. Scalable tensor decompositions for multi-aspect data min- ing. In Data Mining, 2008. ICDM'08. Eighth IEEE Inter- national Conference on, pages 363-372. IEEE, 2008.","title":"Scalable tensor decompositions for multi-aspect data mining","authors":"G Tamara, Jimeng Kolda, Sun","year":"2008","venue":"ICDM'08. Eighth IEEE International Conference on","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Maehara et al., 2016] Takanori Maehara, Kohei Hayashi, and Ken-ichi Kawarabayashi. Expected tensor decompo- sition with stochastic gradient descent. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pages 1919-1925. AAAI Press, 2016.","title":"Expected tensor decomposition with stochastic gradient descent","authors":"Takanori Maehara, Kohei Hayashi, Ken-Ichi Kawarabayashi","year":"2016","venue":"Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Nickel et al., 2011] Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel. A three-way model for collective learning on multi-relational data. In Proceedings of the 28th international conference on machine learning (ICML-11), pages 809-816, 2011.","title":"A three-way model for collective learning on multi-relational data","authors":"Nickel","year":"2011","venue":"Proceedings of the 28th international conference on machine learning (ICML-11)","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Oh et al., 2017] Jinoh Oh, Kijung Shin, Evangelos E Pa- palexakis, Christos Faloutsos, and Hwanjo Yu. S-hot: Scalable high-order tucker decomposition. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, pages 761-770. ACM, 2017.","title":"S-hot: Scalable high-order tucker decomposition","authors":"Oh","year":"2017","venue":"Proceedings of the Tenth ACM International Conference on Web Search and Data Mining","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Papalexakis et al., 2015] Evangelos E Papalexakis, Chris- tos Faloutsos, and Nicholas D Sidiropoulos. P ar c ube: Sparse parallelizable candecomp-parafac tensor decompo- sition. ACM Transactions on Knowledge Discovery from Data (TKDD), 10(1):3, 2015.","title":"P ar c ube: Sparse parallelizable candecomp-parafac tensor decomposition","authors":"Christos Evangelos E Papalexakis, Nicholas D Faloutsos, Sidiropoulos","year":"2015","venue":"ACM Transactions on Knowledge Discovery from Data (TKDD)","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Rai et al., 2014] Piyush Rai, Yingjian Wang, Shengbo Guo, Gary Chen, David B Dunson, and Lawrence Carin. Scal- able bayesian low-rank decomposition of incomplete mul- tiway tensors. In ICML, pages 1800-1808, 2014.","title":"Scalable bayesian low-rank decomposition of incomplete multiway tensors","authors":"Piyush Rai, Yingjian Wang, Shengbo Guo, Gary Chen, David B Dunson, Lawrence Carin","year":"2014","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Rendle and Schmidt-Thieme, 2010] Steffen Rendle and Lars Schmidt-Thieme. Pairwise interaction tensor fac- torization for personalized tag recommendation. In Proceedings of the third ACM international conference on Web search and data mining, pages 81-90. ACM, 2010.","title":"Pairwise interaction tensor factorization for personalized tag recommendation","authors":"Steffen Rendle, Lars Schmidt-Thieme","year":"2010","venue":"Proceedings of the third ACM international conference on Web search and data mining","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Sun et al., 2006] Jimeng Sun, Dacheng Tao, and Christos Faloutsos. Beyond streams and graphs: dynamic tensor analysis. In Proceedings of the 12th ACM SIGKDD in- ternational conference on Knowledge discovery and data mining, pages 374-383. ACM, 2006.","title":"Jimeng Sun, Dacheng Tao, and Christos Faloutsos. Beyond streams and graphs: dynamic tensor analysis","authors":"Sun","year":"2006","venue":"Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Tucker, 1966] Ledyard R Tucker. Some mathematical notes on three-mode factor analysis. Psychometrika, 31(3):279- 311, 1966.","title":"Some mathematical notes on three-mode factor analysis","authors":"R Ledyard, Tucker","year":"1966","venue":"Psychometrika","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Zhao et al., 2016] Qibin Zhao, Guoxu Zhou, Liqing Zhang, Andrzej Cichocki, and Shun-Ichi Amari. Bayesian ro- bust tensor factorization for incomplete multiway data. IEEE transactions on neural networks and learning sys- tems, 27(4):736-748, 2016.","title":"Bayesian robust tensor factorization for incomplete multiway data","authors":"Zhao","year":"2016","venue":"IEEE transactions on neural networks and learning systems","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}