Proceedings

Quantum Divide-and-Conquer Anchoring for Separable Non-negative Matrix Factorization

Download BibTeX Cite

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence. Main track. Pages 2093-2099.

https://doi.org/10.24963/ijcai.2018/289

Abstract

It is NP-complete to find non-negative factors W and H with fixed rank r from a non-negative matrix X by minimizing ||X-WH^Τ ||^2. Although the separability assumption (all data points are in the conical hull of the extreme rows) enables polynomial-time algorithms, the computational cost is not affordable for big data. This paper investigates how the power of quantum computation can be capitalized to solve the non-negative matrix factorization with the separability assumption (SNMF) by devising a quantum algorithm based on the divide-and-conquer anchoring (DCA) scheme [Zhou et al., 2013]. The design of quantum DCA (QDCA) is challenging. In the divide step,  the random projections in  DCA is completed by a quantum algorithm for linear operations, which achieves the exponential speedup. We then  devise a heuristic post-selection procedure which extracts the information of anchors stored in the quantum states efficiently. Under a plausible assumption, QDCA performs efficiently, achieves the quantum speedup, and is beneficial for high dimensional problems.

  1. [Aaronson, 2015] Scott Aaronson. Read the fine print. Na- ture Physics, 11(4):291-293, 2015.
  2. [Berry et al., 2007] Dominic W Berry, Graeme Ahokas, Richard Cleve, and Barry C Sanders. Efficient quantum algorithms for simulating sparse hamiltonians. 2007.
  3. [Biamonte et al., 2017] Jacob Biamonte, Peter Wittek, Nicola Pancotti, Patrick Rebentrost, Nathan Wiebe, and Seth Lloyd. Quantum machine learning. Nature, 549(7671):195, 2017.
  4. [Binder et al., 1993] Kurt Binder, Dieter Heermann, Lyle Roelofs, A John Mallinckrodt, Susan McKay, et al. Monte carlo simulation in statistical physics. 1993.
  5. [Donoho and Stodden, 2004] David Donoho and Victoria Stodden. When does non-negative matrix factorization give a correct decomposition into parts? 2004.
  6. [Giovannetti et al., 2008] Vittorio Giovannetti, Seth Lloyd, and Lorenzo Maccone. Quantum random access memory. Physical review letters, 2008.
  7. [Gross et al., 2010] David Gross, Yi-Kai Liu, Steven T Flammia, Stephen Becker, and Jens Eisert. Quantum state tomography via compressed sensing. Physical review let- ters, 2010.
  8. [Grover and Rudolph, 2002] Lov Grover and Terry Rudolph. Creating superpositions that correspond to efficiently in- tegrable probability distributions. arXiv preprint quant- ph/0208112, 2002.
  9. [Haah et al., 2017] Jeongwan Haah, Aram W Harrow, Zhengfeng Ji, Xiaodi Wu, and Nengkun Yu. Sample- optimal tomography of quantum states. IEEE Transactions on Information Theory, 63(9):5628-5641, 2017.
  10. [Harrow et al., 2009] Aram W Harrow, Avinatan Hassidim, and Seth Lloyd. Quantum algorithm for linear systems of equations. Physical review letters, 103(15):150502, 2009.
  11. [Kapoor et al., 2016] Ashish Kapoor, Nathan Wiebe, and Krysta Svore. Quantum perceptron models. In Advances in Neural Information Processing Systems, pages 3999- 4007, 2016.
  12. [Knuth, 1998] Donald Knuth. Section 5.2. 4: Sorting by merging. 1998.
  13. [Lee and Seung, 1999] Daniel D Lee and H Sebastian Seung. Learning the parts of objects by non-negative matrix fac- torization. Nature, 401(6755):788, 1999.
  14. [Lin, 2007] Chih-Jen Lin. On the convergence of multiplica- tive update algorithms for nonnegative matrix factoriza- tion. IEEE Transactions on Neural Networks, 2007.
  15. [Liu et al., 2017] Tongliang Liu, Mingming Gong, and Dacheng Tao. Large-cone nonnegative matrix factoriza- tion. IEEE transactions on neural networks and learning systems, 2017.
  16. [Lloyd et al., 2014] Seth Lloyd, Masoud Mohseni, and Patrick Rebentrost. Quantum principal component anal- ysis. Nature Physics, 10(9):631-633, 2014.
  17. [Nielsen and Chuang, 2002] Michael A Nielsen and Isaac Chuang. Quantum computation and quantum information, 2002.
  18. [Pauca et al., 2004] V Paul Pauca, Farial Shahnaz, Michael W Berry, and Robert J Plemmons. Text mining using non-negative matrix factorizations. 2004. [Rebentrost et al., 2014]
  19. Patrick Rebentrost, Masoud Mohseni, and Seth Lloyd. Quantum support vector machine for big data classification. Physical review letters, 113(13):130503, 2014.
  20. [Rebentrost et al., 2016] Patrick Rebentrost, Maria Schuld, Francesco Petruccione, and Seth Lloyd. Quantum gradient descent and newton's method for constrained polynomial optimization. 2016.
  21. [Rebentrost et al., 2018] Patrick Rebentrost, Adrian Stef- fens, Iman Marvian, and Seth Lloyd. Quantum singular- value decomposition of nonsparse low-rank matrices. Physical review A, 2018.
  22. [Recht et al., 2012] Ben Recht, Christopher Re, Joel Tropp, and Victor Bittorf. Factoring nonnegative matrices with linear programs. 2012.
  23. [Shor, 1999] Peter W Shor. Polynomial-time algorithms for prime factorization and discrete logarithms on a quantum computer. SIAM review, 41(2):303-332, 1999.
  24. [Van Buskirk et al., 2017] Greg Van Buskirk, Ben Raichel, and Nicholas Ruozzi. Sparse approximate conic hulls. In Advances in Neural Information Processing Systems 30. 2017.
  25. [Van Der Vaart and Wellner, 1996] Aad W Van Der Vaart and Jon A Wellner. Weak convergence. In Weak Con- vergence and Empirical Processes, pages 16-28. Springer, 1996.
  26. [Vavasis, 2009] Stephen A Vavasis. On the complexity of nonnegative matrix factorization. SIAM Journal on Opti- mization, 20(3):1364-1377, 2009.
  27. [Wang et al., 2017] Chaoyue Wang, Chang Xu, Chaohui Wang, and Dacheng Tao. Perceptual adversarial networks for image-to-image transformation. 2017.
  28. [You et al., 2017] Shan You, Chang Xu, Yunhe Wang, Chao Xu, and Dacheng Tao. Privileged multi-label learning. arXiv preprint arXiv:1701.07194, 2017. IJCAI
  29. [Yu et al., 2016] Xiyu Yu, Wei Bian, and Dacheng Tao. Scal- able completion of nonnegative matrices with the separa- ble structure. 2016.
  30. [Zhou et al., 2013] Tianyi Zhou, Wei Bian, and Dacheng Tao. Divide-and-conquer anchoring for near-separable nonnegative matrix factorization and completion in high dimensions. 2013.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards