Proceedings

Matrix Co-Factorization on Compressed Sensing

Download BibTeX Cite

Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence. Pages 1595-1601.

https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-268

© 2011 International Joint Conferences on Artificial Intelligence

Abstract

In this paper we address the problem of matrix factorization on compressively-sampled measurements which are obtained by random projections. While this approach improves the scalability of matrix factorization, its performance is not satisfactory. We present a matrix co-factorization method where compressed measurements and a small number of uncompressed measurements are jointly decomposed, sharing a factor matrix. We evaluate the performance of three matrix factorization methods in terms of Cram{'e}r-Rao bounds, including: (1) matrix factorization on uncompressed data (MF); (2) matrix factorization on compressed data (CS-MF); (3) matrix co-factorization on compressed and uncompressed data (CS-MCF). Numerical experiments demonstrate that CS-MCF improves the performance of CS-MF, emphasizing the useful behavior of exploiting side information (a small number of uncompressed measurements).

  1. [Candes and Tao, 2006] E. Candes and T. Tao. Near opti- mal signal recovery from random projections: Universal encoding strategies? IEEE Transactions on Information Theory, 52(12):5406-5425, 2006.
  2. [Donoho, 2006] D. L. Donoho. Compressed sensing. IEEE Transactions on Information Theory, 52(4):1289-1306, 2006.
  3. [Jolliffe, 2002] I. T. Jolliffe. Principal Component Analysis. Spinger-Verlag, 2 edition, 2002.
  4. [Kay, 1993] S. M. Kay. Fundamentals of Statistical Signal Processing: Estimation Theory. Prentice Hall, 1993.
  5. [Koren et al., 2009] Y. Koren, R. Bell, and C. Volinsky. Ma- trix factorization techniques for recommender systems. IEEE Computer, 42(8):30-37, 2009.
  6. [Lee and Choi, 2009] H. Lee and S. Choi. Group nonnega- tive matrix factorization for EEG classification. In Pro- ceedings of the International Conference on Artificial In- telligence and Statistics (AISTATS), Clearwater Beach, Florida, 2009.
  7. [Lee and Seung, 1999] D. D. Lee and H. S. Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 401:788-791, 1999.
  8. [Lee et al., 2010] H. Lee, J. Yoo, and S. Choi. Semi- supervised nonnegative matrix factorization. IEEE Signal Processing Letters, 17(1):4-7, 2010.
  9. [O'Grady and Rickard, 2008] P. D. O'Grady and S. T. Rickard. Non-negative matrix factorisation of compress- ibely sampled non-negative signals. In Proceedings of the 8th IMA International Conference on Mathematics in Sig- nal Processing, Cirencester, UK, 2008.
  10. [Singh and Gordon, 2008] A. P. Singh and G. J. Gordon. Re- lational learning via collective matrix factorization. In Proceedings of the ACM SIGKDD Conference on Knowl- edge Discovery and Data Mining (KDD), Las Vegas, Nevada, 2008.
  11. [Smaragdis and Brown, 2003] P. Smaragdis and J. C. Brown. Non-negative matrix factorization for polyphonic music transcription. In Proceedings of IEEE Workshop on Appli- cations of Signal Processing to Audio and Acoustics, pages 177-180, New Paltz, NY, 2003.
  12. [Srebro et al., 2005] N. Srebro, J. D. M. Rennie, and T. Jaakkola. Maximum-margin matrix factorization. In Advances in Neural Information Processing Systems (NIPS), volume 17. MIT Press, 2005.
  13. [Xu et al., 2003] W. Xu, X. Liu, and Y. Gong. Docu- ment clustering based on non-negative matrix factoriza- tion. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SI- GIR), Toronto, Canada, 2003.
  14. [Yoo and Choi, 2008] J. Yoo and S. Choi. Orthogonal non- negative matrix factorization: Multiplicative updates on Stiefel manifolds. In Proceedings of the 9th International Conference on Intelligent Data Engineering and Auto- mated Learning (IDEAL), Daejeon, Korea, 2008.
  15. [Yoo and Choi, 2009] J. Yoo and S. Choi. Weighted nonneg- ative matrix co-tri-factorization for collaborative predic- tion. In Proceedings of the 1st Asian Conference on Ma- chine Learning (ACML), Nanjing, China, 2009.
  16. [Yoo and Choi, 2010] J. Yoo and S. Choi. Orthogonal non- negative matrix-tri-factorization for co-clustering: Multi- plicative updates on stiefel manifolds. Information Pro- cessing and Management, 46(5):559-570, 2010.
  17. [Yoo et al., 2010] J. Yoo, M. Kim, K. Kang, and S. Choi. Nonnegative matrix partial co-factorization for drum source separation. In Proceedings of the IEEE Interna- tional Conference on Acoustics, Speech, and Signal Pro- cessing (ICASSP), Dallas, Texas, 2010.
  18. [Yu et al., 2005] K. Yu, S. Yu, and V. Tresp. Multi-label in- formed latent semantic indexing. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), Salvador, Brazil, 2005.
  19. [Zhu et al., 2007] S. Zhu, K. Yu, Y. Chi, and Y. Gong. Com- bining content and link for classification using matrix fac- torization. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), Amsterdam, The Netherlands, 2007.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards