Proceedings

Locality Preserving Nonnegative Matrix Factorization

Download BibTeX Cite

Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence. Pages 1010-1014.

© 2009 International Joint Conferences on Artificial Intelligence

Abstract

Matrix factorization techniques have been frequently applied in information processing tasks. Among them, Non-negative Matrix Factorization (NMF) have received considerable attentions due to its psychological and physiological interpretation of naturally occurring data whose representation may be parts-based in human brain. On the other hand, from geometric perspective the data is usually sampled from a low dimensional manifold embedded in high dimensional ambient space. One hopes then to find a compact representation which uncovers the hidden topics and simultaneously respects the intrinsic geometric structure. In this paper, we propose a novel algorithm, called {em Locality Preserving Non-negative Matrix Factorization} (LPNMF), for this purpose. For two data points, we use KL-divergence to evaluate their similarity on the hidden topics. The optimal maps are obtained such that the feature values on hidden topics are restricted to be non-negative and vary smoothly along the geodesics of the data manifold. Our empirical study shows the encouraging results of the proposed algorithm in comparisons to the state-of-the-art algorithms on two large high-dimensional databases.Deng Cai, Xiaofei He, Xuanhui Wang, Hujun Bao, Jiawei Han

  1. [Belkin and Niyogi, 2001] M. Belkin and P. Niyogi. Lapla- cian eigenmaps and spectral techniques for embedding and clustering. In NIPS 14. 2001.
  2. [Belkin et al., 2006] M. Belkin, P. Niyogi, and V. Sind- hwani. Manifold regularization: A geometric framework for learning from examples. Journal of Machine Learning Research, 7:2399-2434, 2006.
  3. [Brunet et al., 2004] Jean-Philippe Brunet, Pablo Tamayo, Todd R. Golub, and Jill P. Mesirov. Metagenes and molec- ular pattern discovery using matrix factorization. Proceed- ings of the National Academy of Sciences, 101(12):4164- 4169, 2004.
  4. [Cai et al., 2005] Deng Cai, Xiaofei He, and Jiawei Han. Document clustering using locality preserving indexing. IEEE Transactions on Knowledge and Data Engineering, 17(12):1624-1637, December 2005.
  5. [Cai et al., 2008] Deng Cai, Xiaofei He, Xiaoyun Wu, and Jiawei Han. Non-negative matrix factorization on mani- fold. In Proc. Int. Conf. on Data Mining (ICDM'08), 2008.
  6. [Chung, 1997] Fan R. K. Chung. Spectral Graph Theory, volume 92 of Regional Conference Series in Mathematics. AMS, 1997.
  7. [Deerwester et al., 1990] S. C. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. harshman. Index- ing by latent semantic analysis. Journal of the American Society of Information Science, 41(6):391-407, 1990.
  8. [Dempster et al., 1977] A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical So- ciety. Series B (Methodological), 39(1):1-38, 1977.
  9. [Duda et al., 2000] R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification. Wiley-Interscience, Hoboken, NJ, 2nd edition, 2000.
  10. [He and Niyogi, 2003] Xiaofei He and Partha Niyogi. Lo- cality preserving projections. In NIPS 16. 2003.
  11. [Lee and Seung, 1999] Daniel D. Lee and H. Sebastian Se- ung. Learning the parts of objects by non-negative matrix factorization. Nature, 401:788-791, 1999.
  12. [Lee and Seung, 2001] Daniel D. Lee and H. Sebastian Se- ung. Algorithms for non-negative matrix factorization. In NIPS 13. 2001.
  13. [Li et al., 2001] Stan Z. Li, XinWen Hou, HongJiang Zhang, and QianSheng Cheng. Learning spatially localized, parts- based representation. In CVPR'01, 2001.
  14. [Liu et al., 2008] Wei Liu, Dacheng Tao, and Jianzhuang Li. Transductive component analysis. In Proc. Int. Conf. on Data Mining (ICDM'08), 2008.
  15. [Logothetis and Sheinberg, 1996] N. K. Logothetis and D. L. Sheinberg. Visual object recognition. Annual Review of Neuroscience, 19:577-621, 1996.
  16. [Palmer, 1977] S. E. Palmer. Hierarchical structure in per- ceptual representation. Cognitive Psychology, 9:441-474, 1977.
  17. [Shi and Malik, 2000] J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):888-905, 2000.
  18. [Wachsmuth et al., 1994] E. Wachsmuth, M. W. Oram, and D. I. Perrett. Recognition of objects and their component parts: Responses of single units in the temporal cortex of the macaque. Cerebral Cortex, 4:509-522, 1994.
  19. [Xu et al., 2003] Wei Xu, Xin Liu, and Yihong Gong. Doc- ument clustering based on non-negative matrix factoriza- tion. In SIGIR'03, 2003.
  20. [Zha et al., 2001] H. Zha, C. Ding, M. Gu, X. He, and H. Si- mon. Spectral relaxation for k-means clustering. In NIPS 14. 2001.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards