Proceedings

Automatic Name-Face Alignment to Enable Cross-Media News Retrieval

Download BibTeX Cite

Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. Pages 2768-2774.

© 2013 International Joint Conferences on Artificial Intelligence

Abstract

A new algorithm is developed in this paper to support automatic name-face alignment for achieving more accurate cross-media news retrieval. We focus on extracting valuable information from large amounts of news images and their captions, where multi-level image-caption pairs are constructed for characterizing both significant names with higher salience and their cohesion with human faces extracted from news images. To remedy the issue of lacking enough related information for rare name, Web mining is introduced to acquire the extra multimodal information. We also emphasize on an optimization mechanism by our Improved Self-Adaptive Simulated Annealing Genetic Algorithm to verify the feasibility of alignment combinations. Our experiments have obtained very positive results.

  1. [Andresen et al., 2008] M. Andresen, H. Bräsel, J. Tusch, M. Mörig, F. Werner, and P. Willenius. Simulated annealing and genetic algorithms for minimizing mean flow time in an open shop. Mathematical and Computer Modelling, 48(7-8):1279-1293, 2008.
  2. [Berg et al., 2005] T.L. Berg, A.C. Berg, J. Edwards, and D.A. Forsyth. Who's in the picture. Advances in Neural Information Processing Systems 17, 37-144, 2005.
  3. [Berg et al., 2007] T.L. Berg, A.C. Berg, J. Edwards, and M. Maire. Names and faces. Technical Report, U.C. at Berkeley, 2007.
  4. [Berg et al., 2004] T.L. Berg, A.C. Berg, J. Edwards, M. Maire, R. White, Y.W. The, E. Learned-Miller, and D. Forsyth. Names and faces in the news. In Proceedings of CVPR 2004, 2:848-854, 2004.
  5. [Bozorgtabar et al., 2011] B. Bozorgtabar and G.A. Rezai Rad. A genetic programming -PCA hybrid face recognition algorithm. Journal of Signal and Information Processing, 2:170-174, 2011.
  6. [Datta et al., 2008] R. Datta, D. Joshi, J. Li, and J.Z. Wang. Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys (CSUR), 40(2), Article 5, 2008.
  7. [Deschacht et al., 2007] K. Deschacht and M.F. Moens, Text analysis for automatic image annotation. In Proceedings of ACL2007, 1000-1007, 2007.
  8. [Everingham et al., 2006] M. Everingham, J. Sivic, and A. Zisserman. Hello! My name Is … Buffy -Automatic naming of characters in TV video. In Proceedings of BMVC 2006, 889-908, 2006.
  9. [Everingham et al., 2009] M. Everingham, J. Sivic, and A. Zisserman. Taking the bite out of automatic naming of characters in TV video. Image and Vision Computing, 27(5):545-559, 2009.
  10. [Fan et al., 2012] J.P. Fan, X.F. He, N. Zhou, J.Y. Peng, and R. Jain. Quantitative characterization of semantic gaps for learning complexity estimation and inference model selection. IEEE Transactions on Multimedia, 14(5):1414-1428, 2012.
  11. [Guillaumin et al., 2008] M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid. Automatic face naming with caption-based supervision. In Proceedings of CVPR 2008, 1-8, 2008.
  12. [Guillaumin et al., 2012] M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid. Face recognition from caption-based supervision. International Journal of Computer Vision, 96(1):64-82, 2012.
  13. [Le et al., 2008] D.D. Le and S. Satoh. Unsupervised face annotation by mining the Web. In Proceedings of ICDM 2008, 383-392, 2008.
  14. [Le et al., 2007] D.D. Le, S. Satoh, M.E. Houle, and D.P.T. Nguyen. Finding important people in large news video databases using multimodal and clustering analysis. In Proceedings of ICDEW 2007, 127-136, 2007.
  15. [Liu et al., 2008] C. Liu, S. Jiang, and Q. Huang. Naming faces in broadcast news video by image Google. In Proceedings of MM 2008, 717-720, 2008.
  16. [Mensink et al., 2008] T. Mensink and J. Verbeek. Improving People Search using Query expansions: How friends help to find people. In Proceedings of ECCV 2008, 86-99, 2008.
  17. [Ozkan et al., 2006] D. Ozkan and P. Duygulu. A graph based approach for naming faces in news photo. In Proceedings of CVPR 2006, 1477-1482, 2006.
  18. [Pham et al., 2010] P.T. Pham, M.F. Moens, and T. Tuytelaars. Cross-media alignment of names and faces. IEEE Transactions on Multimedia, 12(1):13-27, 2010.
  19. [Pham et al., 2011] P.T. Pham, T. Tuytelaars, and M.F. Moens. Naming people in news videos with label propagation. IEEE Multimedia, 18(3): 44-55, 2011.
  20. [Satoh et al., 1997] S. Satoh and T. Kanade. Name-it: Association of face and name in video. In Proceedings of CVPR 1997, 368-373, 1997.
  21. [Satoh et al., 1999] S. Satoh, Y. Nakamura, and T. Kanade. Name-it: Naming and Detecting Faces in News Videos. IEEE Multimedia, 6(1):22-35, 1999.
  22. [Wang et al., 2005] Z.G. Wang, M. Rahman., and Y.S. Wong. Optimization of multi-pass milling using parallel genetic algorithm and parallel genetic simulated annealing. International Journal of Machine Tools and Manufacture, 45(15):1726-1734, 2005.
  23. [Yang et al., 2004] J. Yang, M.Y. Chen, and A.G. Hauptmann. Finding person x: Correlating names with visual appearances. In Proceedings of CIVR 2004, 270-278, 2004.
  24. [Yang et al., 2009] Y. Yang, D. Xu, F.P. Nie, J.B. Luo, and Y.T. Zhuang. Ranking with local regression and global alignment for cross media retrieval. In Proceedings of MM 2009, 175-184, 2009.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards