{"type":"ScholarlyArticle","title":"Discriminant Tensor Dictionary Learning with Neighbor Uncorrelation for Image Set Based Classification","authors":[{"name":"Fei Wu","slug":"fei-wu","given":"Fei","family":"Wu","affiliation":"State Key Laboratory of Software Engineering , School of Computer , Wuhan University , China; College of Automation , Nanjing University of Posts and Telecommunications , China"},{"name":"Xiao-Yuan Jing","slug":"xiao-yuan-jing","given":"Xiao-Yuan","family":"Jing","affiliation":"State Key Laboratory of Software Engineering , School of Computer , Wuhan University , China; College of Automation , Nanjing University of Posts and Telecommunications , China"},{"name":"Wangmeng Zuo","slug":"wangmeng-zuo","given":"Wangmeng","family":"Zuo","affiliation":"School of Computer , Harbin Institute of Technology , China {wufei 8888 ,"},{"name":"Ruiping Wang","slug":"ruiping-wang","given":"Ruiping","family":"Wang","affiliation":"State Key Laboratory of Software Engineering , School of Computer , Wuhan University , China"},{"name":"Xiaoke Zhu","slug":"xiaoke-zhu","given":"Xiaoke","family":"Zhu","affiliation":"State Key Laboratory of Software Engineering , School of Computer , Wuhan University , China"}],"abstract":"Image set based classification (ISC) has attracted lots of research interest in recent years. Several ISC methods have been developed, and dictionary learning technique based methods obtain state-of-the-art performance. However, existing ISC methods usually transform the image sample of a set into a vector for subsequent processing, which breaks the inherent spatial structure of image sample and the set. In this paper, we utilize tensor to model an image set with two spatial modes and one set mode, which can fully explore the intrinsic structure of image set. We propose a novel ISC approach, named discriminant tensor dictionary learning with neighbor uncorrelation (DTDLNU), which jointly learns two spatial dictionaries and one set dictionary. The spatial and set dictionaries are composed by set-specific sub-dictionaries corresponding to the class labels, such that the reconstruction error is discriminative. To obtain dictionaries with favorable discriminative power, DTDLNU designs a neighbor-uncorrelated discriminant tensor dictionary term, which minimizes the within-class scatter of the training sets in the projected tensor space and reduces tensor dictionary correlation among set-specific sub-dictionaries corresponding to neighbor sets from different classes. Experiments on three challenging datasets demonstrate the effectiveness of DTDLNU.","doi":"10.24963/ijcai.2017/428","url":"https://ijcai.org/proceedings/2017/428","pdf":"https://ijcai.org/proceedings/2017/0428.pdf","markdown":"https://ijcai.org/proceedings/2017/428.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/428","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Machine Learning S-Z","track":"Main track","number":428,"pages":{"first":3069,"last":3075},"keywords":["Machine Learning: Feature Selection/Construction","Machine Learning: Multi-instance/Multi-label/Multi-view learning","Machine Learning: Classification"],"videos":[],"references":[{"position":1,"raw":"[Bartels and Stewart, 1972] Richard H. Bartels and G. W. Stewart. Solution of the matrix equation ax+xb=c. Com- munications of the ACM, 15(9):820-826, 1972.","title":"Solution of the matrix equation ax+xb=c","authors":"Richard H Bartels, G W Stewart","year":"1972","venue":"Communications of the ACM","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Caiafa and Cichocki, 2012] Cesar F. Caiafa and Andrzej Ci- chocki. Block sparse representations of tensors using kro- necker bases. In ICASSP, pages 2709-2712, 2012.","title":"Block sparse representations of tensors using kronecker bases","authors":"Cesar F Caiafa, Andrzej Cichocki","year":"2012","venue":"ICASSP","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Cevikalp and Triggs, 2010] Hakan Cevikalp and Bill Trig- gs. Face recognition based on image sets. In CVPR, pages 2567-2573, 2010.","title":"Hakan Cevikalp and Bill Triggs. Face recognition based on image sets","authors":"Triggs Cevikalp","year":"2010","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen et al., 2012] Yi-Chen Chen, Vishal M. Patel, P. Jonathon Phillips, and Rama Chellappa. Dictionary- based face recognition from video. In ECCV, pages 766-779, 2012.","title":"Dictionarybased face recognition from video","authors":"Yi-Chen Chen, M Vishal, P Jonathon Patel, Rama Phillips, Chellappa","year":"2012","venue":"ECCV","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Hayat et al., 2014] Munawar Hayat, Mohammed Ben- namoun, and Senjian An. Learning non-linear reconstruc- tion models for image set classification. In CVPR, pages 1915-1922, 2014.","title":"Learning non-linear reconstruction models for image set classification","authors":"Munawar Hayat, Mohammed Bennamoun, Senjian An","year":"2014","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Hayat et al., 2015] Munawar Hayat, Mohammed Ben- namoun, and Senjian An. Deep reconstruction models for image set classification. TPAMI, 37(4):713-727, 2015.","title":"Deep reconstruction models for image set classification","authors":"Munawar Hayat, Mohammed Bennamoun, Senjian An","year":"2015","venue":"TPAMI","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Hu et al., 2012] Yiqun Hu, Ajmal S. Mian, and Robyn Owens. Face recognition using sparse approximated near- est points between image sets. TPAMI, 34(10):1992-2004, 2012.","title":"Face recognition using sparse approximated nearest points between image sets","authors":"Yiqun Hu, Ajmal S Mian, Robyn Owens","year":"2012","venue":"TPAMI","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Huang et al., 2015] Zhiwu Huang, Shiguang Shan, Ruip- ing Wang, Haihong Zhang, Shihong Lao, Alifu Kuerban, and Xilin Chen. A benchmark and comparative study of video-based face recognition on cox face database. TIP, 24(12):5967-5981, 2015.","title":"A benchmark and comparative study of video-based face recognition on cox face database","authors":"Zhiwu Huang, Shiguang Shan, Ruiping Wang, Haihong Zhang, Shihong Lao, Alifu Kuerban, Xilin Chen","year":"2015","venue":"TIP","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Kim et al., 2008] Minyoung Kim, Sanjiv Kumar, Vladimir Pavlovic, and Henry Rowley. Face tracking and recogni- tion with visual constraints in real-world videos. In CVPR, pages 1-8, 2008.","title":"Face tracking and recognition with visual constraints in real-world videos","authors":"Minyoung Kim, Sanjiv Kumar, Vladimir Pavlovic, Henry Rowley","year":"2008","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Lathauwer et al., 2000] Lieven De Lathauwer, Bart De Moor, and Joos Vandewalle. On the best rank-1 and rank-(r1, r2,..., rn) approximation of higher-order tensors. SIMAX, 21(4):1324-1342, 2000.","title":"On the best rank-1 and rank-(r1, r2,..., rn) approximation of higher-order tensors","authors":"Lieven De Lathauwer, Bart De Moor, Joos Vandewalle","year":"2000","venue":"SIMAX","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Li and Schonfeld, 2014] Qun Li and Dan Schonfeld. Mul- tilinear discriminant analysis for higher-order tensor data classification. TPAMI, 36(12):2524-2537, 2014.","title":"Multilinear discriminant analysis for higher-order tensor data classification","authors":"Qun Li, Dan Schonfeld","year":"2014","venue":"TPAMI","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Lu et al., 2013] Jiwen Lu, Gang Wang, and Pierre Moulin. Image set classification using holistic multiple order statis- tics features and localized multi-kernel metric learning. In ICCV, pages 329-336, 2013.","title":"Image set classification using holistic multiple order statistics features and localized multi-kernel metric learning","authors":"Jiwen Lu, Gang Wang, Pierre Moulin","year":"2013","venue":"ICCV","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Lu et al., 2014] Jiwen Lu, Gang Wang, Weihong Deng, and Pierre Moulin. Simultaneous feature and dictionary learn- ing for image set based face recognition. In ECCV, pages 265-280, 2014.","title":"Simultaneous feature and dictionary learning for image set based face recognition","authors":"Jiwen Lu, Gang Wang, Weihong Deng, Pierre Moulin","year":"2014","venue":"ECCV","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Peng et al., 2014] Yi Peng, Deyu Meng, Zongben Xu, Chenqiang Gao, Yi Yang, and Biao Zhang. Decompos- able nonlocal tensor dictionary learning for multispectral image denoising. In CVPR, pages 2949-2956, 2014.","title":"Decomposable nonlocal tensor dictionary learning for multispectral image denoising","authors":"Yi Peng, Deyu Meng, Zongben Xu, Chenqiang Gao, Yi Yang, Biao Zhang","year":"2014","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Quan et al., 2015] Yuhui Quan, Yan Huang, and Hui Ji. Dy- namic texture recognition via orthogonal tensor dictionary learning. In ICCV, pages 73-81, 2015.","title":"Dynamic texture recognition via orthogonal tensor dictionary learning","authors":"Yuhui Quan, Yan Huang, Hui Ji","year":"2015","venue":"ICCV","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Roemer et al., 2014] Florian Roemer, Giovanni Del Galdo, and Martin Haardt. Tensor-based algorithms for learn- ing multidimensional separable dictionaries. In ICASSP, pages 3963-3967, 2014.","title":"Tensor-based algorithms for learning multidimensional separable dictionaries","authors":"Florian Roemer, Giovanni Del Galdo, Martin Haardt","year":"2014","venue":"ICASSP","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Shah et al., 2016] Syed Afaq Ali Shah, Mohammed Ben- namoun, and Farid Boussaid. Iterative deep learning for image set based face and object recognition. Neurocom- puting, 174:866-874, 2016.","title":"Iterative deep learning for image set based face and object recognition","authors":"Syed Afaq, Ali Shah, Mohammed Bennamoun, Farid Boussaid","year":"2016","venue":"Neurocomputing","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Viola and Jones, 2004] Paul Viola and Michael J. Jones. Robust real-time face detection. IJCV, 57(2):137-154, 2004.","title":"Robust real-time face detection","authors":"Paul Viola, Michael J Jones","year":"2004","venue":"IJCV","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Wang and Chen, 2009] Ruiping Wang and Xilin Chen. Manifold discriminant analysis. In CVPR, pages 429-436, 2009.","title":"Manifold discriminant analysis","authors":"Wang, Chen ;, Ruiping Wang, Xilin Chen","year":"2009","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Wang et al., 2012] Ruiping Wang, Huimin Guo, Larry S. Davis, and Qionghai Dai. Covariance discriminative learn- ing: A natural and efficient approach to image set classifi- cation. In CVPR, pages 2496-2503, 2012.","title":"Covariance discriminative learning: A natural and efficient approach to image set classification","authors":"Wang","year":"2012","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Wang et al., 2015] Wen Wang, Ruiping Wang, Zhiwu Huang, Shiguang Shan, and Xilin Chen. Discriminant analysis on riemannian manifold of gaussian distribution- s for face recognition with image sets. In CVPR, pages 2048-2057, 2015.","title":"Discriminant analysis on riemannian manifold of gaussian distributions for face recognition with image sets","authors":"Wen Wang, Ruiping Wang, Zhiwu Huang, Shiguang Shan, Xilin Chen","year":"2015","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Wolf et al., 2011] Lior Wolf, Tal Hassner, and Itay Maoz. Face recognition in unconstrained videos with matched background similarity. In CVPR, pages 529-534, 2011.","title":"Face recognition in unconstrained videos with matched background similarity","authors":"Lior Wolf, Tal Hassner, Itay Maoz","year":"2011","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Xu and Yin, 2013] Yangyang Xu and Wotao Yin. A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor fac- torization and completion. SIAM Journal on Imaging Sci- ences, 6(3):1758-1789, 2013.","title":"A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion","authors":"Yin Xu, Yangyang Xu, Wotao Yin","year":"2013","venue":"SIAM Journal on Imaging Sciences","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Zhang et al., 2013] Yangmuzi Zhang, Zhuolin Jiang, and Larry S. Davis. Discriminative tensor sparse coding for image classification. In BMVC, 2013.","title":"Discriminative tensor sparse coding for image classification","authors":"Zhang","year":"2013","venue":"BMVC","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Zhang et al., 2016] Man Zhang, Ran He, Dong Cao, Zhenan Sun, and Tieniu Tan. Simultaneous feature and sample reduction for image-set classification. In AAAI, pages 1401-1407, 2016.","title":"Simultaneous feature and sample reduction for image-set classification","authors":"Zhang","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Zheng et al., 2017] Peng Zheng, Zhong-Qiu Zhao, Jun Gao, and Xindong Wu. Image set classification based on coop- erative sparse representation. PR, 63:206-217, 2017.","title":"Image set classification based on cooperative sparse representation","authors":"Peng Zheng, Zhong-Qiu Zhao, Jun Gao, Xindong Wu","year":"2017","venue":"PR","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Zhu et al., 2014] Pengfei Zhu, Wangmeng Zuo, Lei Zhang, Simon Chi-Keung Shiu, and David Zhang. Image set based collaborative representation for face recognition. TIFS, 9(7):1120-1132, 2014.","title":"Image set based collaborative representation for face recognition","authors":"Pengfei Zhu, Wangmeng Zuo, Lei Zhang, Simon, Chi-Keung Shiu, David Zhang","year":"2014","venue":"TIFS","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Zubair et al., 2014] Syed Zubair, Wenwu Wang, and Jonathon Chambers. Discriminative tensor dictionaries and sparsity for speaker identification. In HSCMA, pages 37-41, 2014.","title":"Discriminative tensor dictionaries and sparsity for speaker identification","authors":"Wenwu Syed Zubair, Jonathon Wang, Chambers","year":"2014","venue":"HSCMA","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}