{"type":"ScholarlyArticle","title":"Vision Shared and Representation Isolated Network for Person Search","authors":[{"name":"Yang Liu","slug":"yang-liu","given":"Yang","family":"Liu","affiliation":"School of Innovation and Entrepreneurship , Dalian University of Technology"},{"name":"Yingping Li","slug":"yingping-li","given":"Yingping","family":"Li","affiliation":"Faculty of Electronic Information and Electrical Engineering , Dalian University of Technology"},{"name":"Chengyu Kong","slug":"chengyu-kong","given":"Chengyu","family":"Kong","affiliation":"Faculty of Electronic Information and Electrical Engineering , Dalian University of Technology"},{"name":"Yuqiu Kong","slug":"yuqiu-kong","given":"Yuqiu","family":"Kong","affiliation":"School of Innovation and Entrepreneurship , Dalian University of Technology"},{"name":"Shenglan Liu","slug":"shenglan-liu","given":"Shenglan","family":"Liu","affiliation":"School of Innovation and Entrepreneurship , Dalian University of Technology"},{"name":"Feilong Wang","slug":"feilong-wang","given":"Feilong","family":"Wang","affiliation":"School of Innovation and Entrepreneurship , Dalian University of Technology"}],"abstract":"Person search is a widely-concerned computer vision task that aims to jointly solve the problems of pedestrian detection and person re-identification in panoramic scenes. However, the pedestrian detection focuses on the consistency of pedestrians, while the person re-identification attempts to extract the discriminative features of pedestrians. The inevitable conflict greatly restricts the researches on the one-stage person search methods. To address this issue, we propose a Vision Shared and Representation Isolated (VSRI) network to decouple the two conflicted subtasks simultaneously, through which two independent representations are constructed for the two subtasks. To enhance the discrimination of the re-ID representation, a Multi-Level Feature Fusion (MLFF) module is proposed. The MLFF adopts the Spatial Pyramid Feature Fusion (SPFF) module to obtain diverse features from the stem network. Moreover, the multi-head self-attention mechanism is employed to construct a Multi-head Attention Driven Extraction (MADE) module and the cascaded convolution unit is adopted to devise a Feature Decomposition and Cascaded Integration  (FDCI) module, which facilitates the MLFF to obtain more discriminative representations of the pedestrians. The proposed method outperforms the state-of-the-art methods on the mainstream datasets.","doi":"10.24963/ijcai.2022/170","url":"https://ijcai.org/proceedings/2022/170","pdf":"https://ijcai.org/proceedings/2022/0170.pdf","markdown":"https://ijcai.org/proceedings/2022/170.md","bibtex":"https://ijcai.org/proceedings/2022/bibtex/170","volume":{"slug":"2022","title":"Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2022","url":"https://ijcai.org/proceedings/2022/","year":2022,"location":"Vienna","dates":"23-29 July 2022","editors":"Luc De Raedt","isbn":"978-1-956792-00-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2022"},"section":"Computer Vision","track":"Main Track","number":170,"pages":{"first":1216,"last":1222},"keywords":["Computer Vision: Recognition (object detection, categorization)","Computer Vision: Applications","Computer Vision: Image and Video retrieval"],"videos":[{"label":"Video #1","url":"https://slideslive.com/38986943","length_sec":86,"provider":"slideslive"},{"label":"Video #2","url":"https://slideslive.com/38985086","length_sec":347,"provider":"slideslive"}],"references":[{"position":1,"raw":"[Chang et al., 2018] Xiaojun Chang, Po-Yao Huang, Yi- Dong Shen, Xiaodan Liang, Yi Yang, and Alexander G Hauptmann. Rcaa: Relational context-aware agents for person search. In Proceedings of the European Confer- ence on Computer Vision (ECCV), pages 84-100, 2018.","title":"Rcaa: Relational context-aware agents for person search","authors":"Xiaojun Chang, Po-Yao Huang, Yi-Dong Shen, Xiaodan Liang, Yi Yang, Alexander G Hauptmann","year":"2018","venue":"Proceedings of the European Conference on Computer Vision (ECCV)","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Chen et al., 2018] Di Chen, Shanshan Zhang, Wanli Ouyang, Jian Yang, and Ying Tai. Person search via a mask-guided two-stream cnn model. In Proceedings of the european conference on computer vision (ECCV), pages 734-750, 2018.","title":"Person search via a mask-guided two-stream cnn model","authors":"Di Chen, Shanshan Zhang, Wanli Ouyang, Jian Yang, Ying Tai","year":"2018","venue":"Proceedings of the european conference on computer vision (ECCV)","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chen et al., 2020a] Di Chen, Shanshan Zhang, Wanli Ouyang, Jian Yang, and Bernt Schiele. Hierarchical online instance matching for person search. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 10518-10525, 2020.","title":"Hierarchical online instance matching for person search","authors":"Chen","year":"2020","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen et al., 2020b] Di Chen, Shanshan Zhang, Jian Yang, and Bernt Schiele. Norm-aware embedding for efficient person search. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, pages 12615-12624, 2020.","title":"Norm-aware embedding for efficient person search","authors":"Chen","year":"2020","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Dong et al., 2020a] Wenkai Dong, Zhaoxiang Zhang, Chunfeng Song, and Tieniu Tan. Bi-directional interac- tion network for person search. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2839-2848, 2020.","title":"Bi-directional interaction network for person search","authors":"Dong","year":"2020","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Dong et al., 2020b] Wenkai Dong, Zhaoxiang Zhang, Chunfeng Song, and Tieniu Tan. Instance guided pro- posal network for person search. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2585-2594, 2020.","title":"Instance guided proposal network for person search","authors":"Dong","year":"2020","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Gao et al., 2019] Shanghua Gao, Ming-Ming Cheng, Kai Zhao, Xin-Yu Zhang, Ming-Hsuan Yang, and Philip HS Torr. Res2net: A new multi-scale backbone architecture. IEEE transactions on pattern analysis and machine intel- ligence, 2019.","title":"Res2net: A new multi-scale backbone architecture","authors":"Gao","year":"2019","venue":"IEEE transactions on pattern analysis and machine intelligence","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Han et al., 2019] Chuchu Han, Jiacheng Ye, Yunshan Zhong, Xin Tan, Chi Zhang, Changxin Gao, and Nong Sang. Re-id driven localization refinement for person search. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 9814-9823, 2019.","title":"Re-id driven localization refinement for person search","authors":"Chuchu Han, Jiacheng Ye, Yunshan Zhong, Xin Tan, Chi Zhang, Changxin Gao, Nong Sang","year":"2019","venue":"Proceedings of the IEEE/CVF International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Han et al., 2021] Chuchu Han, Zhedong Zheng, Changxin Gao, Nong Sang, and Yi Yang. Decoupled and memory- reinforced networks: Towards effective feature learning for one-step person search. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 1505-1512, 2021.","title":"Decoupled and memoryreinforced networks: Towards effective feature learning for one-step person search","authors":"Chuchu Han, Zhedong Zheng, Changxin Gao, Nong Sang, Yi Yang","year":"2021","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[He et al., 2016] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770-778, 2016.","title":"Deep residual learning for image recognition","authors":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun","year":"2016","venue":"Proceedings of the IEEE conference on computer vision and pattern recognition","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Lan et al., 2018] Xu Lan, Xiatian Zhu, and Shaogang Gong. Person search by multi-scale matching. In Proceedings of the European conference on computer vision (ECCV), pages 536-552, 2018.","title":"Person search by multi-scale matching","authors":"Xiatian Xu Lan, Shaogang Zhu, Gong","year":"2018","venue":"Proceedings of the European conference on computer vision (ECCV)","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Liu et al., 2017] Hao Liu, Jiashi Feng, Zequn Jie, Kar- lekar Jayashree, Bo Zhao, Meibin Qi, Jianguo Jiang, and Shuicheng Yan. Neural person search machines. In Pro- ceedings of the IEEE International Conference on Com- puter Vision, pages 493-501, 2017.","title":"Neural person search machines","authors":"Hao Liu, Jiashi Feng, Zequn Jie, Karlekar Jayashree, Bo Zhao, Meibin Qi, Jianguo Jiang, Shuicheng Yan","year":"2017","venue":"Proceedings of the IEEE International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Ren et al., 2015] Shaoqing Ren, Kaiming He, Ross Gir- shick, and Jian Sun. Faster r-cnn: Towards real-time ob- ject detection with region proposal networks. Advances in neural information processing systems, 28:91-99, 2015.","title":"Faster r-cnn: Towards real-time object detection with region proposal networks","authors":"Ren","year":"2015","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Advances in neural information processing sys- tems, pages 5998-6008, 2017.","title":"Attention is all you need","authors":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, Illia Polosukhin","year":"2017","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Wang et al., 2020] Cheng Wang, Bingpeng Ma, Hong Chang, Shiguang Shan, and Xilin Chen. Tcts: A task- consistent two-stage framework for person search. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11952-11961, 2020.","title":"Tcts: A taskconsistent two-stage framework for person search","authors":"Cheng Wang, Bingpeng Ma, Hong Chang, Shiguang Shan, Xilin Chen","year":"2020","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Xiao et al., 2016] Tong Xiao, Shuang Li, Bochao Wang, Liang Lin, and Xiaogang Wang. End-to-end deep learn- ing for person search. arXiv preprint arXiv:1604.01850, 2(2):4, 2016.","title":"End-to-end deep learning for person search","authors":"Tong Xiao, Shuang Li, Bochao Wang, Liang Lin, Xiaogang Wang","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Xiao et al., 2017] Tong Xiao, Shuang Li, Bochao Wang, Liang Lin, and Xiaogang Wang. Joint detection and identi- fication feature learning for person search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3415-3424, 2017.","title":"Joint detection and identification feature learning for person search","authors":"Tong Xiao, Shuang Li, Bochao Wang, Liang Lin, Xiaogang Wang","year":"2017","venue":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Xiao et al., 2019] Jimin Xiao, Yanchun Xie, Tammam Tillo, Kaizhu Huang, Yunchao Wei, and Jiashi Feng. Ian: the individual aggregation network for person search. Pattern Recognition, 87:332-340, 2019.","title":"Ian: the individual aggregation network for person search","authors":"Jimin Xiao, Yanchun Xie, Tammam Tillo, Kaizhu Huang, Yunchao Wei, Jiashi Feng","year":"2019","venue":"Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Xu et al., 2014] Yuanlu Xu, Bingpeng Ma, Rui Huang, and Liang Lin. Person search in a scene by jointly modeling people commonness and person uniqueness. In Proceed- ings of the 22nd ACM international conference on Multi- media, pages 937-940, 2014.","title":"Person search in a scene by jointly modeling people commonness and person uniqueness","authors":"Xu","year":"2014","venue":"Proceedings of the 22nd ACM international conference on Multimedia","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Yan et al., 2019] Yichao Yan, Qiang Zhang, Bingbing Ni, Wendong Zhang, Minghao Xu, and Xiaokang Yang. Learning context graph for person search. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, pages 2158-2167, 2019.","title":"Learning context graph for person search","authors":"Yichao Yan, Qiang Zhang, Bingbing Ni, Wendong Zhang, Minghao Xu, Xiaokang Yang","year":"2019","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Zhang et al., 2021] Xinyu Zhang, Xinlong Wang, Jia-Wang Bian, Chunhua Shen, and Mingyu You. Diverse knowl- edge distillation for end-to-end person search. In Proceed- ings of the AAAI Conference on Artificial Intelligence, vol- ume 35, pages 3412-3420, 2021.","title":"Diverse knowledge distillation for end-to-end person search","authors":"Xinyu Zhang, Xinlong Wang, Jia-Wang Bian, Chunhua Shen, Mingyu You","year":"2021","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Zheng et al., 2017] Liang Zheng, Hengheng Zhang, Shaoyan Sun, Manmohan Chandraker, Yi Yang, and Qi Tian. Person re-identification in the wild. In Proceed- ings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1367-1376, 2017.","title":"Person re-identification in the wild","authors":"Liang Zheng, Hengheng Zhang, Shaoyan Sun, Manmohan Chandraker, Yi Yang, Qi Tian","year":"2017","venue":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}