{"type":"ScholarlyArticle","title":"GSM: Graph Similarity Model for Multi-Object Tracking","authors":[{"name":"Qiankun Liu","slug":"qiankun-liu","given":"Qiankun","family":"Liu","affiliation":"University of Science and Technology of China , China"},{"name":"Qi Chu","slug":"qi-chu","given":"Qi","family":"Chu","affiliation":"University of Science and Technology of China , China"},{"name":"Bin Liu","slug":"bin-liu","given":"Bin","family":"Liu","affiliation":"University of Science and Technology of China , China"},{"name":"Nenghai Yu","slug":"nenghai-yu","given":"Nenghai","family":"Yu","affiliation":"University of Science and Technology of China , China"}],"abstract":"The popular tracking-by-detection paradigm for multi-object tracking (MOT) focuses on solving data association problem, of which a robust similarity model lies in the heart. Most previous works make effort to improve feature representation for individual object while leaving the relations among objects less explored, which may be problematic in some complex scenarios. In this paper, we focus on leveraging the relations among objects to improve robustness of the similarity model. To this end, we propose a novel graph representation that takes both the feature of individual object and the relations among objects into consideration. Besides, a graph matching module is specially designed for the proposed graph representation to alleviate the impact of unreliable relations. With the help of the graph representation and the graph matching module, the proposed graph similarity model, named GSM, is more robust to the occlusion and the targets sharing similar appearance. We conduct extensive experiments on challenging MOT benchmarks and the experimental results demonstrate the effectiveness of the proposed method.","doi":"10.24963/ijcai.2020/74","url":"https://ijcai.org/proceedings/2020/74","pdf":"https://ijcai.org/proceedings/2020/0074.pdf","markdown":"https://ijcai.org/proceedings/2020/74.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/74","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Computer Vision","track":"Main track","number":74,"pages":{"first":530,"last":536},"keywords":["Computer Vision: Motion and Tracking"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/24321/file_24321.m3u8","length_sec":221,"provider":"hls"}],"references":[{"position":1,"raw":"[Bergmann et al., 2019] Philipp Bergmann, Tim Meinhardt, and Laura Leal-Taixe. Tracking without bells and whistles. In ICCV, pages 941-951, 2019.","title":"Tracking without bells and whistles","authors":"Philipp Bergmann, Tim Meinhardt, Laura Leal-Taixe","year":"2019","venue":"ICCV","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bernardin and Stiefelhagen, 2008] Keni Bernardin and Rainer Stiefelhagen. Evaluating multiple object tracking performance: the clear mot metrics. Journal on Image and Video Processing, 2008:1, 2008.","title":"Evaluating multiple object tracking performance: the clear mot metrics","authors":"Stiefelhagen Bernardin, Keni Bernardin, Rainer Stiefelhagen","year":"2008","venue":"Journal on Image and Video Processing","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Breitenstein et al., 2009] Michael D Breitenstein, Fabian Reichlin, Bastian Leibe, Esther Koller-Meier, and Luc Van Gool. Robust tracking-by-detection using a detec- tor confidence particle filter. In ICCV, pages 1515-1522. IEEE, 2009.","title":"Robust tracking-by-detection using a detector confidence particle filter","authors":"Fabian Michael D Breitenstein, Bastian Reichlin, Esther Leibe, Luc Koller-Meier, Van Gool","year":"2009","venue":"ICCV","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen et al., 2018] Long Chen, Haizhou Ai, Zijie Zhuang, and Chong Shang. Real-time multiple people tracking with deeply learned candidate selection and person re- identification. In ICME, pages 1-6. IEEE, 2018.","title":"Real-time multiple people tracking with deeply learned candidate selection and person reidentification","authors":"Long Chen, Haizhou Ai, Zijie Zhuang, Chong Shang","year":"2018","venue":"ICME","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Chu and Ling, 2019] Peng Chu and Haibin Ling. Famnet: Joint learning of feature, affinity and multi-dimensional assignment for online multiple object tracking. In ICCV, pages 6172-6181, 2019.","title":"Famnet: Joint learning of feature, affinity and multi-dimensional assignment for online multiple object tracking","authors":"Peng Chu, Haibin Ling","year":"2019","venue":"ICCV","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Chu et al., 2017] Qi Chu, Wanli Ouyang, Hongsheng Li, Xiaogang Wang, Bin Liu, and Nenghai Yu. Online multi- object tracking using cnn-based single object tracker with spatial-temporal attention mechanism. In ICCV, pages 4836-4845, 2017.","title":"Online multiobject tracking using cnn-based single object tracker with spatial-temporal attention mechanism","authors":"Qi Chu, Wanli Ouyang, Hongsheng Li, Xiaogang Wang, Bin Liu, Nenghai Yu","year":"2017","venue":"ICCV","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Felzenszwalb et al., 2010] Pedro F Felzenszwalb, Ross B Girshick, David McAllester, and Deva Ramanan. Object detection with discriminatively trained part-based models. TPAMI, 32(9):1627-1645, 2010.","title":"Object detection with discriminatively trained part-based models","authors":"Pedro F Felzenszwalb, Ross B Girshick, David Mcallester, Deva Ramanan","year":"2010","venue":"TPAMI","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Fu et al., 2019] Zeyu Fu, Federico Angelini, Jonathon Chambers, and Syed Mohsen Naqvi. Multi-level coop- erative fusion of gm-phd filters for online multiple human tracking. IEEE Transactions on Multimedia, 21(9):2277- 2291, 2019.","title":"Multi-level cooperative fusion of gm-phd filters for online multiple human tracking","authors":"Fu","year":"2019","venue":"IEEE Transactions on Multimedia","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[He et al., 2016] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. In CVPR, pages 770-778, 2016.","title":"Deep residual learning for image recognition","authors":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun","year":"2016","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Helbing and Molnar, 1995] Dirk Helbing and Peter Molnar. Social force model for pedestrian dynamics. Physical re- view E, 51(5):4282, 1995.","title":"Social force model for pedestrian dynamics","authors":"Molnar Helbing, Dirk Helbing, Peter Molnar","year":"1995","venue":"Physical review E","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Izadinia et al., 2012] Hamid Izadinia, Imran Saleemi, Wen- hui Li, and Mubarak Shah. 2 t: multiple people multiple parts tracker. In ECCV, pages 100-114. Springer, 2012.","title":"2 t: multiple people multiple parts tracker","authors":"Hamid Izadinia, Imran Saleemi, Wenhui Li, Mubarak Shah","year":"2012","venue":"ECCV","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Kuo et al., 2010] Cheng-Hao Kuo, Chang Huang, and Ra- makant Nevatia. Multi-target tracking by on-line learned discriminative appearance models. In CVPR, pages 685- 692. IEEE, 2010.","title":"Multi-target tracking by on-line learned discriminative appearance models","authors":"Cheng-Hao Kuo, Chang Huang, Ramakant Nevatia","year":"2010","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Li et al., 2009] Yuan Li, Chang Huang, and Ram Nevatia. Learning to associate: Hybridboosted multi-target tracker for crowded scene. In CVPR, pages 2953-2960. IEEE, 2009.","title":"Learning to associate: Hybridboosted multi-target tracker for crowded scene","authors":"Yuan Li, Chang Huang, Ram Nevatia","year":"2009","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Maksai and Fua, 2019] Andrii Maksai and Pascal Fua. Eliminating exposure bias and metric mismatch in mul- tiple object tracking. In CVPR, pages 4639-4648, 2019.","title":"Eliminating exposure bias and metric mismatch in multiple object tracking","authors":"Fua Maksai, Andrii Maksai, Pascal Fua","year":"2019","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Milan et al., 2013] Anton Milan, Stefan Roth, and Konrad Schindler. Continuous energy minimization for multitarget tracking. TPAMI, 36(1):58-72, 2013.","title":"Continuous energy minimization for multitarget tracking","authors":"Milan","year":"2013","venue":"TPAMI","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Milan et al., 2016] Anton Milan, Laura Leal-Taixé, Ian Reid, Stefan Roth, and Konrad Schindler. Mot16: A benchmark for multi-object tracking. arXiv preprint arXiv:1603.00831, 2016.","title":"Mot16: A benchmark for multi-object tracking","authors":"Anton Milan, Laura Leal-Taixé, Ian Reid, Stefan Roth, Konrad Schindler","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Pellegrini et al., 2009] Stefano Pellegrini, Andreas Ess, Konrad Schindler, and Luc Van Gool. You'll never walk alone: Modeling social behavior for multi-target tracking. In ICCV, pages 261-268. IEEE, 2009.","title":"You'll never walk alone: Modeling social behavior for multi-target tracking","authors":"Stefano Pellegrini, Andreas Ess, Konrad Schindler, Luc Van Gool","year":"2009","venue":"ICCV","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Ren et al., 2015] Shaoqing Ren, Kaiming He, Ross Gir- shick, and Jian Sun. Faster r-cnn: Towards real-time ob- ject detection with region proposal networks. In Advances in neural information processing systems, pages 91-99, 2015.","title":"Faster r-cnn: Towards real-time object detection with region proposal networks","authors":"Ren","year":"2015","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Sadeghian et al., 2017] Amir Sadeghian, Alexandre Alahi, and Silvio Savarese. Tracking the untrackable: Learning to track multiple cues with long-term dependencies. In ICCV, pages 300-311, 2017.","title":"Tracking the untrackable: Learning to track multiple cues with long-term dependencies","authors":"Alexandre Amir Sadeghian, Silvio Alahi, Savarese","year":"2017","venue":"ICCV","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Advances in neural information processing sys- tems, pages 5998-6008, 2017.","title":"Attention is all you need","authors":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, Illia Polosukhin","year":"2017","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Xiang et al., 2015] Yu Xiang, Alexandre Alahi, and Silvio Savarese. Learning to track: Online multi-object tracking by decision making. In ICCV, pages 4705-4713, 2015.","title":"Learning to track: Online multi-object tracking by decision making","authors":"Yu Xiang, Alexandre Alahi, Silvio Savarese","year":"2015","venue":"ICCV","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Xu et al., 2019] Jiarui Xu, Yue Cao, Zheng Zhang, and Han Hu. Spatial-temporal relation networks for multi-object tracking. In ICCV, pages 3988-3998, 2019.","title":"Spatial-temporal relation networks for multi-object tracking","authors":"Jiarui Xu, Yue Cao, Zheng Zhang, Han Hu","year":"2019","venue":"ICCV","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Yamaguchi et al., 2011] Kota Yamaguchi, Alexander C Berg, Luis E Ortiz, and Tamara L Berg. Who are you with and where are you going? In CVPR, pages 1345-1352. IEEE, 2011.","title":"Who are you with and where are you going?","authors":"Yamaguchi","year":"2011","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Yang and Nevatia, 2012] Bo Yang and Ram Nevatia. Multi- target tracking by online learning of non-linear motion patterns and robust appearance models. In CVPR, pages 1918-1925. IEEE, 2012.","title":"Multitarget tracking by online learning of non-linear motion patterns and robust appearance models","authors":"Yang, Nevatia ; ] Bo Yang, Ram Nevatia","year":"2012","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Yang et al., 2016] Fan Yang, Wongun Choi, and Yuanqing Lin. Exploit all the layers: Fast and accurate cnn object detector with scale dependent pooling and cascaded rejec- tion classifiers. In CVPR, pages 2129-2137, 2016.","title":"Exploit all the layers: Fast and accurate cnn object detector with scale dependent pooling and cascaded rejection classifiers","authors":"Fan Yang, Wongun Choi, Yuanqing Lin","year":"2016","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Yoon et al., 2018] Young-chul Yoon, Abhijeet Boragule, Young-min Song, Kwangjin Yoon, and Moongu Jeon. Online multi-object tracking with historical appearance matching and scene adaptive detection filtering. In AVSS, pages 1-6. IEEE, 2018.","title":"Online multi-object tracking with historical appearance matching and scene adaptive detection filtering","authors":"Yoon","year":"2018","venue":"AVSS","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Zhu et al., 2018] Ji Zhu, Hua Yang, Nian Liu, Minyoung Kim, Wenjun Zhang, and Ming-Hsuan Yang. Online multi-object tracking with dual matching attention net- works. In ECCV, pages 366-382, 2018.","title":"Online multi-object tracking with dual matching attention networks","authors":"Ji Zhu, Hua Yang, Nian Liu, Minyoung Kim, Wenjun Zhang, Ming-Hsuan Yang","year":"2018","venue":"ECCV","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}