{"type":"ScholarlyArticle","title":"Salient Object Detection with Semantic Priors","authors":[{"name":"Tam V. Nguyen","slug":"tam-v-nguyen","given":"Tam V.","family":"Nguyen","affiliation":"Department of Computer Science University of Dayton"},{"name":"Luoqi Liu","slug":"luoqi-liu","given":"Luoqi","family":"Liu","affiliation":"Department of ECE National University of Singapore"}],"abstract":"Salient object detection has increasingly become a popular topic in cognitive and computational sciences, including computer vision and artificial intelligence research. In this paper, we propose integrating semantic priors into the salient object detection process. Our algorithm consists of three basic steps. Firstly, the explicit saliency map is obtained based on the semantic segmentation refined by the explicit saliency priors learned from the data. Next, the implicit saliency map is computed based on a trained model which maps the implicit saliency priors embedded into regional features with the saliency values. Finally, the explicit semantic map and the implicit map are adaptively fused to form a pixel-accurate saliency map which uniformly covers the objects of interest. We further evaluate the proposed framework on two challenging datasets, namely, ECSSD and HKUIS. The extensive experimental results demonstrate that our method outperforms other state-of-the-art methods.","doi":"10.24963/ijcai.2017/628","url":"https://ijcai.org/proceedings/2017/628","pdf":"https://ijcai.org/proceedings/2017/0628.pdf","markdown":"https://ijcai.org/proceedings/2017/628.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/628","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Robotics and Vision","track":"Main track","number":628,"pages":{"first":4499,"last":4505},"keywords":["Robotics and Vision: Robotics and Vision","Robotics and Vision: Vision and Perception"],"videos":[],"references":[{"position":1,"raw":"[Achanta et al., 2009] Radhakrishna Achanta, Sheila S. Hemami, Francisco J. Estrada, and Sabine Süsstrunk. Frequency-tuned salient region detection. In CVPR, pages 1597-1604, 2009.","title":"Frequency-tuned salient region detection","authors":"Radhakrishna Achanta, Sheila S Hemami, Francisco J Estrada, Sabine Süsstrunk","year":"2009","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Achanta et al., 2012] Radhakrishna Achanta, Appu Shaji, Kevin Smith, Aurélien Lucchi, Pascal Fua, and Sabine Süsstrunk. SLIC superpixels compared to state-of-the-art superpixel meth- ods. IEEE T-PAMI, 34(11):2274-2282, 2012.","title":"SLIC superpixels compared to state-of-the-art superpixel methods","authors":"Radhakrishna Achanta, Appu Shaji, Kevin Smith, Aurélien Lucchi, Pascal Fua, Sabine Süsstrunk","year":"2012","venue":"IEEE T-PAMI","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bruce and Tsotsos, 2005] Neil D. B. Bruce and John K. Tsotsos. Saliency based on information maximization. In NIPS, 2005.","title":"Saliency based on information maximization","authors":"D B Neil, John K Bruce, Tsotsos","year":"2005","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen et al., 2014] Yanxiang Chen, Tam V. Nguyen, Mohan S. Kankanhalli, Jun Yuan, Shuicheng Yan, and Meng Wang. Audio matters in visual attention. T-CSVT, 24(11):1992-2003, 2014.","title":"Audio matters in visual attention","authors":"Yanxiang Chen, Tam V Nguyen, Mohan S Kankanhalli, Jun Yuan, Shuicheng Yan, Meng Wang","year":"2014","venue":"T-CSVT","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cheng et al., 2011] Ming-Ming Cheng, Guo-Xin Zhang, Niloy J. Mitra, Xiaolei Huang, and Shi-Min Hu. Global contrast based salient region detection. In CVPR, pages 409-416, 2011.","title":"Global contrast based salient region detection","authors":"Ming-Ming Cheng, Guo-Xin Zhang, Niloy J Mitra, Xiaolei Huang, Shi-Min Hu","year":"2011","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Everingham et al., 2010] Mark Everingham, Luc J. Van Gool, Christopher K. I. Williams, John M. Winn, and Andrew Zisser- man. The pascal visual object classes (VOC) challenge. IJCV, 88(2):303-338, 2010.","title":"The pascal visual object classes (VOC) challenge","authors":"Mark Everingham, J Luc, Van Gool, K I Christopher, John M Williams, Andrew Winn, Zisserman","year":"2010","venue":"IJCV","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Goferman et al., 2010] Stas Goferman, Lihi Zelnik-Manor, and Ayellet Tal. Context-aware saliency detection. In CVPR, pages 2376-2383, 2010.","title":"Context-aware saliency detection","authors":"Lihi Stas Goferman, Ayellet Zelnik-Manor, Tal","year":"2010","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Itti et al., 1998] Laurent Itti, Christof Koch, and Ernst Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE T-PAMI, 20(11):1254-1259, 1998.","title":"A model of saliency-based visual attention for rapid scene analysis","authors":"Laurent Itti, Christof Koch, Ernst Niebur","year":"1998","venue":"IEEE T-PAMI","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Jiang et al., 2013] Huaizu Jiang, Jingdong Wang, Zejian Yuan, Yang Wu, Nanning Zheng, and Shipeng Li. Salient object de- tection: A discriminative regional feature integration approach. In CVPR, pages 2083-2090, 2013.","title":"Salient object detection: A discriminative regional feature integration approach","authors":"Huaizu Jiang, Jingdong Wang, Zejian Yuan, Yang Wu, Nanning Zheng, Shipeng Li","year":"2013","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kim et al., 2014] Jiwhan Kim, Dongyoon Han, Yu-Wing Tai, and Junmo Kim. Salient region detection via high-dimensional color transform. In CVPR, pages 883-890, 2014.","title":"Salient region detection via high-dimensional color transform","authors":"Kim","year":"2014","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Koch and Ullman, 1985] C Koch and S Ullman. Shifts in selective visual attention: towards the underlying neural circuitry. Hum Neurobiol, 1985.","title":"Shifts in selective visual attention: towards the underlying neural circuitry","authors":"C Koch, S Ullman","year":"1985","venue":"Hum Neurobiol","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Krizhevsky et al., 2012] Alex Krizhevsky, Ilya Sutskever, and Ge- offrey E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, pages 1106-1114, 2012.","title":"Imagenet classification with deep convolutional neural networks","authors":"Alex Krizhevsky, Ilya Sutskever, Geoffrey E Hinton","year":"2012","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Lang et al., 2012] Congyan Lang, Tam V. Nguyen, Harish Katti, Karthik Yadati, Mohan S. Kankanhalli, and Shuicheng Yan. Depth matters: Influence of depth cues on visual saliency. In ECCV, pages 101-115, 2012.","title":"Depth matters: Influence of depth cues on visual saliency","authors":"Lang","year":"2012","venue":"ECCV","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Leung and Malik, 2001] Thomas K. Leung and Jitendra Malik. Representing and recognizing the visual appearance of materials using three-dimensional textons. IJCV, 43(1):29-44, 2001.","title":"Representing and recognizing the visual appearance of materials using three-dimensional textons","authors":"Thomas K Leung, Jitendra Malik","year":"2001","venue":"IJCV","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Li and Yu, 2015] Guanbin Li and Yizhou Yu. Visual saliency based on multiscale deep features. In CVPR, pages 5455-5463, 2015.","title":"Visual saliency based on multiscale deep features","authors":"Yu ; ] Guanbin Li, Yizhou Li, Yu","year":"2015","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Li et al., 2016] Xi Li, Liming Zhao, Lina Wei, Ming-Hsuan Yang, Fei Wu, Yueting Zhuang, Haibin Ling, and Jingdong Wang. Deepsaliency: Multi-task deep neural network model for salient object detection. IEEE T-IP, 25(8):3919-3930, 2016.","title":"Deepsaliency: Multi-task deep neural network model for salient object detection","authors":"Xi Li, Liming Zhao, Lina Wei, Ming-Hsuan Yang, Fei Wu, Yueting Zhuang, Haibin Ling, Jingdong Wang","year":"2016","venue":"IEEE T-IP","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Liu et al., 2011] Ce Liu, Jenny Yuen, and Antonio Torralba. Non- parametric scene parsing via label transfer. IEEE T-PAMI, 33(12):2368-2382, 2011.","title":"Nonparametric scene parsing via label transfer","authors":"Ce Liu, Jenny Yuen, Antonio Torralba","year":"2011","venue":"IEEE T-PAMI","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Long et al., 2015] Jonathan Long, Evan Shelhamer, and Trevor Darrell. Fully convolutional networks for semantic segmentation. In CVPR, pages 3431-3440, 2015.","title":"Fully convolutional networks for semantic segmentation","authors":"Jonathan Long, Evan Shelhamer, Trevor Darrell","year":"2015","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Margolin et al., 2013] Ran Margolin, Ayellet Tal, and Lihi Zelnik- Manor. What makes a patch distinct? In CVPR, pages 1139- 1146, 2013.","title":"What makes a patch distinct?","authors":"Margolin","year":"2013","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Murray et al., 2011] Naila Murray, Maria Vanrell, Xavier Otazu, and C. Alejandro Párraga. Saliency estimation using a non- parametric low-level vision model. In CVPR, pages 433-440, 2011.","title":"Saliency estimation using a nonparametric low-level vision model","authors":"Naila Murray, Maria Vanrell, Xavier Otazu, C Alejandro Párraga","year":"2011","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Nguyen and Sepulveda, 2015] Tam V. Nguyen and Jose Sepul- veda. Salient object detection via augmented hypotheses. In IJCAI, pages 2176-2182, 2015.","title":"Salient object detection via augmented hypotheses","authors":"Tam V Nguyen, Jose Sepulveda","year":"2015","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2015/308"},{"position":22,"raw":"[Nguyen et al., 2013a] Tam V. Nguyen, Bingbing Ni, Hairong Liu, Wei Xia, Jiebo Luo, Mohan S. Kankanhalli, and Shuicheng Yan. Image re-attentionizing. IEEE T-MM, 15(8):1910-1919, 2013.","title":"Image re-attentionizing","authors":"Nguyen","year":"2013","venue":"IEEE T-MM","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Nguyen et al., 2013b] Tam V. Nguyen, Mengdi Xu, Guangyu Gao, Mohan S. Kankanhalli, Qi Tian, and Shuicheng Yan. Static saliency vs. dynamic saliency: a comparative study. In ACM Mul- timedia, pages 987-996, 2013.","title":"Static saliency vs. dynamic saliency: a comparative study","authors":"Nguyen","year":"2013","venue":"ACM Multimedia","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Nguyen et al., 2015a] Tam V. Nguyen, Canyi Lu, Jose Sepulveda, and Shuicheng Yan. Adaptive nonparametric image parsing. T- CSVT, 25(10):1565-1575, 2015.","title":"Adaptive nonparametric image parsing","authors":"Nguyen","year":"2015","venue":"T-CSVT","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Nguyen et al., 2015b] Tam V. Nguyen, Zheng Song, and Shuicheng Yan. STAP: spatial-temporal attention-aware pooling for action recognition. T-CSVT, 25(1):77-86, 2015.","title":"STAP: spatial-temporal attention-aware pooling for action recognition","authors":"Nguyen","year":"2015","venue":"T-CSVT","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Nguyen et al., 2016] Tam V. Nguyen, Luoqi Liu, and Khang Nguyen. Exploiting generic multi-level convolutional neural net- works for scene understanding. In ICARCV, pages 1-6, 2016.","title":"Exploiting generic multi-level convolutional neural networks for scene understanding","authors":"V Tam, Luoqi Nguyen, Khang Liu, Nguyen","year":"2016","venue":"ICARCV","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Ni et al., 2014] Bingbing Ni, Mengdi Xu, Tam V. Nguyen, Meng Wang, Congyan Lang, ZhongYang Huang, and Shuicheng Yan. Touch saliency: Characteristics and prediction. IEEE T-MM, 16(6):1779-1791, 2014.","title":"Touch saliency: Characteristics and prediction","authors":"Bingbing Ni, Mengdi Xu, Tam V Nguyen, Meng Wang, Congyan Lang, Zhongyang Huang, Shuicheng Yan","year":"2014","venue":"IEEE T-MM","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Perazzi et al., 2012] Federico Perazzi, Philipp Krähenbühl, Yael Pritch, and Alexander Hornung. Saliency filters: Contrast based filtering for salient region detection. In CVPR, pages 733-740, 2012.","title":"Saliency filters: Contrast based filtering for salient region detection","authors":"Federico Perazzi, Philipp Krähenbühl, Yael Pritch, Alexander Hornung","year":"2012","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Tighe and Lazebnik, 2013] Joseph Tighe and Svetlana Lazebnik. Finding things: Image parsing with regions and per-exemplar de- tectors. In CVPR, pages 3001-3008, 2013.","title":"Finding things: Image parsing with regions and per-exemplar detectors","authors":"Lazebnik Tighe, Joseph Tighe, Svetlana Lazebnik","year":"2013","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Wang et al., 2015] Lijun Wang, Huchuan Lu, Xiang Ruan, and Ming-Hsuan Yang. Deep networks for saliency detection via lo- cal estimation and global search. In CVPR, pages 3183-3192, 2015.","title":"Deep networks for saliency detection via local estimation and global search","authors":"Lijun Wang, Huchuan Lu, Xiang Ruan, Ming-Hsuan Yang","year":"2015","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Yan et al., 2013] Qiong Yan, Li Xu, Jianping Shi, and Jiaya Jia. Hierarchical saliency detection. In CVPR, pages 1155-1162, 2013.","title":"Hierarchical saliency detection","authors":"Qiong Yan, Li Xu, Jianping Shi, Jiaya Jia","year":"2013","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Zhai and Shah, 2006] Yun Zhai and Mubarak Shah. Visual atten- tion detection in video sequences using spatiotemporal cues. In ACM Multimedia, pages 815-824, 2006.","title":"Visual attention detection in video sequences using spatiotemporal cues","authors":"Zhai, ; Shah, Yun Zhai, Mubarak Shah","year":"2006","venue":"ACM Multimedia","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Zhang and Sclaroff, 2016] Jianming Zhang and Stan Sclaroff. Ex- ploiting surroundedness for saliency detection: A boolean map approach. IEEE T-PAMI, 38(5):889-902, 2016.","title":"Exploiting surroundedness for saliency detection: A boolean map approach","authors":"Jianming Zhang, Stan Sclaroff","year":"2016","venue":"IEEE T-PAMI","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Zhang et al., 2008] Lingyun Zhang, Matthew H. Tong, Tim K. Marks, Honghao Shan, and Garrison W. Cottrell. Sun: A bayesian framework for saliency using natural statistics. Jour- nal of Vision, 8(7), 2008.","title":"Sun: A bayesian framework for saliency using natural statistics","authors":"Lingyun Zhang, Matthew H Tong, Tim K Marks, Honghao Shan, Garrison W Cottrell","year":"2008","venue":"Journal of Vision","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Zheng et al., 2015] Shuai Zheng, Sadeep Jayasumana, Bernardino Romera-Paredes, Vibhav Vineet, Zhizhong Su, Dalong Du, Chang Huang, and Philip H. S. Torr. Conditional random fields as recurrent neural networks. In ICCV, pages 1529-1537, 2015.","title":"Conditional random fields as recurrent neural networks","authors":"Shuai Zheng, Sadeep Jayasumana, Bernardino Romera-Paredes, Vibhav Vineet, Zhizhong Su, Dalong Du, Chang Huang, Philip H S Torr","year":"2015","venue":"ICCV","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}