{"type":"ScholarlyArticle","title":"Fast Preprocessing for Robust Face Sketch Synthesis","authors":[{"name":"Yibing Song","slug":"yibing-song","given":"Yibing","family":"Song","affiliation":"City University of Hong Kong"},{"name":"Jiawei Zhang","slug":"jiawei-zhang","given":"Jiawei","family":"Zhang","affiliation":"City University of Hong Kong"},{"name":"Linchao Bao","slug":"linchao-bao","given":"Linchao","family":"Bao","affiliation":"Tencent AI Lab"},{"name":"Qingxiong Yang","slug":"qingxiong-yang","given":"Qingxiong","family":"Yang","affiliation":"University of Science and Technology of China"}],"abstract":"Exemplar-based face sketch synthesis methods usually meet the challenging problem that input photos are captured in different lighting conditions from training photos. The critical step causing the failure is the search of similar patch candidates for an input photo patch. Conventional illumination invariant patch distances are adopted rather than directly relying on pixel intensity difference, but they will fail when local contrast within a patch changes. In this paper, we propose a fast preprocessing method named Bidirectional Luminance Remapping (BLR), which interactively adjust the lighting of training and input photos. Our method can be directly integrated into state-of-the-art exemplar-based methods to improve their robustness with ignorable computational cost","doi":"10.24963/ijcai.2017/632","url":"https://ijcai.org/proceedings/2017/632","pdf":"https://ijcai.org/proceedings/2017/0632.pdf","markdown":"https://ijcai.org/proceedings/2017/632.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/632","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Robotics and Vision","track":"Main track","number":632,"pages":{"first":4530,"last":4536},"keywords":["Robotics and Vision: Robotics and Vision","Robotics and Vision: Vision and Perception"],"videos":[],"references":[{"position":1,"raw":"[Aleix and Robert, 1998] Martínez Aleix and Benavente Robert. The ar face database. Technical Report CVC Tech Report 24, Purdue University, 1998.","title":"The ar face database","authors":"Aleix, Robert ;, Martínez Aleix, Benavente Robert","year":"1998","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Han et al., 2010] Hu Han, Shiguang Shan, Laiyun Qing, Xilin Chen, and Wen Gao. Lighting aware preprocessing for face recognition across varying illumination. In Euro- pean Conference on Computer Vision, 2010.","title":"Lighting aware preprocessing for face recognition across varying illumination","authors":"Shiguang Hu Han, Laiyun Shan, Xilin Qing, Wen Chen, Gao","year":"2010","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Hertzmann et al., 2001] Aaron Hertzmann, Charles E Ja- cobs, Nuria Oliver, Brian Curless, and David H Salesin. Image analogies. ACM Transactions on Graphics (SIG- GRAPH), 2001.","title":"Image analogies","authors":"Aaron Hertzmann, Charles E Jacobs, Nuria Oliver, Brian Curless, David H Salesin","year":"2001","venue":"ACM Transactions on Graphics","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Kazemi and Sullivan, 2014] Vahid Kazemi and Josephine Sullivan. One millisecond face alignment with an ensem- ble of regression trees. In IEEE Conference on Computer Vision and Pattern Recognition, 2014.","title":"One millisecond face alignment with an ensemble of regression trees","authors":"Vahid Kazemi, Josephine Sullivan","year":"2014","venue":"IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Levin et al., 2008] Anat Levin, Dani Lischinski, and Yair Weiss. A closed-form solution to natural image matting. IEEE Transactions on Pattern Analysis and Machine In- telligence, 2008.","title":"A closed-form solution to natural image matting","authors":"Levin","year":"2008","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Liu et al., 2007] Wei Liu, Xiaoou Tang, and Jianzhuang Liu. Bayesian tensor inference for sketch-based facial photo hallucination. In International Joint Conference on Artificial Intelligence, 2007.","title":"Bayesian tensor inference for sketch-based facial photo hallucination","authors":"Wei Liu, Xiaoou Tang, Jianzhuang Liu","year":"2007","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2007/345"},{"position":7,"raw":"[Peng et al., 2016a] Chunlei Peng, Xinbo Gao, Nannan Wang, and Jie Li. Graphical representation for hetero- geneous face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016.","title":"Graphical representation for heterogeneous face recognition","authors":"Peng","year":"2016","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Peng et al., 2016b] Chunlei Peng, Nannan Wang, Xinbo Gao, and Jie Li. Face recognition from multiple stylistic sketches: Scenarios, datasets, and evaluation. In European Conference on Computer Vision Workshop, 2016.","title":"Face recognition from multiple stylistic sketches: Scenarios, datasets, and evaluation","authors":"Peng","year":"2016","venue":"European Conference on Computer Vision Workshop","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Pizer et al., 1987] Stephen M Pizer, E Philip Amburn, John D Austin, Robert Cromartie, Ari Geselowitz, Trey Greer, Bart ter Haar Romeny, John B Zimmerman, and Karel Zuiderveld. Adaptive histogram equalization and its variations. Computer vision, graphics, and image process- ing, 1987.","title":"Adaptive histogram equalization and its variations","authors":"E Stephen M Pizer, John D Philip Amburn, Robert Austin, Ari Cromartie, Trey Geselowitz, Bart Greer, Ter Haar, John B Romeny, Karel Zimmerman, Zuiderveld","year":"1987","venue":"Computer vision, graphics, and image processing","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Song et al., 2014] Yibing Song, Linchao Bao, Qingxiong Yang, and Ming-Hsuan Yang. Real-time exemplar-based face sketch synthesis. In European Conference on Com- puter Vision, 2014.","title":"Real-time exemplar-based face sketch synthesis","authors":"Yibing Song, Linchao Bao, Qingxiong Yang, Ming-Hsuan Yang","year":"2014","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Szeliski, 2010] Richard Szeliski. Computer vision: algo- rithms and applications. Springer, 2010.","title":"Computer vision: algorithms and applications","authors":"Richard Szeliski","year":"2010","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Wang and Tang, 2009] Xiaogang Wang and Xiaoou Tang. Face photo-sketch synthesis and recognition. IEEE Trans- actions on Pattern Analysis and Machine Intelligence, 2009.","title":"Face photo-sketch synthesis and recognition","authors":"Wang, Tang, Xiaogang Wang, Xiaoou Tang","year":"2009","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Wang et al., 2012] Shenlong Wang, Lei Zhang, Yan Liang, and Quan Pan. Semi-coupled dictionary learning with ap- plications in image super-resolution and photo-sketch syn- thesis. In IEEE Conference on Computer Vision and Pat- tern Recognition, 2012.","title":"Semi-coupled dictionary learning with applications in image super-resolution and photo-sketch synthesis","authors":"Shenlong Wang, Lei Zhang, Yan Liang, Quan Pan","year":"2012","venue":"IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Wang et al., 2013] Nannan Wang, Dacheng Tao, Xinbo Gao, Xuelong Li, and Jie Li. Transductive face sketch- photo synthesis. IEEE Transactions on Neural Networks and Learning Systems, 2013.","title":"Transductive face sketchphoto synthesis","authors":"Nannan Wang, Dacheng Tao, Xinbo Gao, Xuelong Li, Jie Li","year":"2013","venue":"IEEE Transactions on Neural Networks and Learning Systems","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Wang et al., 2014] Nannan Wang, Dacheng Tao, Xinbo Gao, Xuelong Li, and Jie Li. A comprehensive survey to face hallucination. International Journal of Computer Vision, 2014.","title":"A comprehensive survey to face hallucination","authors":"Nannan Wang, Dacheng Tao, Xinbo Gao, Xuelong Li, Jie Li","year":"2014","venue":"International Journal of Computer Vision","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Wang et al., 2017] Nannan Wang, Xinbo Gao, Leiyu Sun, and Jie Li. Bayesian face sketch synthesis. IEEE Transac- tions on Image Processing, 2017.","title":"Bayesian face sketch synthesis","authors":"Nannan Wang, Xinbo Gao, Leiyu Sun, Jie Li","year":"2017","venue":"IEEE Transactions on Image Processing","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Xie et al., 2008] Xiaohua Xie, Wei-Shi Zheng, Jianhuang Lai, and Pong C. Yuen. Face illumination normalization on large and small scale features. In IEEE Conference on Computer Vision and Pattern Recognition, 2008.","title":"Face illumination normalization on large and small scale features","authors":"Xiaohua Xie, Wei-Shi Zheng, Jianhuang Lai, Pong C Yuen","year":"2008","venue":"IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Zhang et al., 2010] Wei Zhang, Xiaogang Wang, and Xi- aoou Tang. Lighting and pose robust face sketch synthesis. In European Conference on Computer Vision, 2010.","title":"Lighting and pose robust face sketch synthesis","authors":"Wei Zhang, Xiaogang Wang, Xiaoou Tang","year":"2010","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Zhang et al., 2011] Wei Zhang, Xiaogang Wang, and Xi- aoou Tang. Coupled information-theoretic encoding for face photo-sketch recognition. In IEEE Conference on Computer Vision and Pattern Recognition, 2011.","title":"Coupled information-theoretic encoding for face photo-sketch recognition","authors":"Wei Zhang, Xiaogang Wang, Xiaoou Tang","year":"2011","venue":"IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Zhang et al., 2015a] Shengchuan Zhang, Xinbo Gao, Nan- nan Wang, and Jie Li. Face sketch synthesis from a single photo-sketch pair. IEEE Transactions on Circuits and Sys- tems for Video Technology, 2015.","title":"Face sketch synthesis from a single photo-sketch pair","authors":"Zhang","year":"2015","venue":"IEEE Transactions on Circuits and Systems for Video Technology","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Zhang et al., 2015b] Shengchuan Zhang, Xinbo Gao, Nan- nan Wang, Jie Li, and Mingjin Zhang. Face sketch synthe- sis via sparse representation-based greedy search. IEEE Transactions on Image Processing, 2015.","title":"Face sketch synthesis via sparse representation-based greedy search","authors":"Zhang","year":"2015","venue":"IEEE Transactions on Image Processing","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Zhou et al., 2012] Hao Zhou, Zhanghui Kuang, and Ken- neth Wong. Markov weight fields for face sketch synthe- sis. In IEEE Conference on Computer Vision and Pattern Recognition, 2012.","title":"Markov weight fields for face sketch synthesis","authors":"Hao Zhou, Zhanghui Kuang, Kenneth Wong","year":"2012","venue":"IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}