{"type":"ScholarlyArticle","title":"Learning Deep Unsupervised Binary Codes for Image Retrieval","authors":[{"name":"Junjie Chen","slug":"junjie-chen","given":"Junjie","family":"Chen","affiliation":"Department of Computer Science , Hong Kong Baptist University , Hong Kong , China"},{"name":"William K. Cheung","slug":"william-k-cheung","given":"William K.","family":"Cheung","affiliation":"Department of Computer Science , Hong Kong Baptist University , Hong Kong , China"},{"name":"Anran Wang","slug":"anran-wang","given":"Anran","family":"Wang","affiliation":"Institute for Infocomm Research , A*STAR , Singapore"}],"abstract":"Hashing is an efficient approximate nearest neighbor search method and has been widely adopted for large-scale multimedia retrieval. While supervised learning is more popular for the data-dependent hashing, deep unsupervised hashing methods have recently been developed to learn non-linear transformations for converting multimedia inputs to binary codes. Most of existing deep unsupervised hashing methods make use of a quadratic constraint for minimizing the difference between the compact representations and the target binary codes, which inevitably causes severe information loss. In this paper, we propose a novel deep unsupervised method called DeepQuan for hashing. The DeepQuan model utilizes a deep autoencoder network, where the encoder is used to learn compact representations and the decoder is for manifold preservation. To contrast with the existing unsupervised methods, DeepQuan learns the binary codes by minimizing the quantization error through product quantization technique. Furthermore, a weighted triplet loss is proposed to avoid trivial solution and poor generalization. Extensive experimental results on standard datasets show that the proposed DeepQuan model outperforms the state-of-the-art unsupervised hashing methods for image retrieval tasks.","doi":"10.24963/ijcai.2018/85","url":"https://ijcai.org/proceedings/2018/85","pdf":"https://ijcai.org/proceedings/2018/0085.pdf","markdown":"https://ijcai.org/proceedings/2018/85.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/85","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Computer Vision","track":"Main track","number":85,"pages":{"first":613,"last":619},"keywords":["Machine Learning Applications: Applications of Unsupervised Learning","Computer Vision: Recognition: Detection, Categorization, Indexing, Matching, Retrieval, Semantic Interpretation","Multidisciplinary Topics and Applications: Information Retrieval"],"videos":[],"references":[{"position":1,"raw":"[Andoni and Indyk, 2006] Alexandr Andoni and Piotr Indyk. Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. In Foundations of Computer Science, 2006. FOCS'06. 47th Annual IEEE Symposium on, pages 459-468. IEEE, 2006.","title":"Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions","authors":"Indyk Andoni, Alexandr Andoni, Piotr Indyk","year":"2006","venue":"FOCS'06. 47th Annual IEEE Symposium on","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Cao et al., 2016] Yue Cao, Mingsheng Long, Jianmin Wang, Han Zhu, and Qingfu Wen. Deep quantization net- work for efficient image retrieval. In AAAI, pages 3457- 3463, 2016.","title":"Deep quantization network for efficient image retrieval","authors":"Yue Cao, Mingsheng Long, Jianmin Wang, Han Zhu, Qingfu Wen","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Datar et al., 2004] Mayur Datar, Nicole Immorlica, Piotr Indyk, and Vahab S Mirrokni. Locality-sensitive hashing scheme based on p-stable distributions. In Proceedings of the Twentieth Annual Symposium on Computational Ge- ometry, pages 253-262. ACM, 2004.","title":"Locality-sensitive hashing scheme based on p-stable distributions","authors":"Mayur Datar, Nicole Immorlica, Piotr Indyk, Vahab, Mirrokni","year":"2004","venue":"Proceedings of the Twentieth Annual Symposium on Computational Geometry","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Do et al., 2016] Thanh-Toan Do, Anh-Dzung Doan, and Ngai-Man Cheung. Learning to hash with binary deep neural network. In European Conference on Computer Vi- sion, pages 219-234. Springer, 2016.","title":"Learning to hash with binary deep neural network","authors":"Thanh-Toan Do, Anh-Dzung Doan, Ngai-Man Cheung","year":"2016","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Duan et al., 2017] Yueqi Duan, Jiwen Lu, Ziwei Wang, Jianjiang Feng, and Jie Zhou. Learning deep binary de- scriptor with multi-quantization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recog- nition (CVPR), pages 1183-1192, 2017.","title":"Learning deep binary descriptor with multi-quantization","authors":"Duan","year":"2017","venue":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Erin Liong et al., 2015] Venice Erin Liong, Jiwen Lu, Gang Wang, Pierre Moulin, and Jie Zhou. Deep hashing for compact binary codes learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recog- nition, pages 2475-2483, 2015.","title":"Deep hashing for compact binary codes learning","authors":"Erin Liong","year":"2015","venue":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Ge et al., 2014] Tiezheng Ge, Kaiming He, Qifa Ke, and Jian Sun. Optimized product quantization. IEEE Trans- actions on Pattern Analysis and Machine Intelligence, 36(4):744-755, 2014.","title":"Optimized product quantization","authors":"Ge","year":"2014","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Gong et al., 2013] Yunchao Gong, Svetlana Lazebnik, Al- bert Gordo, and Florent Perronnin. Iterative quantization: A procrustean approach to learning binary codes for large- scale image retrieval. IEEE Transactions on Pattern Anal- ysis and Machine Intelligence, 35(12):2916-2929, 2013.","title":"Iterative quantization: A procrustean approach to learning binary codes for largescale image retrieval","authors":"Gong","year":"2013","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Gray, 1984] Robert Gray. Vector quantization. IEEE ASSP Magazine, 1(2):4-29, 1984.","title":"Vector quantization","authors":"Robert Gray","year":"1984","venue":"IEEE ASSP Magazine","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[He et al., 2013] Kaiming He, Fang Wen, and Jian Sun. K-means hashing: An affinity-preserving quantization method for learning binary compact codes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2938-2945, 2013.","title":"K-means hashing: An affinity-preserving quantization method for learning binary compact codes","authors":"Kaiming He, Fang Wen, Jian Sun","year":"2013","venue":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Heo et al., 2012] Jae-Pil Heo, Youngwoon Lee, Junfeng He, Shih-Fu Chang, and Sung-Eui Yoon. Spherical hashing. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2957-2964. IEEE, 2012.","title":"Spherical hashing","authors":"Jae-Pil Heo, Youngwoon Lee, Junfeng He, Shih-Fu Chang, Sung-Eui Yoon","year":"2012","venue":"Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Huang et al., 2017] Shanshan Huang, Yichao Xiong, Ya Zhang, and Jia Wang. Unsupervised triplet hashing for fast image retrieval. arXiv preprint arXiv:1702.08798, 2017. Jegou et al., 2011] Herve Jegou, Matthijs Douze, and Cordelia Schmid. Product quantization for nearest neigh- bor search. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(1):117-128, 2011.","title":"Unsupervised triplet hashing for fast image retrieval","authors":"Shanshan Huang, Yichao Xiong, Ya Zhang, Jia Wang, ; Jegou","year":"2011","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Li et al., 2015] Wu-Jun Li, Sheng Wang, and Wang-Cheng Kang. Feature learning based deep supervised hashing with pairwise labels. arXiv preprint arXiv:1511.03855, 2015.","title":"Feature learning based deep supervised hashing with pairwise labels","authors":"Wu-Jun Li, Sheng Wang, Wang-Cheng Kang","year":"2015","venue":null,"doi":null,"url":null,"internal_url":"/proceedings/2016/245"},{"position":14,"raw":"[Lin et al., 2016] Kevin Lin, Jiwen Lu, Chu-Song Chen, and Jie Zhou. Learning compact binary descriptors with unsu- pervised deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1183-1192, 2016.","title":"Learning compact binary descriptors with unsupervised deep neural networks","authors":"Kevin Lin, Jiwen Lu, Chu-Song Chen, Jie Zhou","year":"2016","venue":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Liu et al., 2011] Wei Liu, Jun Wang, Sanjiv Kumar, and Shih-Fu Chang. Hashing with graphs. In Proceedings of the 28th international conference on machine learning (ICML-11), pages 1-8. Citeseer, 2011.","title":"Hashing with graphs","authors":"Wei Liu, Jun Wang, Sanjiv Kumar, Shih-Fu Chang","year":"2011","venue":"Proceedings of the 28th international conference on machine learning (ICML-11)","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Liu et al., 2012] Wei Liu, Jun Wang, Rongrong Ji, Yu-Gang Jiang, and Shih-Fu Chang. Supervised hashing with ker- nels. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2074-2081. IEEE, 2012.","title":"Supervised hashing with kernels","authors":"Wei Liu, Jun Wang, Rongrong Ji, Yu-Gang Jiang, Shih-Fu Chang","year":"2012","venue":"Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Long et al., 2016] Mingsheng Long, Yue Cao, Jianmin Wang, and Philip S Yu. Composite correlation quanti- zation for efficient multimodal retrieval. In Proceedings of the 39th International ACM SIGIR Conference on Re- search and Development in Information Retrieval, pages 579-588. ACM, 2016.","title":"Composite correlation quantization for efficient multimodal retrieval","authors":"Mingsheng Long, Yue Cao, Jianmin Wang, Philip S Yu","year":"2016","venue":"Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Lu et al., 2017] Jiwen Lu, Venice Erin Liong, and Jie Zhou. Deep hashing for scalable image search. IEEE Transac- tions on Image Processing, 26(5):2352-2367, 2017.","title":"Deep hashing for scalable image search","authors":"Jiwen Lu, Venice Erin Liong, Jie Zhou","year":"2017","venue":"IEEE Transactions on Image Processing","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Oliva and Torralba, 2001] Aude Oliva and Antonio Tor- ralba. Modeling the shape of the scene: A holistic rep- resentation of the spatial envelope. International Journal of Computer Vision, 42(3):145-175, 2001.","title":"Aude Oliva and Antonio Torralba. Modeling the shape of the scene: A holistic representation of the spatial envelope","authors":"Torralba Oliva","year":"2001","venue":"International Journal of Computer Vision","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Simonyan and Zisserman, 2014] Karen Simonyan and An- drew Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.","title":"Very deep convolutional networks for large-scale image recognition","authors":"Karen Simonyan, Andrew Zisserman","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Wang et al., 2012] Jun Wang, Sanjiv Kumar, and Shih-Fu Chang. Semi-supervised hashing for large-scale search. IEEE Transactions on Pattern Analysis and Machine In- telligence, 34(12):2393-2406, 2012.","title":"Semi-supervised hashing for large-scale search","authors":"Jun Wang, Sanjiv Kumar, Shih-Fu Chang","year":"2012","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Weiss et al., 2009] Yair Weiss, Antonio Torralba, and Rob Fergus. Spectral hashing. In Advances in Neural Informa- tion Processing Systems, pages 1753-1760, 2009.","title":"Spectral hashing","authors":"Yair Weiss, Antonio Torralba, Rob Fergus","year":"2009","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Xie et al., 2016] Junyuan Xie, Ross Girshick, and Ali Farhadi. Unsupervised deep embedding for clustering analysis. In Processings of International Conference on Machine Learning, pages 478-487, 2016.","title":"Unsupervised deep embedding for clustering analysis","authors":"Junyuan Xie, Ross Girshick, Ali Farhadi","year":"2016","venue":"Processings of International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Zhang et al., 2017] Jian Zhang, Yuxin Peng, and Mingkuan Yuan. Unsupervised generative adversarial cross-modal hashing. arXiv preprint arXiv:1712.00358, 2017.","title":"Unsupervised generative adversarial cross-modal hashing","authors":"Jian Zhang, Yuxin Peng, Mingkuan Yuan","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}