{"type":"ScholarlyArticle","title":"Deep Learning at Alibaba","authors":[{"name":"Rong Jin","slug":"rong-jin","given":"Rong","family":"Jin","affiliation":"Alibaba Group , Hang Zhou , China"}],"abstract":"In this talk, I will focus on the applications and the latest development of deep learning technologies at Alibaba. More specifically, I will discuss (a) how to handle high dimensional data in DNN and its application to recommender system, (b) the development of deep learning models for transfer learning and its application to multimedia data analysis, (c) the development of combinatorial optimization techniques for DNN model compression and its application to large-scale image classification, and (d) the exploration of deep learning technique for combinatorial optimization and its application to the packing problem in shipping industry. I will conclude my talk with a discussion of new directions for deep learning that are under development at Alibaba.","doi":"10.24963/ijcai.2017/2","url":"https://ijcai.org/proceedings/2017/2","pdf":"https://ijcai.org/proceedings/2017/0002.pdf","markdown":"https://ijcai.org/proceedings/2017/2.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/2","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Invited Speakers","track":"Invited Speakers","number":2,"pages":{"first":11,"last":16},"keywords":["Machine Learning: Deep Learning"],"videos":[],"references":[{"position":1,"raw":"[Bello et al., 2017] Irwan Bello, Hieu Pham, Quoc V. Le, Mohammad Norouzi, and Samy Bengio. Neural combina- torial optimization with reinforcement learning. In ICLR, 2017.","title":"Neural combinatorial optimization with reinforcement learning","authors":"Irwan Bello, Hieu Pham, Quoc V Le, Mohammad Norouzi, Samy Bengio","year":"2017","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Boyd et al., 2011] Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, and Jonathan Eckstein. Distributed opti- mization and statistical learning via the alternating direc- tion method of multipliers. Foundations and Trends R in Machine Learning, 3(1):1-122, 2011.","title":"Distributed optimization and statistical learning via the alternating direction method of multipliers","authors":"Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, Jonathan Eckstein","year":"2011","venue":"Foundations and Trends R in Machine Learning","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Burke et al., 2013] Edmund K Burke, Michel Gendreau, Matthew Hyde, Graham Kendall, Gabriela Ochoa, Ender Özcan, and Rong Qu. Hyper-heuristics: A survey of the state of the art. Journal of the Operational Research Soci- ety, 64(12):1695-1724, 2013.","title":"Hyper-heuristics: A survey of the state of the art","authors":"Edmund K Burke, Michel Gendreau, Matthew Hyde, Graham Kendall, Gabriela Ochoa, Ender Özcan, Rong Qu","year":"2013","venue":"Journal of the Operational Research Society","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen et al., 1995] CS Chen, Shen-Ming Lee, and QS Shen. An analytical model for the container loading problem. European Journal of Operational Research, 80(1):68-76, 1995.","title":"An analytical model for the container loading problem","authors":"Chen","year":"1995","venue":"European Journal of Operational Research","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cheng et al., 2016] Heng-Tze Cheng, Levent Koc, Jeremi- ah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et al. Wide & deep learning for recommender systems. In Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, pages 7-10. ACM, 2016.","title":"Wide & deep learning for recommender systems","authors":"Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir","year":"2016","venue":"Proceedings of the 1st Workshop on Deep Learning for Recommender Systems","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Clautiaux et al., 2014] Franc ¸ois Clautiaux, Mauro DellAm- ico, Manuel Iori, and Ali Khanafer. Lower and upper bounds for the bin packing problem with fragile objects. Discrete Applied Mathematics, 163:73-86, 2014.","title":"Franc ¸ois Clautiaux, Mauro DellAmico, Manuel Iori, and Ali Khanafer. Lower and upper bounds for the bin packing problem with fragile objects","authors":"Clautiaux","year":"2014","venue":"Discrete Applied Mathematics","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Coffman et al., 1980] Edward G Coffman, Jr, Michael R Garey, David S Johnson, and Robert Endre Tarjan. Perfor- mance bounds for level-oriented two-dimensional packing algorithms. SIAM Journal on Computing, 9(4):808-826, 1980.","title":"Performance bounds for level-oriented two-dimensional packing algorithms","authors":"Jr Edward G Coffman, Michael R Garey, David S Johnson, Robert Endre Tarjan","year":"1980","venue":"SIAM Journal on Computing","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Crainic et al., 2008] Teodor Gabriel Crainic, Guido Perboli, and Roberto Tadei. Extreme point-based heuristics for three-dimensional bin packing. Informs Journal on com- puting, 20(3):368-384, 2008.","title":"Extreme point-based heuristics for three-dimensional bin packing","authors":"Teodor Gabriel Crainic, Guido Perboli, Roberto Tadei","year":"2008","venue":"Informs Journal on computing","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[He et al., 2016] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. In Proceedings of the IEEE Conference on Comput- er Vision and Pattern Recognition, 2016.","title":"Deep residual learning for image recognition","authors":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun","year":"2016","venue":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Hu et al., 2017] Haoyuan Hu, Xiaodong Zhang, Xiaowei Yan, Longfei Wang, and Yinghui Xu. Solving a new 3d bin packing problem with deep reinforcement learning method. Technical report, 2017.","title":"Solving a new 3d bin packing problem with deep reinforcement learning method","authors":"Haoyuan Hu, Xiaodong Zhang, Xiaowei Yan, Longfei Wang, Yinghui Xu","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Ioffe and Szegedy, 2015] Sergey Ioffe and Christian Szegedy. Batch normalization: Accelerating deep net- work training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167, 2015.","title":"Batch normalization: Accelerating deep network training by reducing internal covariate shift","authors":"Szegedy Ioffe, Sergey Ioffe, Christian Szegedy","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Krasin et al., 2016] Ivan Krasin, Tom Duerig, Neil Alldrin, Andreas Veit, Sami Abu-El-Haija, Serge Belongie, David Cai, Zheyun Feng, Vittorio Ferrari, Victor Gomes, Ab- hinav Gupta, Dhyanesh Narayanan, Chen Sun, Gal Chechik, and Kevin Murphy. Openimages: A pub- lic dataset for large-scale multi-label and multi-class image classification. Dataset available from http- s://github.com/openimages, 2016.","title":"Openimages: A public dataset for large-scale multi-label and multi-class image classification","authors":"Ivan Krasin, Tom Duerig, Neil Alldrin, Andreas Veit, Sami Abu-El-Haija, Serge Belongie, David Cai, Zheyun Feng, Vittorio Ferrari, Victor Gomes, Abhinav Gupta, Dhyanesh Narayanan, Chen Sun, Gal Chechik, Kevin Murphy","year":"2016","venue":null,"doi":null,"url":"http-s://github.com/openimages","internal_url":null},{"position":13,"raw":"[Liu et al., 2016] Wei Liu, Dragomir Anguelov, Dumitru Er- han, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C Berg. Ssd: Single shot multibox detector. In European Conference on Computer Vision, 2016.","title":"Ssd: Single shot multibox detector","authors":"Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, Alexander C Berg","year":"2016","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Pinkus, 1999] Allan Pinkus. Approximation theory of the mlp model in neural networks. Acta Numerica, 8:143- 195, 1999.","title":"Approximation theory of the mlp model in neural networks","authors":"Allan Pinkus","year":"1999","venue":"Acta Numerica","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Rastegari et al., 2016] Mohammad Rastegari, Vicente Or- donez, Joseph Redmon, and Ali Farhadi. Xnor-net: Ima- genet classification using binary convolutional neural net- works. In European Conference on Computer Vision, 2016.","title":"Xnor-net: Imagenet classification using binary convolutional neural networks","authors":"Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, Ali Farhadi","year":"2016","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Schroff et al., 2015] Florian Schroff, Dmitry Kalenichenko, and James Philbin. Facenet: A unified embedding for face recognition and clustering. In IEEE Conference on Com- puter Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, June 7-12, 2015, pages 815-823, 2015.","title":"Facenet: A unified embedding for face recognition and clustering","authors":"Schroff","year":"2015","venue":"IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Sutskever et al., 2014] Ilya Sutskever, Oriol Vinyals, and Quoc V Le. Sequence to sequence learning with neural networks. In NIPS, pages 3104-3112, 2014.","title":"Quoc V Le. Sequence to sequence learning with neural networks","authors":"Sutskever","year":"2014","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Tsybakov, 2008] Alexandre B. Tsybakov. Introduction to Nonparametric Estimation. Springer Publishing Compa- ny, Incorporated, 1st edition, 2008.","title":"Introduction to Nonparametric Estimation","authors":"B Alexandre, Tsybakov","year":"2008","venue":null,"doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Vinyals et al., 2015] Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. Pointer networks. In NIPS, pages 2692- 2700, 2015.","title":"Pointer networks","authors":"Oriol Vinyals, Meire Fortunato, Navdeep Jaitly","year":"2015","venue":"NIPS","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}