{"type":"ScholarlyArticle","title":"Transition-based Adversarial Network for Cross-lingual Aspect Extraction","authors":[{"name":"Wenya Wang","slug":"wenya-wang","given":"Wenya","family":"Wang","affiliation":"† Nanyang Technological University , Singapore; ‡ SAP Innovation Center , Singapore"},{"name":"Sinno Jialin Pan","slug":"sinno-jialin-pan","given":"Sinno Jialin","family":"Pan","affiliation":"† Nanyang Technological University , Singapore"}],"abstract":"In fine-grained opinion mining, the task of aspect extraction involves the identification of explicit product features in customer reviews. This task has been widely studied in some major languages, e.g., English, but was seldom addressed in other minor languages due to the lack of annotated corpus. To solve it, we develop a novel deep model to transfer knowledge from a source language with labeled training data to a target language without any annotations. Different from cross-lingual sentiment classification, aspect extraction across languages requires more fine-grained adaptation. To this end, we utilize transition-based mechanism that reads a word each time and forms a series of configurations that represent the status of the whole sentence. We represent each configuration as a continuous feature vector and align these representations from different languages into a shared space through an adversarial network. In addition, syntactic structures are also integrated into the deep model to achieve more syntactically-sensitive adaptations. The proposed method is end-to-end and achieves state-of-the-art performance on English, French and Spanish restaurant review datasets.","doi":"10.24963/ijcai.2018/622","url":"https://ijcai.org/proceedings/2018/622","pdf":"https://ijcai.org/proceedings/2018/0622.pdf","markdown":"https://ijcai.org/proceedings/2018/622.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/622","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Natural Language Processing","track":"Main track","number":622,"pages":{"first":4475,"last":4481},"keywords":["Machine Learning: Deep Learning","Natural Language Processing: Sentiment Analysis and Text Mining"],"videos":[],"references":[{"position":1,"raw":"[Bérard et al., 2016] Alexandre Bérard, Christophe Servan, Olivier Pietquin, and Laurent Besacier. MultiVec: a Multi- lingual and Multilevel Representation Learning Toolkit for NLP. In LREC, 2016.","title":"MultiVec: a Multilingual and Multilevel Representation Learning Toolkit for NLP","authors":"Alexandre Bérard, Christophe Servan, Olivier Pietquin, Laurent Besacier","year":"2016","venue":"LREC","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Chandar et al., 2014] Sarath Chandar, Stanislas Lauly, Hugo Larochelle, Mitesh Khapra, Balaraman Ravindran, Vikas C Raykar, and Amrita Saha. An autoencoder ap- proach to learning bilingual word representations. In NIPS. 2014.","title":"An autoencoder approach to learning bilingual word representations","authors":"Sarath Chandar, Stanislas Lauly, Hugo Larochelle, Mitesh Khapra, Balaraman Ravindran, Amrita Vikas C Raykar, Saha","year":"2014","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chen et al., 2016] Xilun Chen, Ben Athiwaratkun, Yu Sun, Kilian Q. Weinberger, and Claire Cardie. Adversarial deep averaging networks for cross-lingual sentiment classifica- tion. CoRR, 2016.","title":"Adversarial deep averaging networks for cross-lingual sentiment classification","authors":"Chen","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[de Marneffe et al., 2014] Marie-Catherine de Marneffe, Timothy Dozat, Natalia Silveira, Katri Haverinen, Filip Ginter, Joakim Nivre, and Christopher D. Manning. Uni- versal stanford dependencies: A cross-linguistic typology. In LREC, 2014.","title":"Universal stanford dependencies: A cross-linguistic typology","authors":"Marie-Catherine De Marneffe, Timothy Dozat, Natalia Silveira, Katri Haverinen, Filip Ginter, Joakim Nivre, Christopher D Manning","year":"2014","venue":"LREC","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Ding et al., 2017] Ying Ding, Jianfei Yu, and Jing Jiang. Recurrent neural networks with auxiliary labels for cross- domain opinion target extraction. In AAAI, 2017.","title":"Recurrent neural networks with auxiliary labels for crossdomain opinion target extraction","authors":"Ying Ding, Jianfei Yu, Jing Jiang","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Dyer et al., 2015] Chris Dyer, Miguel Ballesteros, Wang Ling, Austin Matthews, and Noah A. Smith. Transition- based dependency parsing with stack long short-term memory. In ACL, 2015.","title":"Transitionbased dependency parsing with stack long short-term memory","authors":"Chris Dyer, Miguel Ballesteros, Wang Ling, Austin Matthews, Noah A Smith","year":"2015","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Ganin et al., 2016] Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, Franc ¸ois Laviolette, Mario Marchand, and Victor Lempitsky. Domain-adversarial training of neural networks. J. Mach. Learn. Res., 17(1):2096-2030, 2016.","title":"Domain-adversarial training of neural networks","authors":"Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, Mario Franc ¸ois Laviolette, Victor Marchand, Lempitsky","year":"2016","venue":"J. Mach. Learn. Res","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Goodfellow et al., 2014] Ian Goodfellow, Jean Pouget- Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Gen- erative adversarial nets. In NIPS. 2014.","title":"Generative adversarial nets","authors":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio","year":"2014","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Gouws et al., 2015] Stephan Gouws, Yoshua Bengio, and Greg Corrado. Bilbowa: Fast bilingual distributed rep- resentations without word alignments. In ICML, 2015.","title":"Bilbowa: Fast bilingual distributed representations without word alignments","authors":"Stephan Gouws, Yoshua Bengio, Greg Corrado","year":"2015","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Hermann and Blunsom, 2014] Karl Moritz Hermann and Phil Blunsom. Multilingual models for compositional dis- tributed semantics. In ACL, 2014.","title":"Multilingual models for compositional distributed semantics","authors":"Blunsom Hermann, Karl Moritz Hermann, Phil Blunsom","year":"2014","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Hu and Liu, 2004] Minqing Hu and Bing Liu. Mining and summarizing customer reviews. In KDD, 2004.","title":"Mining and summarizing customer reviews","authors":"Liu Hu, Minqing Hu, Bing Liu","year":"2004","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Jakob and Gurevych, 2010] Niklas Jakob and Iryna Gurevych. Extracting opinion targets in a single-and cross-domain setting with conditional random fields. In EMNLP, 2010.","title":"Extracting opinion targets in a single-and cross-domain setting with conditional random fields","authors":"Jakob, Gurevych ;, Niklas Jakob, Iryna Gurevych","year":"2010","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Jin and Ho, 2009] Wei Jin and Hung Hay Ho. A novel lex- icalized hmm-based learning framework for web opinion mining. In ICML, pages 465-472, 2009.","title":"A novel lexicalized hmm-based learning framework for web opinion mining","authors":"Jin Ho, ; ] Wei, Jin, Hung Hay Ho","year":"2009","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Klementiev et al., 2012] Alexandre Klementiev, Ivan Titov, and Binod Bhattarai. Inducing crosslingual distributed representations of words. In COLING, 2012.","title":"Inducing crosslingual distributed representations of words","authors":"Alexandre Klementiev, Ivan Titov, Binod Bhattarai","year":"2012","venue":"COLING","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Lample et al., 2016] Guillaume Lample, Miguel Balles- teros, Kazuya Kawakami, Sandeep Subramanian, and Chris Dyer. Neural architectures for named entity recog- nition. In Proc. NAACL-HLT, 2016.","title":"Neural architectures for named entity recognition","authors":"Guillaume Lample, Miguel Ballesteros, Kazuya Kawakami, Sandeep Subramanian, Chris Dyer","year":"2016","venue":"Proc. NAACL-HLT","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Li et al., 2012] Fangtao Li, Sinno Jialin Pan, Ou Jin, Qiang Yang, and Xiaoyan Zhu. Cross-domain co-extraction of sentiment and topic lexicons. In ACL, 2012.","title":"Cross-domain co-extraction of sentiment and topic lexicons","authors":"Fangtao Li, Sinno Jialin Pan, Ou Jin, Qiang Yang, Xiaoyan Zhu","year":"2012","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Liu et al., 2015] Pengfei Liu, Shafiq Joty, and Helen Meng. Fine-grained opinion mining with recurrent neural net- works and word embeddings. In EMNLP, 2015.","title":"Fine-grained opinion mining with recurrent neural networks and word embeddings","authors":"Pengfei Liu, Shafiq Joty, Helen Meng","year":"2015","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Meng et al., 2012] Xinfan Meng, Furu Wei, Xiaohua Liu, Ming Zhou, Ge Xu, and Houfeng Wang. Cross-lingual mixture model for sentiment classification. In ACL, 2012.","title":"Cross-lingual mixture model for sentiment classification","authors":"Meng","year":"2012","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Odena et al., 2017] Augustus Odena, Christopher Olah, and Jonathon Shlens. Conditional image synthesis with auxil- iary classifier GANs. In ICML, 2017.","title":"Conditional image synthesis with auxiliary classifier GANs","authors":"Odena","year":"2017","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Prettenhofer and Stein, 2010] Peter Prettenhofer and Benno Stein. Cross-language text classification using structural correspondence learning. In ACL, 2010.","title":"Cross-language text classification using structural correspondence learning","authors":"Stein Prettenhofer, Peter Prettenhofer, Benno Stein","year":"2010","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Qiu et al., 2011] Guang Qiu, Bing Liu, Jiajun Bu, and Chun Chen. Opinion word expansion and target extraction through double propagation. Comput. Linguist., 37(1):9- 27, 2011.","title":"Opinion word expansion and target extraction through double propagation","authors":"Guang Qiu, Bing Liu, Jiajun Bu, Chun Chen","year":"2011","venue":"Comput. Linguist","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Wan, 2009] Xiaojun Wan. Co-training for cross-lingual sen- timent classification. In ACL-AFNLP, 2009.","title":"Co-training for cross-lingual sentiment classification","authors":"Xiaojun Wan","year":"2009","venue":"ACL-AFNLP","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Wang et al., 2016] Wenya Wang, Sinno Jialin Pan, Daniel Dahlmeier, and Xiaokui Xiao. Recursive neural condi- tional random fields for aspect-based sentiment analysis. In EMNLP, 2016.","title":"Recursive neural conditional random fields for aspect-based sentiment analysis","authors":"Wenya Wang, Sinno Jialin Pan, Daniel Dahlmeier, Xiaokui Xiao","year":"2016","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Wang et al., 2017] Wenya Wang, Sinno Jialin Pan, Daniel Dahlmeier, and Xiaokui Xiao. Coupled multi-layer tensor network for co-extraction of aspect and opinion terms. In AAAI, 2017.","title":"Coupled multi-layer tensor network for co-extraction of aspect and opinion terms","authors":"Wenya Wang, Sinno Jialin Pan, Daniel Dahlmeier, Xiaokui Xiao","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Yin et al., 2016] Yichun Yin, Furu Wei, Li Dong, Kaimeng Xu, Ming Zhang, and Ming Zhou. Unsupervised word and dependency path embeddings for aspect term extraction. In IJCAI, 2016.","title":"Unsupervised word and dependency path embeddings for aspect term extraction","authors":"Yichun Yin, Furu Wei, Li Dong, Kaimeng Xu, Ming Zhang, Ming Zhou","year":"2016","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2016/423"},{"position":26,"raw":"[Zhou et al., 2014] Joey Tianyi Zhou, Sinno Jialin Pan, Ivor W. Tsang, and Yan Yan. Hybrid heterogeneous trans- fer learning through deep learning. In AAAI, 2014.","title":"Hybrid heterogeneous transfer learning through deep learning","authors":"Joey Tianyi Zhou, Sinno Jialin Pan, Ivor W Tsang, Yan Yan","year":"2014","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Zhou et al., 2015] Guangyou Zhou, Tingting He, Jun Zhao, and Wensheng Wu. A subspace learning framework for cross-lingual sentiment classification with partial parallel data. In IJCAI, pages 1426-1432, 2015.","title":"A subspace learning framework for cross-lingual sentiment classification with partial parallel data","authors":"Zhou","year":"2015","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2015/205"},{"position":28,"raw":"[Zhou et al., 2016] Xinjie Zhou, Xiaojun Wan, and Jianguo Xiao. Cross-lingual sentiment classification with bilingual document representation learning. In ACL, 2016.","title":"Cross-lingual sentiment classification with bilingual document representation learning","authors":"Xinjie Zhou, Xiaojun Wan, Jianguo Xiao","year":"2016","venue":"ACL","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}