{"type":"ScholarlyArticle","title":"Language Independent Sequence Labelling for Opinion Target Extraction (Extended Abstract)","authors":[{"name":"Rodrigo Agerri","slug":"rodrigo-agerri","given":"Rodrigo","family":"Agerri","affiliation":"HiTZ Centre , IXA Group , University of the Basque Country UPV/EHU"},{"name":"German Rigau","slug":"german-rigau","given":"German","family":"Rigau","affiliation":"HiTZ Centre , IXA Group , University of the Basque Country UPV/EHU"}],"abstract":"In this paper we present a language independent system to model Opinion Target Extraction (OTE) as a sequence labelling task. The system consists of a combination of clustering features implemented on top of a simple set of shallow local features. Experiments on the well known Aspect Based Sentiment Analysis (ABSA) benchmarks show that our approach is very competitive across languages, obtaining, at the time of writing, best results for six languages in seven different datasets. Furthermore, the results provide further insights into the behaviour of clustering features for sequence labeling tasks. Finally, we also show that these results can be outperformed by recent advances in contextual word embeddings and the transformer architecture. The system and models generated in this work are available for public use and to facilitate reproducibility of results.","doi":"10.24963/ijcai.2020/717","url":"https://ijcai.org/proceedings/2020/717","pdf":"https://ijcai.org/proceedings/2020/0717.pdf","markdown":"https://ijcai.org/proceedings/2020/717.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/717","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Journal track","track":"Journal track","number":717,"pages":{"first":5110,"last":5114},"keywords":["Natural Language Processing: Sentiment Analysis and Text Mining","Natural Language Processing: NLP Applications and Tools","Natural Language Processing: Information Extraction"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/25228/file_25228.m3u8","length_sec":300,"provider":"hls"}],"references":[{"position":1,"raw":"[Agerri and Rigau, 2016] Rodrigo Agerri and German Rigau. Robust multilingual named entity recognition with shallow semi-supervised features. Artificial Intelligence, 238:63-82, 2016.","title":"Rodrigo Agerri and German Rigau. Robust multilingual named entity recognition with shallow semi-supervised features","authors":"Rigau Agerri","year":"2016","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Agerri et al., 2014] Rodrigo Agerri, Josu Bermudez, and German Rigau. IXA pipeline: Efficient and ready to use multilingual NLP tools. In LREC, 2014.","title":"IXA pipeline: Efficient and ready to use multilingual NLP tools","authors":"Rodrigo Agerri, Josu Bermudez, German Rigau","year":"2014","venue":"LREC","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Álvarez-López et al., 2016] Tamara Álvarez-López, Jonathan Juncal-Martínez, Milagros Fernández-Gavilanes, Enrique Costa-Montenegro, and Francisco Javier González-Castaño. GTI at semeval-2016 task 5: Svm and crf for aspect detection and unsupervised aspect-based sentiment analysis. In SemEval, 2016.","title":"GTI at semeval-2016 task 5: Svm and crf for aspect detection and unsupervised aspect-based sentiment analysis","authors":"Tamara Álvarez-López, Jonathan Juncal-Martínez, Milagros Fernández-Gavilanes, Enrique Costa-Montenegro, Francisco Javier, González-Castaño","year":"2016","venue":"SemEval","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Brown et al., 1992] Peter F Brown, Peter V Desouza, Robert L Mercer, Vincent J Della Pietra, and Jenifer C Lai. Class-based n-gram models of natural language. Compu- tational linguistics, 18(4):467-479, 1992.","title":"Class-based n-gram models of natural language","authors":"Peter V Peter F Brown, Robert L Desouza, Vincent J Mercer, Pietra Della, Jenifer C Lai","year":"1992","venue":"Computational linguistics","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cambria et al., 2014] Erik Cambria, Daniel Olsher, and Dheeraj Rajagopal. Senticnet 3: a common and common- sense knowledge base for cognition-driven sentiment anal- ysis. In AAAI, 2014.","title":"Senticnet 3: a common and commonsense knowledge base for cognition-driven sentiment analysis","authors":"Cambria","year":"2014","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Clark, 2003] Alexander Clark. Combining distributional and morphological information for part of speech induc- tion. In EACL, 2003.","title":"Combining distributional and morphological information for part of speech induction","authors":"Alexander Clark","year":"2003","venue":"EACL","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Conneau et al., 2019] Alexis Conneau, Kartikay Khandel- wal, Naman Goyal, Vishrav Chaudhary, Guillaume Wen- zek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. Unsu- pervised cross-lingual representation learning at scale. arXiv:1911.02116, 2019.","title":"Unsupervised cross-lingual representation learning at scale","authors":"Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Devlin et al., 2018] Jacob Devlin, Ming-Wei Chang, Ken- ton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understand- ing. arXiv preprint arXiv:1810.04805, 2018.","title":"Bert: Pre-training of deep bidirectional transformers for language understanding","authors":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Jebbara and Cimiano, 2019] Soufian Jebbara and Philipp Cimiano. Zero-shot cross-lingual opinion target extrac- tion. In NAACL, pages 2486-2495, 2019.","title":"Soufian Jebbara and Philipp Cimiano. Zero-shot cross-lingual opinion target extraction","authors":"Cimiano Jebbara","year":"2019","venue":"NAACL","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Li and Lam, 2017] Xin Li and Wai Lam. Deep multi-task learning for aspect term extraction with memory interac- tion. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 2886- 2892, 2017.","title":"Deep multi-task learning for aspect term extraction with memory interaction","authors":"Li, Lam ; ] Xin Li, Wai Lam","year":"2017","venue":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Liu et al., 2015] Pengfei Liu, Shafiq Joty, and Helen Meng. Fine-grained opinion mining with recurrent neural net- works and word embeddings. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 1433-1443. Association for Computa- tional Linguistics, 2015.","title":"Fine-grained opinion mining with recurrent neural networks and word embeddings","authors":"Pengfei Liu, Shafiq Joty, Helen Meng","year":"2015","venue":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Liu, 2012] Bing Liu. Sentiment analysis and opinion min- ing. Synthesis Lectures on Human Language Technolo- gies, 5(1):1-167, 2012.","title":"Sentiment analysis and opinion mining","authors":"Bing Liu, Liu","year":"2012","venue":"Synthesis Lectures on Human Language Technologies","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[McAuley and Leskovec, 2013] Julian McAuley and Jure Leskovec. Hidden factors and hidden topics: understand- ing rating dimensions with review text. In Proceedings of the 7th ACM conference on Recommender systems, pages 165-172. ACM, 2013.","title":"Hidden factors and hidden topics: understanding rating dimensions with review text","authors":"Leskovec Mcauley, Julian Mcauley, Jure Leskovec","year":"2013","venue":"Proceedings of the 7th ACM conference on Recommender systems","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Mikolov et al., 2013] Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. Distributed rep- resentations of words and phrases and their composition- ality. In Advances in Neural Information Processing Sys- tems, pages 3111-3119, 2013.","title":"Distributed representations of words and phrases and their compositionality","authors":"Mikolov","year":"2013","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Pang and Lee, 2008] B. Pang and L. Lee. Opinion mining and sentiment analysis. Foundations and Trends in Infor- mation Retrieval, 2(1-2):1-135, 2008.","title":"Opinion mining and sentiment analysis","authors":"B Pang, L Lee","year":"2008","venue":"Foundations and Trends in Information Retrieval","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Pontiki et al., 2014] Maria Pontiki, Dimitris Galanis, John Pavlopoulos, Harris Papageorgiou, Ion Androutsopoulos, and Suresh Manandhar. Semeval-2014 task 4: Aspect based sentiment analysis. In SemEval, 2014.","title":"Semeval-2014 task 4: Aspect based sentiment analysis","authors":"Maria Pontiki, Dimitris Galanis, John Pavlopoulos, Harris Papageorgiou, Ion Androutsopoulos, Suresh Manandhar","year":"2014","venue":"SemEval","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Pontiki et al., 2015] Maria Pontiki, Dimitris Galanis, Haris Papageorgiou, Suresh Manandhar, and Ion Androutsopou- los. Semeval-2015 task 12: Aspect based sentiment anal- ysis. In SemEval, 2015.","title":"Androutsopoulos. Semeval-2015 task 12: Aspect based sentiment analysis","authors":"Maria Pontiki, Dimitris Galanis, Haris Papageorgiou, Suresh Manandhar, Ion","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Pontiki et al., 2016] Maria Pontiki, Dimitris Galanis, Haris Papageorgiou, Ion Androutsopoulos, Suresh Manand- har, Mohammad AL-Smadi, Mahmoud Al-Ayyoub, Yanyan Zhao, Bing Qin, Orphee De Clercq, Veronique Hoste, Marianna Apidianaki, Xavier Tannier, Na- talia Loukachevitch, Evgeniy Kotelnikov, Núria Bel, Salud María Jiménez-Zafra, and Güls ¸en Eryigit. Semeval- 2016 task 5: Aspect based sentiment analysis. In SemEval, 2016.","title":"Semeval-2016 task 5: Aspect based sentiment analysis","authors":"Maria Pontiki, Dimitris Galanis, Haris Papageorgiou, Ion Androutsopoulos, Suresh Manandhar, Al-Smadi Mohammad, Mahmoud Al-Ayyoub, Yanyan Zhao, Bing Qin, Orphee De Clercq, Veronique Hoste, Marianna Apidianaki, Xavier Tannier, Natalia Loukachevitch, Evgeniy Kotelnikov, Núria Bel, Salud María Jiménez-Zafra, Güls ¸en Eryigit","year":"2016","venue":"SemEval","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Poria et al., 2016] Soujanya Poria, Erik Cambria, and Alexander Gelbukh. Aspect extraction for opinion mining with a deep convolutional neural network. Knowledge- Based Systems, 108:42-49, 2016.","title":"Aspect extraction for opinion mining with a deep convolutional neural network","authors":"Poria","year":"2016","venue":"Knowledge-Based Systems","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[San Vicente et al., 2015] Iñaki San Vicente, Xabier Sar- alegi, and Rodrigo Agerri. Elixa: A modular and flexible absa platform. In SemEval, 2015.","title":"Iñaki San Vicente, Xabier Saralegi, and Rodrigo Agerri. Elixa: A modular and flexible absa platform","authors":"San Vicente","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Toh and Su, 2015] Zhiqiang Toh and Jian Su. Nlangp: Su- pervised machine learning system for aspect category clas- sification and opinion target extraction. In SemEval, 2015.","title":"Nlangp: Supervised machine learning system for aspect category classification and opinion target extraction","authors":"Zhiqiang Toh, Jian Su","year":"2015","venue":"SemEval","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Toh and Su, 2016] Zhiqiang Toh and Jian Su. Nlangp at semeval-2016 task 5: Improving aspect based sentiment analysis using neural network features. In SemEval, 2016.","title":"Nlangp at semeval-2016 task 5: Improving aspect based sentiment analysis using neural network features","authors":"Zhiqiang Toh, Jian Su","year":"2016","venue":"SemEval","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Toh and Wang, 2014] Zhiqiang Toh and Wenting Wang. Dlirec: Aspect term extraction and term polarity classi- fication system. In SemEval, 2014.","title":"Dlirec: Aspect term extraction and term polarity classification system","authors":"Zhiqiang Toh, Wenting Wang","year":"2014","venue":"SemEval","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Wang et al., 2017] Wenya Wang, Sinno Jialin Pan, Daniel Dahlmeier, and Xiaokui Xiao. Coupled multi-layer at- tentions for co-extraction of aspect and opinion terms. In AAAI, pages 3316-3322, 2017.","title":"Coupled multi-layer attentions for co-extraction of aspect and opinion terms","authors":"Wenya Wang, Sinno Jialin Pan, Daniel Dahlmeier, Xiaokui Xiao","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Yin et al., 2016] Yichun Yin, Furu Wei, Li Dong, Kaimeng Xu, Ming Zhang, and Ming Zhou. Unsupervised word and dependency path embeddings for aspect term extraction. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI'16, pages 2979-2985. AAAI Press, 2016.","title":"Unsupervised word and dependency path embeddings for aspect term extraction","authors":"Yichun Yin, Furu Wei, Li Dong, Kaimeng Xu, Ming Zhang, Ming Zhou","year":"2016","venue":"Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI'16","doi":null,"url":null,"internal_url":"/proceedings/2016/423"}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}