{"type":"ScholarlyArticle","title":"Five Years of Argument Mining: a Data-driven Analysis","authors":[{"name":"Elena Cabrio","slug":"elena-cabrio","given":"Elena","family":"Cabrio","affiliation":"Université Côte d'Azur , CNRS , Inria , I3S , France"},{"name":"Serena Villata","slug":"serena-villata","given":"Serena","family":"Villata","affiliation":"Université Côte d'Azur , CNRS , Inria , I3S , France"}],"abstract":"Argument mining is the research area aiming at extracting natural language arguments and their relations from text,  with the final goal of providing machine-processable structured data for computational models of argument. This research topic has started to attract the attention of a small community of researchers around 2014, and it is nowadays counted as one of the most promising research areas in Artificial Intelligence in terms of growing of the community,  funded projects,  and involvement of companies.  In this paper, we present the argument mining tasks, and we discuss the obtained results in the area from a data-driven perspective. An open discussion highlights the main weaknesses suffered by the existing work in the literature, and proposes open challenges to be faced in the future.","doi":"10.24963/ijcai.2018/766","url":"https://ijcai.org/proceedings/2018/766","pdf":"https://ijcai.org/proceedings/2018/0766.pdf","markdown":"https://ijcai.org/proceedings/2018/766.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/766","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Survey track","track":"Survey track","number":766,"pages":{"first":5427,"last":5433},"keywords":["Knowledge Representation and Reasoning: Computational Models of Argument","Natural Language Processing: Natural Language Processing"],"videos":[],"references":[{"position":1,"raw":"Approaches Component Detection Relations prediction Sentence classification Boundaries Detection SVM [Mochales and Moens, 2011], [Duthie et al., 2016] [Mochales and Moens, 2011] [","title":"Approaches Component Detection Relations prediction Sentence classification Boundaries Detection SVM","authors":null,"year":"2011","venue":"Mochales and Moens","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Naderi and Hirst, 2015] [","title":null,"authors":"Hirst Naderi","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"Lippi and Torroni, 2016a; 2016c] [Lippi and Torroni, 2016c] [Niculae et al., 2017] [Habernal and Gurevych, 2017] [Stab and Gurevych, 2017]","title":"Habernal and Gurevych","authors":"Torroni Lippi","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bar-Haim et al., 2017] [","title":null,"authors":"Bar-Haim","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Menini et al., 2018] P [Villalba and Saint-Dizier, 2012] [","title":null,"authors":"P [ Villalba, Saint-Dizier","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Villalba and Saint-Dizier, 2012] [Peldszus and Stede, 2015] [Peldszus and Stede, 2015] [","title":"Peldszus and Stede","authors":"Saint-Dizier Villalba","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Eger et al., 2017] [","title":null,"authors":"Eger","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Eger et al., 2017] [","title":null,"authors":"Eger","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Eger et al., 2017] LR [Levy et al., 2014], [Rinott et al., 2015] [Dusmanu et al., 2017] [","title":null,"authors":"Eger","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Nguyen and Litman, 2018] [","title":null,"authors":"Litman Nguyen","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Nguyen and Litman, 2018] [Ibeke et al., 2017] [","title":null,"authors":"Litman Nguyen","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Nguyen and Litman, 2018] RNN [Eger et al., 2017] [","title":"RNN","authors":"Litman ; Nguyen, Eger","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Eger et al., 2017] [Niculae et al., 2017] [","title":null,"authors":"Eger","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Eger et al., 2017] ME [Mochales and Moens, 2011], [","title":"ME [Mochales and Moens","authors":"Eger","year":"2011","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Duthie et al., 2016] [Mochales and Moens, 2011] CRF [Stab and Gurevych, 2017]","title":"CRF [Stab and Gurevych","authors":"Duthie","year":"2011","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Duthie et al., 2016] RF [Dusmanu et al., 2017] TES [Cabrio and Villata, 2013] Levy et al., 2014] References [Artstein, 2017] Ron Artstein. Inter-annotator Agreement, pages 297-313. Springer Netherlands, Dordrecht, 2017.","title":"References [Artstein, 2017] Ron Artstein. Inter-annotator Agreement","authors":"Duthie","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Bar-Haim et al., 2017] Roy Bar-Haim, Indrajit Bhat- tacharya, Francesco Dinuzzo, Amrita Saha, and Noam Slonim. Stance classification of context-dependent claims. In EACL, pages 251-261, 2017.","title":"Stance classification of context-dependent claims","authors":"Bar-Haim","year":"2017","venue":"EACL","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Basile et al., 2016] Pierpaolo Basile, Valerio Basile, Elena Cabrio, and Serena Villata. Argument mining on italian news blogs. In CLiC-it, volume 1749 of CEUR Workshop Proceedings, 2016.","title":"Argument mining on italian news blogs","authors":"Pierpaolo Basile, Valerio Basile, Elena Cabrio, Serena Villata","year":"2016","venue":"CEUR Workshop Proceedings","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Cabrio and Villata, 2013] Elena Cabrio and Serena Villata. A natural language bipolar argumentation approach to sup- port users in online debate interactions. Argument & Com- putation, 4(3):209-230, 2013.","title":"Elena Cabrio and Serena Villata. A natural language bipolar argumentation approach to support users in online debate interactions","authors":"Villata Cabrio","year":"2013","venue":"Argument & Computation","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Daxenberger et al., 2017] Johannes Daxenberger, Steffen Eger, Ivan Habernal, Christian Stab, and Iryna Gurevych. What is the essence of a claim? cross-domain claim iden- tification. In EMNLP, pages 2055-2066, 2017.","title":"What is the essence of a claim? cross-domain claim identification","authors":"Johannes Daxenberger, Steffen Eger, Ivan Habernal, Christian Stab, Iryna Gurevych","year":"2017","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Durmus and Cardie, 2018] Esin Durmus and Claire Cardie. Exploting the role of prior beliefs for argument persuasion. In NAACL, page 1035-1045, 2018.","title":"Exploting the role of prior beliefs for argument persuasion","authors":"Cardie ; ] Esin Durmus, Claire Durmus, Cardie","year":"2018","venue":"NAACL","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Dusmanu et al., 2017] Mihai Dusmanu, Elena Cabrio, and Serena Villata. Argument mining on twitter: Arguments, facts and sources. In EMNLP, pages 2317-2322, 2017.","title":"Argument mining on twitter: Arguments, facts and sources","authors":"Mihai Dusmanu, Elena Cabrio, Serena Villata","year":"2017","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Duthie et al., 2016] Rory Duthie, Katarzyna Budzynska, and Chris Reed. Mining ethos in political debate. In COMMA, pages 299-310, 2016.","title":"Mining ethos in political debate","authors":"Rory Duthie, Katarzyna Budzynska, Chris Reed","year":"2016","venue":"COMMA","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Eger et al., 2017] Steffen Eger, Johannes Daxenberger, and Iryna Gurevych. Neural end-to-end learning for computa- tional argumentation mining. In ACL, pages 11-22, 2017.","title":"Neural end-to-end learning for computational argumentation mining","authors":"Steffen Eger, Johannes Daxenberger, Iryna Gurevych","year":"2017","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Grabmair et al., 2015] Matthias Grabmair, Kevin D. Ash- ley, Ran Chen, Preethi Sureshkumar, Chen Wang, Eric Ny- berg, and Vern R. Walker. Introducing LUIMA: an exper- iment in legal conceptual retrieval of vaccine injury de- cisions using a UIMA type system and tools. In ICAIL, pages 69-78, 2015.","title":"Introducing LUIMA: an experiment in legal conceptual retrieval of vaccine injury decisions using a UIMA type system and tools","authors":"Matthias Grabmair, Kevin D Ashley, Ran Chen, Preethi Sureshkumar, Chen Wang, Eric Nyberg, Vern R Walker","year":"2015","venue":"ICAIL","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Habernal and Gurevych, 2016] Ivan Habernal and Iryna Gurevych. Which argument is more convincing? analyz- ing and predicting convincingness of web arguments using bidirectional LSTM. In ACL, page 1589-1599, 2016.","title":"Ivan Habernal and Iryna Gurevych. Which argument is more convincing? analyzing and predicting convincingness of web arguments using bidirectional LSTM","authors":"Gurevych Habernal","year":"2016","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Habernal and Gurevych, 2017] I. Habernal and I. Gurevych. Argumentation mining in user-generated web discourse. Comput. Linguist., 43(1):125-179, 2017.","title":"Argumentation mining in user-generated web discourse","authors":"Gurevych Habernal, I Habernal, I Gurevych","year":"2017","venue":"Comput. Linguist","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Hua and Wang, 2017] Xinyu Hua and Lu Wang. Under- standing and detecting diverse supporting arguments on controversial issues. In ACL, pages 203-208, 2017.","title":"Understanding and detecting diverse supporting arguments on controversial issues","authors":"Xinyu Hua, Lu Wang","year":"2017","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Ibeke et al., 2017] Ebuka Ibeke, Chenghua Lin, Adam Z. Wyner, and Mohamad Hardyman Barawi. Extracting and understanding contrastive opinion through topic relevant sentences. In IJCNLP, pages 395-400, 2017.","title":"Extracting and understanding contrastive opinion through topic relevant sentences","authors":"Ebuka Ibeke, Chenghua Lin, Adam Z Wyner, Mohamad Hardyman Barawi","year":"2017","venue":"IJCNLP","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Khatib et al., 2016] Khalid Al Khatib, Henning Wachsmuth, Matthias Hagen, Jonas Köhler, and Benno Stein. Cross-domain mining of argumentative text through distant supervision. In NAACL, pages 1395-1404, 2016.","title":"Cross-domain mining of argumentative text through distant supervision","authors":"Al Khalid, Henning Khatib, Matthias Wachsmuth, Jonas Hagen, Benno Köhler, Stein","year":"2016","venue":"NAACL","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Levy et al., 2014] Ran Levy, Yonatan Bilu, Daniel Hersh- covich, Ehud Aharoni, and Noam Slonim. Context de- pendent claim detection. In COLING, pages 1489-1500, 2014.","title":"Context dependent claim detection","authors":"Ran Levy, Yonatan Bilu, Daniel Hershcovich, Ehud Aharoni, Noam Slonim","year":"2014","venue":"COLING","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Lippi and Torroni, 2016a] Marco Lippi and Paolo Torroni. Argument mining from speech: Detecting claims in polit- ical debates. In AAAI, pages 2979-2985, 2016.","title":"Argument mining from speech: Detecting claims in political debates","authors":"Torroni Lippi, Marco Lippi, Paolo Torroni","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Lippi and Torroni, 2016b] Marco Lippi and Paolo Torroni. Argumentation mining: State of the art and emerging trends. ACM Trans. Internet Techn., 16(2):10, 2016.","title":"Argumentation mining: State of the art and emerging trends","authors":"Torroni Lippi, Marco Lippi, Paolo Torroni","year":"2016","venue":"ACM Trans. Internet Techn","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Lippi and Torroni, 2016c] Marco Lippi and Paolo Torroni. Margot: A web server for argumentation mining. Expert Systems with Applications, 65:292-303, 12 2016.","title":"Margot: A web server for argumentation mining","authors":"Torroni Lippi, Marco Lippi, Paolo Torroni","year":"2016","venue":"Expert Systems with Applications","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Menini et al., 2018] Stefano Menini, Elena Cabrio, Sara Tonelli, and Serena Villata. Never retreat, never retract: Argumentation analysis for political speeches. In AAAI, pages 4889-4896, 2018.","title":"Never retreat, never retract: Argumentation analysis for political speeches","authors":"Stefano Menini, Elena Cabrio, Sara Tonelli, Serena Villata","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Mochales and Moens, 2011] Rachele Mochales and Marie- Francine Moens. Argumentation mining. Artificial Intelli- gence and Law, 19(1):1-22, 2011.","title":"Rachele Mochales and Marie-Francine Moens. Argumentation mining","authors":"Moens Mochales","year":"2011","venue":"Artificial Intelligence and Law","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Naderi and Hirst, 2015] Nona Naderi and Graeme Hirst. Argumentation mining in parliamentary discourse. In CMNA, pages 16-25, 2015.","title":"Argumentation mining in parliamentary discourse","authors":"Hirst Naderi, Nona Naderi, Graeme Hirst","year":"2015","venue":"CMNA","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Nguyen and Litman, 2018] Huy V. Nguyen and Diane J. Litman. Argument mining for improving the automated scoring of persuasive essays. In AAAI, pages 5892-5899, 2018.","title":"Argument mining for improving the automated scoring of persuasive essays","authors":"V Huy, Diane J Nguyen, Litman","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Niculae et al., 2017] Vlad Niculae, Joonsuk Park, and Claire Cardie. Argument mining with structured svms and rnns. In ACL, pages 985-995, 2017.","title":"Argument mining with structured svms and rnns","authors":"Niculae","year":"2017","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Peldszus and Stede, 2013] Andreas Peldszus and Manfred Stede. From argument diagrams to argumentation mining in texts: A survey. IJCINI, 7(1):1-31, 2013.","title":"From argument diagrams to argumentation mining in texts: A survey","authors":"Stede Peldszus, Andreas Peldszus, Manfred Stede","year":"2013","venue":"IJCINI","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Peldszus and Stede, 2015] Andreas Peldszus and Mandred Stede. Joint prediction in mst-style discourse parsing for argumentation mining. In EMNLP, page 938-948, 2015.","title":"Joint prediction in mst-style discourse parsing for argumentation mining","authors":"Stede Peldszus, Andreas Peldszus, Mandred Stede","year":"2015","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Peldszus and Stede, 2016] Andreas Peldszus and Manfred Stede. An annotated corpus of argumentative microtexts. In ECA, pages 801-815, 2016.","title":"An annotated corpus of argumentative microtexts","authors":"Stede Peldszus, Andreas Peldszus, Manfred Stede","year":"2016","venue":"ECA","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Persing and Ng, 2017] Isaac Persing and Vincent Ng. Why can't you convince me? modeling weaknesses in unper- suasive arguments. In IJCAI, pages 4082-4088, 2017.","title":"Why can't you convince me? modeling weaknesses in unpersuasive arguments","authors":"Ng Persing, Isaac Persing, Vincent Ng","year":"2017","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2017/570"},{"position":44,"raw":"[Rinott et al., 2015] Ruty Rinott, Lena Dankin, Carlos Alzate, Mitesh M. Khapra, Ehud Aharoni, and Noam Slonim. Show me your evidence -an automatic method for context dependent evidence detection. In EMNLP, pages 440-450, 2015.","title":"Show me your evidence -an automatic method for context dependent evidence detection","authors":"Ruty Rinott, Lena Dankin, Carlos Alzate, M Mitesh, Ehud Khapra, Noam Aharoni, Slonim","year":"2015","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":45,"raw":"[Schulz et al., 2018] Claudia Schulz, Steffen Eger, Johannes Daxenberger, Tobias Kahse, and Iryna Gurevych. Multi- task learning for argumentation mining in low-resource settings. In NAACL, page 35-41, 2018.","title":"Multitask learning for argumentation mining in low-resource settings","authors":"Claudia Schulz, Steffen Eger, Johannes Daxenberger, Tobias Kahse, Iryna Gurevych","year":"2018","venue":"NAACL","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Stab and Gurevych, 2017] Christian Stab and Iryna Gurevych. Parsing argumentation structures in persuasive essays. Comput. Linguist., 43(3):619-659, 2017.","title":"Christian Stab and Iryna Gurevych. Parsing argumentation structures in persuasive essays","authors":"Gurevych Stab","year":"2017","venue":"Comput. Linguist","doi":null,"url":null,"internal_url":null},{"position":47,"raw":"[Stab et al., 2018] Christian Stab, Tristan Miller, and Iryna Gurevych. Cross-topic argument mining from hetero- geneous sources using attention-based neural networks. CoRR, abs/1802.05758, 2018.","title":"Christian Stab, Tristan Miller, and Iryna Gurevych. Cross-topic argument mining from heterogeneous sources using attention-based neural networks","authors":"Stab","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":48,"raw":"[Teruel et al., 2018] Milagro Teruel, Cristian Cardellino, Fernando Cardellino, Laura Alonso Alemany, and Serena Villata. Increasing argument annotation reproducibility by using inter-annotator agreement to improve guidelines. In LREC, pages 4061-4064, 2018.","title":"Increasing argument annotation reproducibility by using inter-annotator agreement to improve guidelines","authors":"Milagro Teruel, Cristian Cardellino, Fernando Cardellino, Laura Alonso Alemany, Serena Villata","year":"2018","venue":"LREC","doi":null,"url":null,"internal_url":null},{"position":49,"raw":"[Teufel et al., 2009] Simone Teufel, Advaith Siddharthan, and Colin Batchelor. Towards domain-independent argu- mentative zoning: Evidence from chemistry and computa- tional linguistics. In EMNLP, pages 1493-1502, 2009.","title":"Towards domain-independent argumentative zoning: Evidence from chemistry and computational linguistics","authors":"Simone Teufel, Advaith Siddharthan, Colin Batchelor","year":"2009","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":50,"raw":"[Villalba and Saint-Dizier, 2012] María Paz García Villalba and Patrick Saint-Dizier. A framework to extract argu- ments in opinion texts. IJCINI, 6(3):62-87, 2012.","title":"María Paz García Villalba and Patrick Saint-Dizier. A framework to extract arguments in opinion texts","authors":"Saint-Dizier Villalba","year":"2012","venue":"IJCINI","doi":null,"url":null,"internal_url":null},{"position":51,"raw":"[Wachsmuth et al., 2017] Henning Wachsmuth, Nona Naderi, Ivan Habernal, Yufang Hou, Graeme Hirst, Iryna Gurevych, and Benno Stein. Argumentation quality assessment: Theory vs. practice. In ACL, pages 250-255, 2017.","title":"Argumentation quality assessment: Theory vs. practice","authors":"Henning Wachsmuth, Nona Naderi, Ivan Habernal, Yufang Hou, Graeme Hirst, Iryna Gurevych, Benno Stein","year":"2017","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":52,"raw":"[Walker et al., 2012] Marylin Walker, Jean Fox Tree, Pranav Anand, R. Abbott, and Joseph King. A corpus for re- search on deliberation and debate. In LREC, pages 812- 817, 2012.","title":"A corpus for research on deliberation and debate","authors":"Marylin Walker, Jean Fox Tree, Pranav Anand, R Abbott, Joseph King","year":"2012","venue":"LREC","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}