{"type":"ScholarlyArticle","title":"Automated Essay Scoring: A Survey of the State of the Art","authors":[{"name":"Zixuan Ke","slug":"zixuan-ke","given":"Zixuan","family":"Ke","affiliation":"Human Language Technology Research Institute , University of Texas at Dallas , USA"},{"name":"Vincent Ng","slug":"vincent-ng","given":"Vincent","family":"Ng","affiliation":"Human Language Technology Research Institute , University of Texas at Dallas , USA"}],"abstract":"Despite being investigated for over 50 years, the task of automated essay scoring is far from being solved. Nevertheless, it continues to draw a lot of attention in the natural language processing community in part because of its commercial and educational values as well as the associated research challenges. This paper presents an overview of the major milestones made in automated essay scoring research since its inception.","doi":"10.24963/ijcai.2019/879","url":"https://ijcai.org/proceedings/2019/879","pdf":"https://ijcai.org/proceedings/2019/0879.pdf","markdown":"https://ijcai.org/proceedings/2019/879.md","bibtex":"https://ijcai.org/proceedings/2019/bibtex/879","volume":{"slug":"2019","title":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2019","url":"https://ijcai.org/proceedings/2019/","year":2019,"location":"Macao","dates":"10-16 August 2019","editors":"Sarit Kraus","isbn":"978-0-9992411-4-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2019"},"section":"Survey track","track":"Survey track","number":879,"pages":{"first":6300,"last":6308},"keywords":["Natural Language Processing: NLP Applications and Tools"],"videos":[],"references":[{"position":1,"raw":"[Alikaniotis et al., 2016] Dimitrios Alikaniotis, Helen Yan- nakoudakis, and Marek Rei. Automatic text scoring using neural networks. In Proc. of ACL, pages 715-725, 2016.","title":"Automatic text scoring using neural networks","authors":"Dimitrios Alikaniotis, Helen Yannakoudakis, Marek Rei","year":"2016","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Amorim et al., 2018] Evelin Amorim, Marcia Canc ¸ado, and Adriano Veloso. Automated essay scoring in the presence of biased ratings. In Proc. of NAACL-HLT, pages 229-237, 2018.","title":"Automated essay scoring in the presence of biased ratings","authors":"Evelin Amorim, Marcia Canc, Adriano Veloso","year":"2018","venue":"Proc. of NAACL-HLT","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Attali and Burstein, 2006] Yigal Attali and Jill Burstein. Automated essay scoring with e-rater R v.2. The Journal of Technology, Learning and Assessment, 4(3), 2006.","title":"Automated essay scoring with e-rater R v.2","authors":"Burstein Attali, Yigal Attali, Jill Burstein","year":"2006","venue":"The Journal of Technology, Learning and Assessment","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Baker et al., 1998] Collin F. Baker, Charles J. Fillmore, and John B. Lowe. The Berkeley FrameNet project. In Proc. of COLING/ACL, pages 86-90, 1998.","title":"The Berkeley FrameNet project","authors":"Collin F Baker, Charles J Fillmore, John B Lowe","year":"1998","venue":"Proc. of COLING/ACL","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Barzilay and Lapata, 2008] Regina Barzilay and Mirella Lapata. Modeling local coherence: An entity-based ap- proach. Computational Linguistics, 34(1):1-34, 2008.","title":"Modeling local coherence: An entity-based approach","authors":"Lapata Barzilay, Regina Barzilay, Mirella Lapata","year":"2008","venue":"Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Blanchard et al., 2013] Daniel Blanchard, Joel Tetreault, Derrick Higgins, Aoife Cahill, and Martin Chodorow. TOEFL11: A corpus of non-native English. ETS Research Report Series, 2013(2):i-15, 2013.","title":"TOEFL11: A corpus of non-native English","authors":"Daniel Blanchard, Joel Tetreault, Derrick Higgins, Aoife Cahill, Martin Chodorow","year":"2013","venue":"ETS Research Report Series","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Breland et al., 1994] Hunter M. Breland, Robert J. Jones, Laura Jenkins, Marion Paynter, Judith Pollack, and Y. Fai Fong. The college board vocabulary study. ETS Research Report Series, 1994(1):i-51, 1994.","title":"The college board vocabulary study","authors":"M Hunter, Robert J Breland, Laura Jones, Marion Jenkins, Judith Paynter, Y Fai Pollack, Fong","year":"1994","venue":"ETS Research Report Series","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Burstein et al., 2004] Jill Burstein, Martin Chodorow, and Claudia Leacock. Automated essay evaluation: The Crite- rion online writing service. AI Magazine, 25(3):27, 2004.","title":"Automated essay evaluation: The Criterion online writing service","authors":"Jill Burstein, Martin Chodorow, Claudia Leacock","year":"2004","venue":"AI Magazine","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Burstein et al., 2010] Jill Burstein, Joel Tetreault, and Slava Andreyev. Using entity-based features to model coherence in student essays. In Proc. of NAACL-HLT, pages 681- 684, 2010.","title":"Using entity-based features to model coherence in student essays","authors":"Jill Burstein, Joel Tetreault, Slava Andreyev","year":"2010","venue":"Proc. of NAACL-HLT","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Carlile et al., 2018] Winston Carlile, Nishant Gurrapadi, Zixuan Ke, and Vincent Ng. Give me more feedback: An- notating argument persuasiveness and related attributes in student essays. In Proc. of ACL, pages 621-631, 2018.","title":"Give me more feedback: Annotating argument persuasiveness and related attributes in student essays","authors":"Winston Carlile, Nishant Gurrapadi, Zixuan Ke, Vincent Ng","year":"2018","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Chen and He, 2013] Hongbo Chen and Ben He. Automated essay scoring by maximizing human-machine agreement. In Proc. of EMNLP, pages 1741-1752, 2013.","title":"Automated essay scoring by maximizing human-machine agreement","authors":"Hongbo Chen, Ben He","year":"2013","venue":"Proc. of EMNLP","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Chen et al., 2010] Yen-Yu Chen, Chien-Liang Liu, Chia- Hoang Lee, and Tao-Hsing Chang. An unsupervised au- tomated essay-scoring system. IEEE Intelligent systems, 25(5):61-67, 2010.","title":"An unsupervised automated essay-scoring system","authors":"Yen-Yu Chen, Chien-Liang Liu, Chia-Hoang Lee, Tao-Hsing Chang","year":"2010","venue":"IEEE Intelligent systems","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Collobert and Weston, 2008] Ronan Collobert and Jason Weston. A unified architecture for natural language pro- cessing: Deep neural networks with multitask learning. In Proc. of ICML, pages 160-167, 2008.","title":"A unified architecture for natural language processing: Deep neural networks with multitask learning","authors":"Weston ; Collobert, Ronan Collobert, Jason Weston","year":"2008","venue":"Proc. of ICML","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Cozma et al., 2018] Madalina Cozma, Andrei Butnaru, and Radu Tudor Ionescu. Automated essay scoring with string kernels and word embeddings. In Proc. of ACL, pages 503-509, 2018.","title":"Automated essay scoring with string kernels and word embeddings","authors":"Madalina Cozma, Andrei Butnaru, Radu Tudor, Ionescu","year":"2018","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Crossley et al., 2015] Scott Crossley, Laura K. Allen, Er- ica L. Snow, and Danielle S. McNamara. Pssst... textual features... there is more to automatic essay scoring than just you! In Proc. of ICLAK, pages 203-207, 2015.","title":"Pssst... textual features... there is more to automatic essay scoring than just you!","authors":"Scott Crossley, Laura K Allen, Erica L Snow, Danielle S Mcnamara","year":"2015","venue":"Proc. of ICLAK","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Cummins et al., 2016] Ronan Cummins, Meng Zhang, and Ted Briscoe. Constrained multi-task learning for auto- mated essay scoring. In Proc. of ACL, pages 789-799, 2016.","title":"Constrained multi-task learning for automated essay scoring","authors":"Ronan Cummins, Meng Zhang, Ted Briscoe","year":"2016","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Daumé III, 2007] Hal Daumé III. Frustratingly easy domain adaptation. In Proc. of ACL, pages 256-263, 2007.","title":"Hal Daumé III. Frustratingly easy domain adaptation","authors":"Iii Daumé","year":"2007","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Devlin et al., 2019] Jacob Devlin, Ming-Wei Chang, Ken- ton Lee, and Kristina Toutanova. BERT: Pre-training of deep bidirectional transformers for language understand- ing. In Proc. of NAACL-HLT, pages 4171-4186, 2019.","title":"BERT: Pre-training of deep bidirectional transformers for language understanding","authors":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova","year":"2019","venue":"Proc. of NAACL-HLT","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Dong and Zhang, 2016] Fei Dong and Yue Zhang. Auto- matic features for essay scoring -An empirical study. In Proc. of EMNLP, pages 1072-1077, 2016.","title":"Automatic features for essay scoring -An empirical study","authors":"Fei Dong, Yue Zhang","year":"2016","venue":"Proc. of EMNLP","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Dong et al., 2017] Fei Dong, Yue Zhang, and Jie Yang. Attention-based recurrent convolutional neural network for automatic essay scoring. In Proc. of CoNLL, pages 153-162, 2017.","title":"Attention-based recurrent convolutional neural network for automatic essay scoring","authors":"Fei Dong, Yue Zhang, Jie Yang","year":"2017","venue":"Proc. of CoNLL","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Farra et al., 2015] Noura Farra, Swapna Somasundaran, and Jill Burstein. Scoring persuasive essays using opinions and their targets. In Proc. of the BEA Workshop, pages 64-74, 2015.","title":"Scoring persuasive essays using opinions and their targets","authors":"Noura Farra, Swapna Somasundaran, Jill Burstein","year":"2015","venue":"Proc. of the BEA Workshop","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Faulkner, 2014] Adam Faulkner. Automated classification of stance in student essays: An approach using stance tar- get information and the Wikipedia link-based measure. In Proc. of FLAIRS, 2014.","title":"Automated classification of stance in student essays: An approach using stance target information and the Wikipedia link-based measure","authors":"Adam Faulkner, Faulkner","year":"2014","venue":"Proc. of FLAIRS","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Ghosh et al., 2016] Debanjan Ghosh, Aquila Khanam, Yubo Han, and Smaranda Muresan. Coarse-grained argu- mentation features for scoring persuasive essays. In Proc. of ACL, pages 549-554, 2016.","title":"Coarse-grained argumentation features for scoring persuasive essays","authors":"Debanjan Ghosh, Aquila Khanam, Yubo Han, Smaranda Muresan","year":"2016","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Granger et al., 2009] Sylviane Granger, Estelle Dagneaux, Fanny Meunier, and Magali Paquot. International Corpus of Learner English (Version 2). Presses universitaires de Louvain, 2009.","title":"International Corpus of Learner English (Version 2)","authors":"Granger","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Grosz et al., 1995] Barbara J. Grosz, Scott Weinstein, and Aravind K. Joshi. Centering: A framework for modeling the local coherence of discourse. Computational linguis- tics, 21(2):203-225, 1995.","title":"Centering: A framework for modeling the local coherence of discourse","authors":"Barbara J Grosz, Scott Weinstein, Aravind K Joshi","year":"1995","venue":"Computational linguistics","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Higgins et al., 2004] Derrick Higgins, Jill Burstein, Daniel Marcu, and Claudia Gentile. Evaluating multiple aspects of coherence in student essays. In Proc. of HLT-NAACL, pages 185-192, 2004.","title":"Evaluating multiple aspects of coherence in student essays","authors":"Derrick Higgins, Jill Burstein, Daniel Marcu, Claudia Gentile","year":"2004","venue":"Proc. of HLT-NAACL","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Hochreiter and Schmidhuber, 1997] Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural Computation, 9(8):1735-1780, 1997.","title":"Long short-term memory","authors":"Schmidhuber Hochreiter, Sepp Hochreiter, Jürgen Schmidhuber","year":"1997","venue":"Neural Computation","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Horbach et al., 2017] Andrea Horbach, Dirk Scholten- Akoun, Yuning Ding, and Torsten Zesch. Fine-grained es- say scoring of a complex writing task for native speakers. In Proc. of the BEA workshop, pages 357-366, 2017.","title":"Fine-grained essay scoring of a complex writing task for native speakers","authors":"Andrea Horbach, Dirk Scholten-Akoun, Yuning Ding, Torsten Zesch","year":"2017","venue":"Proc. of the BEA workshop","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Jin et al., 2018] Cancan Jin, Ben He, Kai Hui, and Le Sun. TDNN: A two-stage deep neural network for prompt- independent automated essay scoring. In Proc. of ACL, pages 1088-1097, 2018.","title":"TDNN: A two-stage deep neural network for promptindependent automated essay scoring","authors":"Cancan Jin, Ben He, Kai Hui, Le Sun","year":"2018","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Ke et al., 2018] Zixuan Ke, Winston Carlile, Nishant Gurra- padi, and Vincent Ng. Learning to give feedback: Model- ing attributes affecting argument persuasiveness in student essays. In Proc. of IJCAI, pages 4130-4136, 2018.","title":"Learning to give feedback: Modeling attributes affecting argument persuasiveness in student essays","authors":"Ke","year":"2018","venue":"Proc. of IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2018/574"},{"position":31,"raw":"[Klebanov and Flor, 2013] Beata Beigman Klebanov and Michael Flor. Word association profiles and their use for automated scoring of essays. In Proc. of ACL, pages 1148- 1158, 2013.","title":"Word association profiles and their use for automated scoring of essays","authors":"Flor ; Klebanov, Beigman Beata, Michael Klebanov, Flor","year":"2013","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Klebanov et al., 2013] Beata Beigman Klebanov, Nitin Madnani, and Jill Burstein. Using pivot-based paraphras- ing and sentiment profiles to improve a subjectivity lexi- con for essay data. Transactions of the ACL, 1:99-110, 2013.","title":"Using pivot-based paraphrasing and sentiment profiles to improve a subjectivity lexicon for essay data","authors":"Beata Beigman Klebanov, Nitin Madnani, Jill Burstein","year":"2013","venue":"Transactions of the ACL","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Klebanov et al., 2016] Beata Beigman Klebanov, Michael Flor, and Binod Gyawali. Topicality-based indices for es- say scoring. In Proc. of the BEA Workshop, pages 63-72, 2016.","title":"Topicality-based indices for essay scoring","authors":"Beata Beigman Klebanov, Michael Flor, Binod Gyawali","year":"2016","venue":"Proc. of the BEA Workshop","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Landauer et al., 2003] Thomas K. Landauer, Darrell La- ham, and Peter W. Foltz. Automated scoring and anno- tation of essays with the Intelligent Essay Assessor TM ˙In Automated Essay Scoring: A Cross-Disciplinary Perspec- tive, pages 87-112.","title":"Automated scoring and annotation of essays with the Intelligent Essay Assessor TM ˙In Automated Essay Scoring: A Cross-Disciplinary Perspective","authors":"Thomas K Landauer, Darrell Laham, Peter W Foltz","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":35,"raw":"Lawrence Erlbaum Associates, Mah- wah, NJ, 2003.","title":null,"authors":"Mahwah, Nj","year":"2003","venue":null,"doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Leacock et al., 2014] Claudia Leacock, Martin Chodorow, Michael Gamon, and Joel R. Tetreault. Automated Gram- matical Error Detection for Language Learners. Morgan & Claypool Publishers, 2nd edition, 2014. Synthesis Lec- tures on Human Language Technologies.","title":"Automated Grammatical Error Detection for Language Learners","authors":"Claudia Leacock, Martin Chodorow, Michael Gamon, Joel R Tetreault","year":"2014","venue":"Synthesis Lectures on Human Language Technologies","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Louis and Higgins, 2010] Annie Louis and Derrick Hig- gins. Off-topic essay detection using short prompt texts. In Proc. of the BEA Workshop, pages 92-95, 2010.","title":"Annie Louis and Derrick Higgins. Off-topic essay detection using short prompt texts","authors":"Higgins Louis","year":"2010","venue":"Proc. of the BEA Workshop","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Mann and Thompson, 1988] William C. Mann and San- dra A. Thompson. Rhetorical Structure Theory: To- ward a functional theory of text organization. Text- Interdisciplinary Journal for the Study of Discourse, 8(3):243-281, 1988.","title":"Rhetorical Structure Theory: Toward a functional theory of text organization","authors":"William C Mann, Sandra A Thompson","year":"1988","venue":"Text-Interdisciplinary Journal for the Study of Discourse","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[McNamara et al., 2015] Danielle S. McNamara, Scott A. Crossley, Rod D. Roscoe, Laura K. Allen, and Jianmin Dai. A hierarchical classification approach to automated essay scoring. Assessing Writing, 23:35-59, 2015.","title":"A hierarchical classification approach to automated essay scoring","authors":"Danielle S Mcnamara, Scott A Crossley, Rod D Roscoe, Laura K Allen, Jianmin Dai","year":"2015","venue":"Assessing Writing","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Miltsakaki and Kukich, 2004] Eleni Miltsakaki and Karen Kukich. Evaluation of text coherence for electronic es- say scoring systems. Natural Language Engineering, 10(1):25-55, 2004.","title":"Eleni Miltsakaki and Karen Kukich. Evaluation of text coherence for electronic essay scoring systems","authors":"Kukich Miltsakaki","year":"2004","venue":"Natural Language Engineering","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Morris and Hirst, 1991] Jane Morris and Graeme Hirst. Lexical cohesion computed by thesaural relations as an in- dicator of the structure of text. Computational Linguistics, 17(1):21-48, 1991.","title":"Lexical cohesion computed by thesaural relations as an indicator of the structure of text","authors":"Hirst Morris, Jane Morris, Graeme Hirst","year":"1991","venue":"Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Nguyen and Litman, 2018] Huy V. Nguyen and Diane J. Litman. Argument mining for improving the automated scoring of persuasive essays. In Proc. of AAAI, pages 5892-5899, 2018.","title":"Argument mining for improving the automated scoring of persuasive essays","authors":"V Huy, Diane J Nguyen, Litman","year":"2018","venue":"Proc. of AAAI","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Östling et al., 2013] Robert Östling, André Smolentzov, Björn Tyrefors Hinnerich, and Erik Höglin. Automated essay scoring for Swedish. In Proc. of the BEA Workshop, pages 42-47, 2013.","title":"Automated essay scoring for Swedish","authors":"Robert Östling, André Smolentzov, Björn Tyrefors Hinnerich, Erik Höglin","year":"2013","venue":"Proc. of the BEA Workshop","doi":null,"url":null,"internal_url":null},{"position":44,"raw":"Ellis B Page. The imminence of... grading es- says by computer. The Phi Delta Kappan, 47(5):238-243, 1966.","title":"The imminence of... grading essays by computer","authors":"Ellis B Page","year":"1966","venue":"The Phi Delta Kappan","doi":null,"url":null,"internal_url":null},{"position":45,"raw":"[Pennington et al., 2014] Jeffrey Pennington, Richard Socher, and Christopher D. Manning. GloVe: Global vectors for word representation. In Proc. of EMNLP, pages 1532-1543, 2014.","title":"GloVe: Global vectors for word representation","authors":"Jeffrey Pennington, Richard Socher, Christopher D Manning","year":"2014","venue":"Proc. of EMNLP","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Persing and Ng, 2013] Isaac Persing and Vincent Ng. Mod- eling thesis clarity in student essays. In Proc. of ACL, pages 260-269, 2013.","title":"Modeling thesis clarity in student essays","authors":"Ng Persing, Isaac Persing, Vincent Ng","year":"2013","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":47,"raw":"[Persing and Ng, 2014] Isaac Persing and Vincent Ng. Mod- eling prompt adherence in student essays. In Proc. of ACL, pages 1534-1543, 2014.","title":"Modeling prompt adherence in student essays","authors":"Ng Persing, Isaac Persing, Vincent Ng","year":"2014","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":48,"raw":"[Persing and Ng, 2015] Isaac Persing and Vincent Ng. Mod- eling argument strength in student essays. In Proc. of ACL- IJCNLP, pages 543-552, 2015.","title":"Modeling argument strength in student essays","authors":"Ng Persing, Isaac Persing, Vincent Ng","year":"2015","venue":"Proc. of ACL-IJCNLP","doi":null,"url":null,"internal_url":null},{"position":49,"raw":"[Persing et al., 2010] Isaac Persing, Alan Davis, and Vincent Ng. Modeling organization in student essays. In Proc. of EMNLP, pages 229-239, 2010.","title":"Modeling organization in student essays","authors":"Persing","year":"2010","venue":"Proc. of EMNLP","doi":null,"url":null,"internal_url":null},{"position":50,"raw":"[Phandi et al., 2015] Peter Phandi, Kian Ming A Chai, and Hwee Tou Ng. Flexible domain adaptation for automated essay scoring using correlated linear regression. In Proc. of EMNLP, pages 431-439, 2015.","title":"Flexible domain adaptation for automated essay scoring using correlated linear regression","authors":"Peter Phandi, Ming A Kian, Hwee Tou Chai, Ng","year":"2015","venue":"Proc. of EMNLP","doi":null,"url":null,"internal_url":null},{"position":51,"raw":"[Rudner and Liang, 2002] Lawrence M. Rudner and Tahung Liang. Automated essay scoring using Bayes' Theorem. The Journal of Technology, Learning and Assessment, 1(2), 2002.","title":"Automated essay scoring using Bayes' Theorem","authors":"Lawrence M Rudner, Tahung Liang","year":"2002","venue":"The Journal of Technology, Learning and Assessment","doi":null,"url":null,"internal_url":null},{"position":52,"raw":"[Shermis and Burstein, 2003] Mark D. Shermis and Jill C. Burstein. Automated Essay Scoring: A Cross-Disciplinary Perspective. Lawrence Erlbaum Associates, Mahwah, NJ, 2003.","title":"Automated Essay Scoring: A Cross-Disciplinary Perspective","authors":"Mark D Shermis, Jill C Burstein","year":"2003","venue":null,"doi":null,"url":null,"internal_url":null},{"position":53,"raw":"[Shermis and Burstein, 2013] Mark D. Shermis and Jill C. Burstein. Handbook of Automated Essay Evaluation: Cur- rent Applications and New Directions. Routledge, New York, NY, 2013.","title":"Handbook of Automated Essay Evaluation: Current Applications and New Directions","authors":"Mark D Shermis, Jill C Burstein","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":54,"raw":"[Somasundaran et al., 2014] Swapna Somasundaran, Jill Burstein, and Martin Chodorow. Lexical chaining for measuring discourse coherence quality in test-taker essays. In Proc. of COLING, pages 950-961, 2014.","title":"Lexical chaining for measuring discourse coherence quality in test-taker essays","authors":"Swapna Somasundaran, Jill Burstein, Martin Chodorow","year":"2014","venue":"Proc. of COLING","doi":null,"url":null,"internal_url":null},{"position":55,"raw":"[Stab and Gurevych, 2014] Christian Stab and Iryna Gurevych. Annotating argument components and rela- tions in persuasive essays. In Proc. of COLING, pages 1501-1510, 2014.","title":"Christian Stab and Iryna Gurevych. Annotating argument components and relations in persuasive essays","authors":"Gurevych Stab","year":"2014","venue":"Proc. of COLING","doi":null,"url":null,"internal_url":null},{"position":56,"raw":"[Sutskever et al., 2014] Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. Sequence to sequence learning with neural networks. In Proc. of NIPS, pages 3104-3112, 2014.","title":"Le. Sequence to sequence learning with neural networks","authors":"Sutskever","year":"2014","venue":"Proc. of NIPS","doi":null,"url":null,"internal_url":null},{"position":57,"raw":"[Taghipour and Ng, 2016] Kaveh Taghipour and Hwee Tou Ng. A neural approach to automated essay scoring. In Proc. of EMNLP, pages 1882-1891, 2016.","title":"A neural approach to automated essay scoring","authors":"Ng Taghipour, Kaveh Taghipour, Hwee Tou Ng","year":"2016","venue":"Proc. of EMNLP","doi":null,"url":null,"internal_url":null},{"position":58,"raw":"[Tay et al., 2018] Yi Tay, Minh C. Phan, Luu Anh Tuan, and Siu Cheung Hui. SkipFlow: Incorporating neural coher- ence features for end-to-end automatic text scoring. In Proc. of AAAI, pages 5948-5955, 2018.","title":"SkipFlow: Incorporating neural coherence features for end-to-end automatic text scoring","authors":"Yi Tay, Minh C Phan, Anh Luu, Siu Tuan, Hui Cheung","year":"2018","venue":"Proc. of AAAI","doi":null,"url":null,"internal_url":null},{"position":59,"raw":"[Vajjala, 2018] Sowmya Vajjala. Automated assessment of non-native learner essays: Investigating the role of linguis- tic features. International Journal of Artificial Intelligence in Education, 28(1):79-105, 2018.","title":"Automated assessment of non-native learner essays: Investigating the role of linguistic features","authors":"Sowmya Vajjala","year":"2018","venue":"International Journal of Artificial Intelligence in Education","doi":null,"url":null,"internal_url":null},{"position":60,"raw":"[Wachsmuth et al., 2016] Henning Wachsmuth, Khalid Al Khatib, and Benno Stein. Using argument mining to assess the argumentation quality of essays. In Proc. of COLING, pages 1680-1691, 2016.","title":"Using argument mining to assess the argumentation quality of essays","authors":"Khalid Henning Wachsmuth, Al Khatib, Benno Stein","year":"2016","venue":"Proc. of COLING","doi":null,"url":null,"internal_url":null},{"position":61,"raw":"[Wang et al., 2018] Yucheng Wang, Zhongyu Wei, Yaqian Zhou, and Xuanjing Huang. Automatic essay scoring in- corporating rating schema via reinforcement learning. In Proc. of EMNLP, pages 791-797, 2018.","title":"Automatic essay scoring incorporating rating schema via reinforcement learning","authors":"Yucheng Wang, Zhongyu Wei, Yaqian Zhou, Xuanjing Huang","year":"2018","venue":"Proc. of EMNLP","doi":null,"url":null,"internal_url":null},{"position":62,"raw":"[Yannakoudakis and Briscoe, 2012] Helen Yannakoudakis and Ted Briscoe. Modeling coherence in ESOL learner texts. In Proc. of the BEA workshop, pages 33-43, 2012.","title":"Helen Yannakoudakis and Ted Briscoe. Modeling coherence in ESOL learner texts","authors":"Briscoe Yannakoudakis","year":"2012","venue":"Proc. of the BEA workshop","doi":null,"url":null,"internal_url":null},{"position":63,"raw":"[Yannakoudakis and Cummins, 2015] Helen Yannakoudakis and Ronan Cummins. Evaluating the performance of au- tomated text scoring systems. In Proceedings of the BEA Workshop, pages 213-223, 2015.","title":"Helen Yannakoudakis and Ronan Cummins. Evaluating the performance of automated text scoring systems","authors":"Cummins Yannakoudakis","year":"2015","venue":"Proceedings of the BEA Workshop","doi":null,"url":null,"internal_url":null},{"position":64,"raw":"[Yannakoudakis et al., 2011] Helen Yannakoudakis, Ted Briscoe, and Ben Medlock. A new dataset and method for automatically grading ESOL texts. In Proc. of ACL, pages 180-189, 2011.","title":"A new dataset and method for automatically grading ESOL texts","authors":"Helen Yannakoudakis, Ted Briscoe, Ben Medlock","year":"2011","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":65,"raw":"[Zesch et al., 2015] Torsten Zesch, Michael Wojatzki, and Dirk Scholten-Akoun. Task-independent features for au- tomated essay grading. In Proc. of the BEA Workshop, pages 224-232, 2015.","title":"Task-independent features for automated essay grading","authors":"Torsten Zesch, Michael Wojatzki, Dirk Scholten-Akoun","year":"2015","venue":"Proc. of the BEA Workshop","doi":null,"url":null,"internal_url":null},{"position":66,"raw":"[Zhang et al., 2017] Fan Zhang, Homa B. Hashemi, Rebecca Hwa, and Diane Litman. A corpus of annotated revisions for studying argumentative writing. In Proc. of ACL, pages 1568-1578, 2017.","title":"A corpus of annotated revisions for studying argumentative writing","authors":"Fan Zhang, B Homa, Rebecca Hashemi, Diane Hwa, Litman","year":"2017","venue":"Proc. of ACL","doi":null,"url":null,"internal_url":null},{"position":67,"raw":"[Zupanc and Bosnic, 2016] Kaja Zupanc and Zoran Bosnic. Advances in the field of automated essay evaluation. In- formatica, 39(4), 2016.","title":"Advances in the field of automated essay evaluation","authors":"Bosnic Zupanc, Kaja Zupanc, Zoran Bosnic","year":"2016","venue":"Informatica","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}