{"type":"ScholarlyArticle","title":"Applying Hybrid Approach of Complexity Annotator Tool and Machine Learning for Lexical Complexity Detection and Simplification in Amharic Text","authors":[{"name":"Gebregziabihier Nigusie","slug":"gebregziabihier-nigusie","given":"Gebregziabihier","family":"Nigusie","affiliation":"Bahir Dar Institute of Technology"},{"name":"Tesfa Tegegne","slug":"tesfa-tegegne","given":"Tesfa","family":"Tegegne","affiliation":"Bahir Dar Institute of Technology"}],"abstract":"Text complexity refers to how difficult a document is for target readers to understand. The Amharic language includes complex and unfamiliar words that may cause low-literacy readers to misunderstand the document. In addition to human readers, such text complexity also poses challenges for NLP applications like machine translation.\r\nTo detect and reduce this type of complexity for one of the Semitic family, low-resourced and morphologically reached language Amharic, we have applied a hybrid approach of complexity annotator tool and machine learning. The Amharic text complexity annotator tool is built using 1113 complex terms. Then based on the annotated dataset we have developed complexity classification and simplification models.\r\nFor the classification experiment, we used 26.4k sentences to train Long Short-Term Memory, Bidirectional Long Short-Term Memory, and Bidirectional Encoder Representations from Transformers pre-trained models. To embed these sentences, we have built Word2Vec and BERT embeddings. using 9756 vocabularies. The experimental result of these models scores an accuracy of 84.1\\%(LSTM), 86\\%(BiLSTM), and 90\\%(BERT). Based on the experimental result the BERT model has better classification accuracy, because of its ability to handle long-term information dependency. The simplification generation for the identified complex term using cosine similarity results 92\\% for top-ranked and 53\\% for lowest-ranked simplest equivalents from five top-generated words.","doi":"10.24963/ijcai.aai4g.2024/7","url":"https://ijcai.org/proceedings_aai4g/2024/7","pdf":"https://ijcai.org/proceedings_aai4g/2024/0007.pdf","markdown":"https://ijcai.org/proceedings_aai4g/2024/7.md","bibtex":"https://ijcai.org/proceedings_aai4g/2024/bibtex/7","volume":{"slug":"aai4g-2024","title":"Proceedings of the Second IJCAI AI for Good Symposium in Africa hosted by Deep Learning Indaba","short_title":"AI for Good Africa 2024","url":"https://ijcai.org/proceedings_aai4g/2024/","year":2024,"location":"Dakar, Senegal","dates":"1-7 September 2024","editors":"Avishkar Bhoopchand, Girmaw Abebe Tadesse, Sibusisiwe Makhanya, Frank Dignum, Georgina Curto","isbn":"978-1-956792-07-2","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.aai4g.2024"},"section":"Indaba","track":"Indaba","number":7,"pages":{"first":42,"last":49},"keywords":["Indaba: Indaba"],"videos":[],"references":[{"position":1,"raw":"[Berhane, 2011] Girmay Berhane. In search of pre-service efl certificate teachers attitudes towards technology. Pro- cedia Computer Science, 3:666-671, 2011.","title":"Girmay Berhane. In search of pre-service efl certificate teachers attitudes towards technology","authors":"Berhane","year":"2011","venue":"Procedia Computer Science","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bessou and Chenni, 2021] Sadik Bessou and Ghozlane Chenni. Efficient measuring of readability to improve doc- uments accessibility for arabic language learners. Journal of Digital Information Management, 19(3):75-82, 2021.","title":"Efficient measuring of readability to improve documents accessibility for arabic language learners","authors":"Chenni Bessou, Sadik Bessou, Ghozlane Chenni","year":"2021","venue":"Journal of Digital Information Management","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Tal, 2021] Perry Tal. Lighttag: Text annotation platform. In Proceedings of the 2021 Conference on Empirical Meth- ods in Natural Language Processing: System Demonstra- tions, pages 20-27. Association for Computational Lin- guistics, November 2021.","title":"Lighttag: Text annotation platform","authors":"Perry Tal, Tal","year":"2021","venue":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Uluslu, 2022] Ahmet Uluslu. Automatic lexical simplifica- tion for turkish. ArXiv, 2201(05878), 2022.","title":"Ahmet Uluslu. Automatic lexical simplification for turkish","authors":"Uluslu","year":"2022","venue":"ArXiv","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[USAID, 2018] USAID. Ethiopia Early Grade Reading As- sessment 2018. USAID, 2018.","title":"USAID. Ethiopia Early Grade Reading Assessment 2018","authors":null,"year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Woldeyohannis and Meshesha, 2022] Michael Melese Woldeyohannis and Million Meshesha. Usable amharic text corpus for natural language processing applications. Applied Corpus Linguistics, 2(3):100033, 2022.","title":"Usable amharic text corpus for natural language processing applications","authors":"Michael Melese, Woldeyohannis, Million Meshesha","year":"2022","venue":"Applied Corpus Linguistics","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Zhang et al., 2008] Wen Zhang, Taketoshi Yoshida, and Xijin Tang. Knowledge-based systems text classifica- tion based on multi-word with support vector machine. Knowledge-Based Systems, 21:879-886, 2008.","title":"Knowledge-based systems text classification based on multi-word with support vector machine","authors":"Wen Zhang, Taketoshi Yoshida, Xijin Tang","year":"2008","venue":"Knowledge-Based Systems","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}