{"type":"ScholarlyArticle","title":"LivePoem: Improving the Learning Experience of Classical Chinese Poetry with AI-Generated Musical Storyboards","authors":[{"name":"Qihao Liang","slug":"qihao-liang","given":"Qihao","family":"Liang","affiliation":""},{"name":"Xichu Ma","slug":"xichu-ma","given":"Xichu","family":"Ma","affiliation":""},{"name":"Torin Hopkins","slug":"torin-hopkins","given":"Torin","family":"Hopkins","affiliation":""},{"name":"Ye Wang","slug":"ye-wang","given":"Ye","family":"Wang","affiliation":""}],"abstract":"Textbook reading has long dominated classical poetry education in Chinese-speaking communities. However, research has shown that extensive text-based learning can lead to learner disengagement and a less pleasant experience. This paper aims to improve the experience of classical Chinese poetry learning by introducing LivePoem—a system that generates musical storyboards (storyboards with background music) as audiovisual aids to support poetry comprehension. We employ a pre-trained diffusion model for storyboard generation and train a prosody-based poem-to-melody generator using a Transformer model, both validated by standard objective metrics to ensure generation quality. Through a within-subjects study involving 25 non-native Chinese learners, we compared learning outcomes from textbook reading and musical storyboard viewing through standardised reading comprehension tests. Additionally, the learning experience was assessed by the Self-Assessment Manikin (SAM) and an inductive thematic analysis of learners' open-ended feedback. Experimental results show that musical storyboards retained the learning outcomes of textbooks, while more effectively engaging learners and providing a more pleasant learning experience.","doi":"10.24963/ijcai.2025/1145","url":"https://ijcai.org/proceedings/2025/1145","pdf":"https://ijcai.org/proceedings/2025/1145.pdf","markdown":"https://ijcai.org/proceedings/2025/1145.md","bibtex":"https://ijcai.org/proceedings/2025/bibtex/1145","volume":{"slug":"2025","title":"Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2025","url":"https://ijcai.org/proceedings/2025/","year":2025,"location":"Montreal, Canada","dates":"16-22 August 2025","editors":"James Kwok","isbn":"978-1-956792-06-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2025"},"section":"Human-Centred AI","track":"Human-Centred AI","number":1145,"pages":{"first":10307,"last":10315},"keywords":["IJCAI25: Human-Centred AI"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}