{"type":"ScholarlyArticle","title":"Improving Scientific Formula Verbalization in Large Speech Language Models for Accessible Learning","authors":[{"name":"Xueyi Li","slug":"xueyi-li","given":"Xueyi","family":"Li","affiliation":""},{"name":"Tianqiao Liu","slug":"tianqiao-liu","given":"Tianqiao","family":"Liu","affiliation":""},{"name":"Zitao Liu","slug":"zitao-liu","given":"Zitao","family":"Liu","affiliation":""},{"name":"Teng Guo","slug":"teng-guo","given":"Teng","family":"Guo","affiliation":""},{"name":"Yongdong Wu","slug":"yongdong-wu","given":"Yongdong","family":"Wu","affiliation":""}],"abstract":"Online learning systems provide accessible learning opportunities for blind or low-vision students. To support access to complex scientific materials, the speech models used in these systems need to deliver accurate scientific formula verbalization. While recent large speech language models (LSLMs) provide remarkable low-latency streaming capabilities, their potential for scientific formula verbalization remains underexplored. In this paper, we propose Formula-Speech, the first end-to-end LSLM designed for scientific formula verbalization. Specifically, we construct two high-quality scientific formula datasets with educational experts to align speech models with scientific formula verbalization patterns. We then adopt a lightweight and effective two-stage training framework, combining supervised fine-tuning for basic formula-to-speech alignment with reinforcement learning guided by a custom reward function to optimize for human-preferred verbalization. Experimental results show that our model significantly improves the verbalization performance of LSLMs and achieves state-of-the-art results across multiple scientific domains. Our code and datasets are available at https://github.com/ai4ed/FormulaSpeech.","doi":"10.24963/ijcai.2026/812","url":"https://ijcai.org/proceedings/2026/812","pdf":"https://ijcai.org/proceedings/2026/0812.pdf","markdown":"https://ijcai.org/proceedings/2026/812.md","bibtex":"https://ijcai.org/proceedings/2026/bibtex/812","volume":{"slug":"2026","title":"Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2026","url":"https://ijcai.org/proceedings/2026/","year":2026,"location":"Bremen, Germany","dates":"15-21 August 2026","editors":"Diego Calvanese","isbn":"978-1-956792-09-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2026"},"section":"AI and Social Good","track":"AI and Social Good","number":812,"pages":{"first":7301,"last":7309},"keywords":["AI4G: Multidisciplinary Topics and Applications","AI4G: Data Mining","AI4G: Humans and AI"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}