{"type":"ScholarlyArticle","title":"MuChin: A Chinese Colloquial Description Benchmark for Evaluating Language Models in the Field of Music","authors":[{"name":"Zihao Wang","slug":"zihao-wang","given":"Zihao","family":"Wang","affiliation":"Zhejiang University ,; DuiNiuTanQin Co., Ltd."},{"name":"Shuyu Li","slug":"shuyu-li","given":"Shuyu","family":"Li","affiliation":"DuiNiuTanQin Co., Ltd.; Xi'an Jiaotong University"},{"name":"Tao Zhang","slug":"tao-zhang","given":"Tao","family":"Zhang","affiliation":"DuiNiuTanQin Co., Ltd."},{"name":"Qi Wang","slug":"qi-wang","given":"Qi","family":"Wang","affiliation":"DuiNiuTanQin Co., Ltd."},{"name":"Pengfei Yu","slug":"pengfei-yu","given":"Pengfei","family":"Yu","affiliation":"DuiNiuTanQin Co., Ltd."},{"name":"Jinyang Luo","slug":"jinyang-luo","given":"Jinyang","family":"Luo","affiliation":"DuiNiuTanQin Co., Ltd."},{"name":"Yan Liu","slug":"yan-liu","given":"Yan","family":"Liu","affiliation":"DuiNiuTanQin Co., Ltd."},{"name":"Ming Xi","slug":"ming-xi","given":"Ming","family":"Xi","affiliation":"DuiNiuTanQin Co., Ltd."},{"name":"Kejun Zhang","slug":"kejun-zhang","given":"Kejun","family":"Zhang","affiliation":"Zhejiang University ,; Innovation Center of Yangtze River Delta ,"}],"abstract":"The rapidly evolving multimodal Large Language Models (LLMs) urgently require new benchmarks to uniformly evaluate their performance on understanding and textually describing music. However, due to semantic gaps between Music Information Retrieval (MIR) algorithms and human understanding, discrepancies between professionals and the public, and low precision of annotations, existing music description datasets cannot serve as benchmarks. To this end, we present MuChin, the first open-source music description benchmark in Chinese colloquial language, designed to evaluate the performance of multimodal LLMs in understanding and describing music. We established the Caichong Music Annotation Platform (CaiMAP) that employs an innovative multi-person, multi-stage assurance method, and recruited both amateurs and professionals to ensure the precision of annotations and alignment with popular semantics. Utilizing this method, we built a large-scale, private dataset with multi-dimensional, high-precision music annotations, the Caichong Music Dataset (CaiMD), and carefully selected 1,000 high-quality entries to serve as the test set for MuChin. Based on MuChin, we analyzed the discrepancies between professionals and amateurs in terms of music description, and empirically demonstrated the effectiveness of CaiMD for fine-tuning LLMs. Ultimately, we employed MuChin to evaluate existing music understanding models on their ability to provide colloquial descriptions of music.","doi":"10.24963/ijcai.2024/860","url":"https://ijcai.org/proceedings/2024/860","pdf":"https://ijcai.org/proceedings/2024/0860.pdf","markdown":"https://ijcai.org/proceedings/2024/860.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/860","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"AI, Arts & Creativity","track":"AI, Arts & Creativity","number":860,"pages":{"first":7771,"last":7779},"keywords":["Methods and resources: Computational implementations inspired by fields such as psychology or cognitive science","Theory and philosophy of arts and creativity in AI systems: Evaluation and curation of artistic or creative artefacts","Application domains: Music and sound","Theory and philosophy of arts and creativity in AI systems: Cultural and social impacts of AI on creativity, creative practice, education and society","Theory and philosophy of arts and creativity in AI systems: Ethical issues raised by creative AI systems","Methods and resources: Datasets, knowledge bases and ontologies","Theory and philosophy of arts and creativity in AI systems: Social (multi-agent) creativity and human-computer co-creation","Methods and resources: AI methods for better understanding human creative processes","Methods and resources: AI systems for collaboration and co-creation","Theory and philosophy of arts and creativity in AI systems: Autonomous creative or artistic AI","Theory and philosophy of arts and creativity in AI systems: Other theory or philosophy of arts and creativity in AI"],"videos":[],"references":[{"position":1,"raw":"[Achiam et al., 2023] Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Alt- man, Shyamal Anadkat, et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774, 2023.","title":"Gpt-4 technical report","authors":"Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Agostinelli et al., 2023] Andrea Agostinelli, Timo I Denk, Zalán Borsos, Jesse Engel, Mauro Verzetti, Antoine Cail- lon, Qingqing Huang, Aren Jansen, Adam Roberts, Marco Tagliasacchi, et al. Musiclm: Generating music from text. arXiv preprint arXiv:2301.11325, 2023.","title":"Musiclm: Generating music from text","authors":"Andrea Agostinelli, I Timo, Zalán Denk, Jesse Borsos, Mauro Engel, Antoine Verzetti, Qingqing Caillon, Aren Huang, Adam Jansen, Marco Roberts, Tagliasacchi","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Amer et al., 2013] Tarek Amer, Beste Kalender, Lynn Hasher, Sandra E Trehub, and Yukwal Wong. Do older professional musicians have cognitive advantages? PloS one, 8(8):e71630, 2013.","title":"Do older professional musicians have cognitive advantages?","authors":"Tarek Amer, Beste Kalender, Lynn Hasher, Sandra E Trehub, Yukwal Wong","year":"2013","venue":"PloS one","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bai et al., 2023] Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, Jianxin Ma, Rui Men, Xingzhang Ren, Xu- ancheng Ren, Chuanqi Tan, Sinan Tan, Jianhong Tu, Peng Wang, Shijie Wang, Wei Wang, Shengguang Wu, Benfeng Xu, Jin Xu, An Yang, Hao Yang, Jian Yang, Shusheng Yang, Yang Yao, Bowen Yu, Hongyi Yuan, Zheng Yuan, Jianwei Zhang, Xingxuan Zhang, Yichang Zhang, Zhenru Zhang, Chang Zhou, Jingren Zhou, Xiaohuan Zhou, and Tianhang Zhu. Qwen technical report. arXiv preprint arXiv:2309.16609, 2023.","title":"Qwen technical report","authors":"Bai","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Baichuan, 2023] Baichuan. Baichuan 2: Open large-scale language models. arXiv preprint arXiv:2309.10305, 2023.","title":"Baichuan. Baichuan 2: Open large-scale language models","authors":"Baichuan","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Bertin-Mahieux et al., 2011] Thierry Bertin-Mahieux, Daniel PW Ellis, Brian Whitman, and Paul Lamere. The million song dataset. ISMIR, 2011.","title":"The million song dataset","authors":"Thierry Bertin-Mahieux, P W Daniel, Brian Ellis, Paul Whitman, Lamere","year":"2011","venue":"ISMIR","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Bogdanov et al., 2019] Dmitry Bogdanov, Minz Won, Philip Tovstogan, Alastair Porter, and Xavier Serra. The mtg-jamendo dataset for automatic music tagging. In ML4MD Machine Learning for Music Discovery Workshop at ICML2019. ICML, 2019.","title":"The mtg-jamendo dataset for automatic music tagging","authors":"Dmitry Bogdanov, Minz Won, Philip Tovstogan, Alastair Porter, Xavier Serra","year":"2019","venue":"ML4MD Machine Learning for Music Discovery Workshop at ICML2019","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Castellon et al., 2021] Rodrigo Castellon, Chris Donahue, and Percy Liang. Codified audio language modeling learns useful representations for music information retrieval. IS- MIR, 2021.","title":"Codified audio language modeling learns useful representations for music information retrieval","authors":"Rodrigo Castellon, Chris Donahue, Percy Liang","year":"2021","venue":"IS-MIR","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Chang et al., 2023] Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Kaijie Zhu, Hao Chen, Linyi Yang, Xi- aoyuan Yi, Cunxiang Wang, Yidong Wang, Wei Ye, Yue Zhang, Yi Chang, Philip S. Yu, Qiang Yang, and Xing Xie. A survey on evaluation of large language models. arXiv preprint arXiv:2307.03109, 2023.","title":"A survey on evaluation of large language models","authors":"Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Kaijie Zhu, Hao Chen, Linyi Yang, Xiaoyuan Yi, Cunxiang Wang, Yidong Wang, Wei Ye, Yue Zhang, Yi Chang, Philip S Yu, Qiang Yang, Xing Xie","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Copet et al., 2023] Jade Copet, Felix Kreuk, Itai Gat, Tal Remez, David Kant, Gabriel Synnaeve, Yossi Adi, and Alexandre Défossez. Simple and controllable music gen- eration. arXiv preprint arXiv:2306.05284, 2023.","title":"Simple and controllable music generation","authors":"Copet","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Défossez et al., 2022] Alexandre Défossez, Jade Copet, Gabriel Synnaeve, and Yossi Adi. High fidelity neural au- dio compression. arXiv preprint arXiv:2210.13438, 2022.","title":"High fidelity neural audio compression","authors":"Alexandre Défossez, Jade Copet, Gabriel Synnaeve, Yossi Adi","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Devlin et al., 2019] Jacob Devlin, Ming-Wei Chang, Ken- ton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understand- ing. In NAACL HLT 2019, volume 1, page 4171 -4186, 2019.","title":"Bert: Pre-training of deep bidirectional transformers for language understanding","authors":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova","year":"2019","venue":"NAACL HLT 2019","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Donahue and Liang, 2021] Chris Donahue and Percy Liang. Sheet sage: Lead sheets from music audio. Proc. ISMIR Late-Breaking and Demo, 2021.","title":"Sheet sage: Lead sheets from music audio","authors":"Chris Donahue, Percy Liang","year":"2021","venue":"Proc. ISMIR Late-Breaking and Demo","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Gardner et al., 2023] Josh Gardner, Simon Durand, Daniel Stoller, and Rachel M Bittner. Llark: A multimodal foun- dation model for music. arXiv preprint arXiv:2310.07160, 2023.","title":"Llark: A multimodal foundation model for music","authors":"Josh Gardner, Simon Durand, Daniel Stoller, Rachel M Bittner","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Huang et al., 2022] Qingqing Huang, Aren Jansen, Joon- seok Lee, Ravi Ganti, Judith Yue Li, and Daniel PW El- lis. Mulan: A joint embedding of music audio and natural language. ISMIR, 2022.","title":"Mulan: A joint embedding of music audio and natural language","authors":"Qingqing Huang, Aren Jansen, Joonseok Lee, Ravi Ganti, Judith Yue Li, Daniel Pw Ellis","year":"2022","venue":"ISMIR","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Huang et al., 2023a] Qingqing Huang, Daniel S Park, Tao Wang, Timo I Denk, Andy Ly, Nanxin Chen, Zhengdong Zhang, Zhishuai Zhang, Jiahui Yu, Christian Frank, et al. Noise2music: Text-conditioned music generation with dif- fusion models. arXiv preprint arXiv:2302.03917, 2023.","title":"Noise2music: Text-conditioned music generation with diffusion models","authors":"Huang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Huang et al., 2023b] Yuzhen Huang, Yuzhuo Bai, Zhihao Zhu, Junlei Zhang, Jinghan Zhang, Tangjun Su, Junteng Liu, Chuancheng Lv, Yikai Zhang, Jiayi Lei, Yao Fu, Maosong Sun, and Junxian He. C-eval: A multi-level multi-discipline chinese evaluation suite for foundation models. In Advances in Neural Information Processing Systems, 2023.","title":"C-eval: A multi-level multi-discipline chinese evaluation suite for foundation models","authors":"Huang","year":"2023","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Li et al., 2022] Yizhi Li, Ruibin Yuan, Ge Zhang, Yinghao Ma, Chenghua Lin, Xingran Chen, Anton Ragni, Hanzhi Yin, Zhijie Hu, Haoyu He, et al. Map-music2vec: A sim- ple and effective baseline for self-supervised music audio representation learning. ISMIR, 2022.","title":"Map-music2vec: A simple and effective baseline for self-supervised music audio representation learning","authors":"Yizhi Li, Ruibin Yuan, Ge Zhang, Yinghao Ma, Chenghua Lin, Xingran Chen, Anton Ragni, Hanzhi Yin, Zhijie Hu, Haoyu He","year":"2022","venue":"ISMIR","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Li et al., 2023] Yizhi Li, Ruibin Yuan, Ge Zhang, Yinghao Ma, Xingran Chen, Hanzhi Yin, Chenghua Lin, Anton Ragni, Emmanouil Benetos, Norbert Gyenge, Roger Dan- nenberg, Ruibo Liu, Wenhu Chen, Gus Xia, Yemin Shi, Wenhao Huang, Yike Guo, and Jie Fu. Mert: Acoustic mu- sic understanding model with large-scale self-supervised training, 2023.","title":"Mert: Acoustic music understanding model with large-scale self-supervised training","authors":"Yizhi Li, Ruibin Yuan, Ge Zhang, Yinghao Ma, Xingran Chen, Hanzhi Yin, Chenghua Lin, Anton Ragni, Emmanouil Benetos, Norbert Gyenge, Roger Dannenberg, Ruibo Liu, Wenhu Chen, Gus Xia, Yemin Shi, Wenhao Huang, Yike Guo, Jie Fu","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Liang et al., 2022] Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Ku- mar, et al. Holistic evaluation of language models. arXiv preprint arXiv:2211.09110, 2022.","title":"Holistic evaluation of language models","authors":"Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Lu et al., 2023] Peiling Lu, Xin Xu, Chenfei Kang, Botao Yu, Chengyi Xing, Xu Tan, and Jiang Bian. Musec- oco: Generating symbolic music from text. arXiv preprint arXiv:2306.00110, 2023.","title":"Musecoco: Generating symbolic music from text","authors":"Peiling Lu, Xin Xu, Chenfei Kang, Botao Yu, Chengyi Xing, Xu Tan, Jiang Bian","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Manco et al., 2021] Ilaria Manco, Emmanouil Benetos, Elio Quinton, and György Fazekas. Muscaps: Generating captions for music audio. In 2021 International Joint Con- ference on Neural Networks (IJCNN), pages 1-8. IEEE, 2021.","title":"Muscaps: Generating captions for music audio","authors":"Ilaria Manco, Emmanouil Benetos, Elio Quinton, György Fazekas","year":"2021","venue":"2021 International Joint Conference on Neural Networks (IJCNN)","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Melechovsky et al., 2023] Jan Melechovsky, Zixun Guo, Deepanway Ghosal, Navonil Majumder, Dorien Her- remans, and Soujanya Poria. Mustango: Toward controllable text-to-music generation. arXiv preprint arXiv:2311.08355, 2023.","title":"Mustango: Toward controllable text-to-music generation","authors":"Melechovsky","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Mikutta et al., 2014] CA Mikutta, Gieri Maissen, Andreas Altorfer, Werner Strik, and Thomas König. Profes- sional musicians listen differently to music. Neuroscience, 268:102-111, 2014.","title":"Professional musicians listen differently to music","authors":"Mikutta","year":"2014","venue":"Neuroscience","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Ratcliff et al., 1988] John W Ratcliff, David Metzener, et al. Pattern matching: The gestalt approach. Dr. Dobb's Jour- nal, 13(7):46, 1988.","title":"Pattern matching: The gestalt approach","authors":"John W Ratcliff, David Metzener","year":"1988","venue":"Dr. Dobb's Journal","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Schneider et al., 2023] Flavio Schneider, Ojasv Kamal, Zhijing Jin, and Bernhard Schölkopf. Môusai: Text-to- music generation with long-context latent diffusion. arXiv preprint arXiv:2301.11757, 2023.","title":"Môusai: Text-tomusic generation with long-context latent diffusion","authors":"Flavio Schneider, Ojasv Kamal, Zhijing Jin, Bernhard Schölkopf","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Tzanetakis et al., 2001] George Tzanetakis, Georg Essl, and Perry Cook. Automatic musical genre classification of au- dio signals. In Proceedings of the 2nd Annual Interna- tional Symposium on Music Information Retrieval, 2001.","title":"Automatic musical genre classification of audio signals","authors":"George Tzanetakis, Georg Essl, Perry Cook","year":"2001","venue":"Proceedings of the 2nd Annual International Symposium on Music Information Retrieval","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Wang et al., 2020] Ziyu Wang, Ke Chen, Junyan Jiang, Yiyi Zhang, Maoran Xu, Shuqi Dai, Xianbin Gu, and Gus Xia. Pop909: A pop-song dataset for music arrangement gen- eration. ISMIR, 2020.","title":"Pop909: A pop-song dataset for music arrangement generation","authors":"Ziyu Wang, Ke Chen, Junyan Jiang, Yiyi Zhang, Maoran Xu, Shuqi Dai, Xianbin Gu, Gus Xia","year":"2020","venue":"ISMIR","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Wang et al., 2022] Zihao Wang, Kejun Zhang, Yuxing Wang, Chen Zhang, Qihao Liang, Pengfei Yu, Yongsheng Feng, Wenbo Liu, Yikai Wang, Yuntao Bao, et al. Song- driver: Real-time music accompaniment generation with- out logical latency nor exposure bias. In Proceedings of the 30th ACM International Conference on Multimedia, pages 1057-1067, 2022.","title":"Songdriver: Real-time music accompaniment generation without logical latency nor exposure bias","authors":"Wang","year":"2022","venue":"Proceedings of the 30th ACM International Conference on Multimedia","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Wang et al., 2023] Zihao Wang, Le Ma, Chen Zhang, Bo Han, Yikai Wang, Xinyi Chen, HaoRong Hong, Wenbo Liu, Xinda Wu, and Kejun Zhang. Remast: Real-time emotion-based music arrangement with soft transition. arXiv preprint arXiv:2305.08029, 2023.","title":"Remast: Real-time emotion-based music arrangement with soft transition","authors":"Wang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Xiao et al., 2023] Shitao Xiao, Zheng Liu, Peitian Zhang, and Niklas Muennighoff. C-pack: Packaged resources to advance general chinese embedding, 2023.","title":"C-pack: Packaged resources to advance general chinese embedding","authors":"Shitao Xiao, Zheng Liu, Peitian Zhang, Niklas Muennighoff","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Yang et al., 2017] Li-Chia Yang, Szu-Yu Chou, and Yi- Hsuan Yang. Midinet: A convolutional generative adver- sarial network for symbolic-domain music generation. IS- MIR, 2017.","title":"Midinet: A convolutional generative adversarial network for symbolic-domain music generation","authors":"Li-Chia Yang, Szu-Yu Chou, Yi-Hsuan Yang","year":"2017","venue":"IS-MIR","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Yuan et al., 2023] Ruibin Yuan, Yinghao Ma, Yizhi Li, Ge Zhang, Xingran Chen, Hanzhi Yin, Le Zhuo, Yiqi Liu, Jiawen Huang, Zeyue Tian, et al. Marble: Music audio representation benchmark for universal evaluation. (Ad- vances in Neural Information Processing Systems, 2023.","title":"Marble: Music audio representation benchmark for universal evaluation","authors":"Yuan","year":"2023","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Zeng et al., 2022] Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yi- fan Xu, Wendi Zheng, Xiao Xia, et al. Glm-130b: An open bilingual pre-trained model. arXiv preprint arXiv:2210.02414, 2022.","title":"Glm-130b: An open bilingual pre-trained model","authors":"Zeng","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Zhang et al., 2018] Kejun Zhang, Hui Zhang, Simeng Li, Changyuan Yang, and Lingyun Sun. The pmemo dataset for music emotion recognition. In Proceedings of the 2018 acm on international conference on multimedia retrieval, pages 135-142, 2018.","title":"The pmemo dataset for music emotion recognition","authors":"Kejun Zhang, Hui Zhang, Simeng Li, Changyuan Yang, Lingyun Sun","year":"2018","venue":"Proceedings of the 2018 acm on international conference on multimedia retrieval","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Zhang et al., 2023] Chen Zhang, Yi Ren, Kejun Zhang, and Shuicheng Yan. Sdmuse: Stochastic differential music editing and generation via hybrid representation. IEEE Transactions on Multimedia, pages 1-9, 2023.","title":"Sdmuse: Stochastic differential music editing and generation via hybrid representation","authors":"Chen Zhang, Yi Ren, Kejun Zhang, Shuicheng Yan","year":"2023","venue":"IEEE Transactions on Multimedia","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Zhao et al., 2023] Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al. A survey of large language models. arXiv preprint arXiv:2303.18223, 2023.","title":"A survey of large language models","authors":"Kun Wayne Xin Zhao, Junyi Zhou, Tianyi Li, Xiaolei Tang, Yupeng Wang, Yingqian Hou, Beichen Min, Junjie Zhang, Zican Zhang, Dong","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Zhu et al., 2023] Pengfei Zhu, Chao Pang, Shuohuan Wang, Yekun Chai, Yu Sun, Hao Tian, and Hua Wu. Ernie-music: Text-to-waveform music generation with diffusion mod- els. arXiv preprint arXiv:2302.04456, 2023.","title":"Ernie-music: Text-to-waveform music generation with diffusion models","authors":"Pengfei Zhu, Chao Pang, Shuohuan Wang, Yekun Chai, Yu Sun, Hua Hao Tian, Wu","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}