Humming2Music: Being A Composer As Long As You Can Humming

Yao Qiu, Jinchao Zhang, Huiying Ren, Yong Shan, Jie Zhou

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence

Demo Track. Pages 7163-7166.

https://doi.org/10.24963/ijcai.2023/840

PDF BibTeX

Abstract

Creating a piece of music is difficult for people who have never been trained to compose. We present an automatic music generation system to lower the threshold of creating music. The system takes the user's humming as input and creates full music based on the humming melody. The system consists of five modules: 1) humming transcription, 2) melody generation, 3) broken chord generation, 4) accompaniment generation, and 5) audio synthesis. The first module transcribes the user's humming audio to a score, and then the melody generation module composes a complete melody based on the user's humming melody. After that, the third module will generate a broken chord track to accompany the full melody, and the fourth module will create more accompanying tracks. Finally, the audio synthesis module mixes all the tracks to generate the music. Through the user experiment, our system can generate high-quality music with natural expression based on the user's humming input.

Keywords

  • Multidisciplinary Topics and Applications: MDA: Arts and creativity
  • Multidisciplinary Topics and Applications: MDA: Other
Welcome Future Conferences AI Journal Division IJCAI Proceedings Travel Grant Program IJCAI Awards