{"type":"ScholarlyArticle","title":"MCM: Multi-condition Motion Synthesis Framework","authors":[{"name":"Zeyu Ling","slug":"zeyu-ling","given":"Zeyu","family":"Ling","affiliation":"College of Computer Science and Technology , Zhejiang University"},{"name":"Bo Han","slug":"bo-han","given":"Bo","family":"Han","affiliation":"College of Computer Science and Technology , Zhejiang University"},{"name":"Yongkang Wong","slug":"yongkang-wong","given":"Yongkang","family":"Wong","affiliation":"School of Computing , National University of Singapore"},{"name":"Han Lin","slug":"han-lin","given":"Han","family":"Lin","affiliation":"College of Computer Science and Technology , Zhejiang University"},{"name":"Mohan Kankanhalli","slug":"mohan-kankanhalli","given":"Mohan","family":"Kankanhalli","affiliation":"School of Computing , National University of Singapore"},{"name":"Weidong Geng","slug":"weidong-geng","given":"Weidong","family":"Geng","affiliation":"College of Computer Science and Technology , Zhejiang University"}],"abstract":"Conditional human motion synthesis (HMS) aims to generate human motion sequences that conform to specific conditions. Text and audio represent the two predominant modalities employed as HMS control conditions. While existing research has primarily focused on single conditions, the multi-condition human motion synthesis remains underexplored. In this study, we propose a multi-condition HMS framework, termed MCM, based on a dual-branch structure composed of a main branch and a control branch. This framework effectively extends the applicability of the diffusion model, which is initially predicated solely on textual conditions, to auditory conditions. This extension encompasses both music-to-dance and co-speech HMS while preserving the intrinsic quality of motion and the capabilities for semantic association inherent in the original model.\r\nFurthermore, we propose the implementation of a Transformer-based diffusion model, designated as MWNet, as the main branch. This model adeptly apprehends the spatial intricacies and inter-joint correlations inherent in motion sequences, facilitated by the integration of multi-wise self-attention modules.\r\nExtensive experiments show that our method achieves competitive results in single-condition and multi-condition HMS tasks.","doi":"10.24963/ijcai.2024/120","url":"https://ijcai.org/proceedings/2024/120","pdf":"https://ijcai.org/proceedings/2024/0120.pdf","markdown":"https://ijcai.org/proceedings/2024/120.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/120","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Computer Vision","track":"Main Track","number":120,"pages":{"first":1083,"last":1091},"keywords":["Computer Vision: CV: Applications","Computer Vision: CV: 3D computer vision"],"videos":[],"references":[{"position":1,"raw":"[Azadi et al., 2023] Samaneh Azadi, Akbar Shah, Thomas Hayes, Devi Parikh, and Sonal Gupta. Make-an- animation: Large-scale text-conditional 3d human motion generation. In International Conference on Computer Vi- sion, 2023.","title":"Make-ananimation: Large-scale text-conditional 3d human motion generation","authors":"Azadi","year":"2023","venue":"International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Ba et al., 2016] Jimmy Lei Ba, Jamie Ryan Kiros, and Ge- offrey E Hinton. Layer normalization. arXiv preprint arXiv:1607.06450, 2016.","title":"Layer normalization","authors":"Jimmy Lei Ba, Jamie Ryan Kiros, Geoffrey E Hinton","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chen et al., 2023] Xin Chen, Biao Jiang, Wen Liu, Zilong Huang, Bin Fu, Tao Chen, and Gang Yu. Executing your commands via motion diffusion in latent space. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 18000-18010, 2023.","title":"Executing your commands via motion diffusion in latent space","authors":"Xin Chen, Biao Jiang, Wen Liu, Zilong Huang, Bin Fu, Tao Chen, Gang Yu","year":"2023","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chung et al., 2014] Junyoung Chung, Caglar Gulcehre, Kyunghyun Cho, and Yoshua Bengio. Empirical evalua- tion of gated recurrent neural networks on sequence mod- eling. In NIPS 2014 Workshop on Deep Learning, Decem- ber 2014, 2014.","title":"Empirical evaluation of gated recurrent neural networks on sequence modeling","authors":"Chung","year":"2014","venue":"NIPS 2014 Workshop on Deep Learning, December 2014","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Dabral et al., 2023] Rishabh Dabral, Muhammad Hamza Mughal, Vladislav Golyanik, and Christian Theobalt. Mo- Fusion: A framework for denoising-diffusion-based mo- tion synthesis. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, pages 9760-9770, 2023.","title":"Mo-Fusion: A framework for denoising-diffusion-based motion synthesis","authors":"Rishabh Dabral, Muhammad Hamza Mughal, Vladislav Golyanik, Christian Theobalt","year":"2023","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Dhariwal et al., 2020] Prafulla Dhariwal, Heewoo Jun, Christine Payne, Jong Wook Kim, Alec Radford, and Ilya Sutskever. Jukebox: A generative model for music. arXiv preprint arXiv:2005.00341, 2020.","title":"Jukebox: A generative model for music","authors":"Prafulla Dhariwal, Heewoo Jun, Christine Payne, Jong Wook Kim, Alec Radford, Ilya Sutskever","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Ding et al., 2022] Mingyu Ding, Bin Xiao, Noel Codella, Ping Luo, Jingdong Wang, and Lu Yuan. DaViT: Dual attention vision transformers. In European Conference on Computer Vision, pages 74-92. Springer, 2022.","title":"DaViT: Dual attention vision transformers","authors":"Mingyu Ding, Bin Xiao, Noel Codella, Ping Luo, Jingdong Wang, Lu Yuan","year":"2022","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Gong et al., 2023a] Kehong Gong, Dongze Lian, Heng Chang, Chuan Guo, Zihang Jiang, Xinxin Zuo, Michael Bi Mi, and Xinchao Wang. TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integration. In Proceed- ings of the IEEE/CVF International Conference on Com- puter Vision, pages 9942-9952, 2023.","title":"TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integration","authors":"Gong","year":"2023","venue":"Proceedings of the IEEE/CVF International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Gong et al., 2023b] Kehong Gong, Dongze Lian, Heng Chang, Chuan Guo, Zihang Jiang, Xinxin Zuo, Michael Bi Mi, and Xinchao Wang. TM2D: Bimodality driven 3d dance generation via music-text integration. In Proceed- ings of the IEEE/CVF International Conference on Com- puter Vision, pages 9942-9952, 2023.","title":"TM2D: Bimodality driven 3d dance generation via music-text integration","authors":"Gong","year":"2023","venue":"Proceedings of the IEEE/CVF International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Goodfellow et al., 2014] Ian Goodfellow, Jean Pouget- Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Gen- erative adversarial nets. Advances in neural information processing systems, 27, 2014.","title":"Generative adversarial nets","authors":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio","year":"2014","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Gopinath and Won, 2020] Deepak Gopinath and Jungdam Won. Fairmotion-tools to load, process and visualize mo- tion capture data. https://github.com/facebookresearch/ fairmotion, 2020.","title":"Deepak Gopinath and Jungdam Won. Fairmotion-tools to load, process and visualize motion capture data","authors":"Won Gopinath","year":"2020","venue":null,"doi":null,"url":"https://github.com/facebookresearch/fairmotion","internal_url":null},{"position":12,"raw":"[Guo et al., 2022a] Chuan Guo, Shihao Zou, Xinxin Zuo, Sen Wang, Wei Ji, Xingyu Li, and Li Cheng. Generating diverse and natural 3d motions from text. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, pages 5152-5161, 2022.","title":"Generating diverse and natural 3d motions from text","authors":"Guo","year":"2022","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Guo et al., 2022b] Chuan Guo, Xinxin Zuo, Sen Wang, and Li Cheng. TM2T: Stochastic and tokenized modeling for the reciprocal generation of 3d human motions and texts. In European Conference on Computer Vision, pages 580- 597. Springer, 2022.","title":"TM2T: Stochastic and tokenized modeling for the reciprocal generation of 3d human motions and texts","authors":"Guo","year":"2022","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Han et al., 2023] Bo Han, Yi Ren, Hao Peng, Teng Zhang, Zeyu Ling, Xiang Yin, and Feilin Han. EnchantDance: Unveiling the Potential of Music-Driven Dance Move- ment. arXiv preprint arXiv:2312.15946, 2023.","title":"EnchantDance: Unveiling the Potential of Music-Driven Dance Movement","authors":"Bo Han, Yi Ren, Hao Peng, Teng Zhang, Zeyu Ling, Xiang Yin, Feilin Han","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Ho et al., 2020] Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840-6851, 2020.","title":"Denoising diffusion probabilistic models","authors":"Jonathan Ho, Ajay Jain, Pieter Abbeel","year":"2020","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Hudson and Zitnick, 2021] Drew A Hudson and Larry Zit- nick. Generative adversarial transformers. In Interna- tional conference on machine learning, pages 4487-4499.","title":"Generative adversarial transformers","authors":"A Drew, Larry Hudson, Zitnick","year":null,"venue":"International conference on machine learning","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"PMLR, 2021.","title":null,"authors":"Pmlr","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Jiang et al., 2023] Biao Jiang, Xin Chen, Wen Liu, Jingyi Yu, Gang Yu, and Tao Chen. MotionGPT: Human Motion as a Foreign Language. Advances in neural information processing systems, 2023.","title":"MotionGPT: Human Motion as a Foreign Language","authors":"Biao Jiang, Xin Chen, Wen Liu, Jingyi Yu, Gang Yu, Tao Chen","year":"2023","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Kingma and Welling, 2013] Diederik P Kingma and Max Welling. Auto-encoding variational bayes. 2013.","title":"Auto-encoding variational bayes","authors":"P Diederik, Max Kingma, Welling","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Li et al., 2021] Ruilong Li, Shan Yang, David A Ross, and Angjoo Kanazawa. AI choreographer: Music conditioned 3d dance generation with AIST++. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 13401-13412, 2021.","title":"AI choreographer: Music conditioned 3d dance generation with AIST++","authors":"Li","year":"2021","venue":"Proceedings of the IEEE/CVF International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Liu et al., 2022] Haiyang Liu, Zihao Zhu, Naoya Iwamoto, Yichen Peng, Zhengqing Li, You Zhou, Elif Bozkurt, and Bo Zheng. BEAT: A large-scale semantic and emotional multi-modal dataset for conversational gestures synthesis. In European Conference on Computer Vision, pages 612- 630. Springer, 2022.","title":"BEAT: A large-scale semantic and emotional multi-modal dataset for conversational gestures synthesis","authors":"Haiyang Liu, Zihao Zhu, Naoya Iwamoto, Yichen Peng, Zhengqing Li, You Zhou, Elif Bozkurt, Bo Zheng","year":"2022","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Lu et al., 2023] Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing Lin, Ruimao Zhang, Lei Zhang, and Heung-Yeung Shum. HumanTOMATO: Text-aligned whole-body mo- tion generation. arXiv preprint arXiv:2310.12978, 2023.","title":"HumanTOMATO: Text-aligned whole-body motion generation","authors":"Lu","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Nichol et al., 2021] Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen. Glide: Towards photore- alistic image generation and editing with text-guided diffu- sion models. International Conference on Machine Learn- ing, 2021.","title":"Glide: Towards photorealistic image generation and editing with text-guided diffusion models","authors":"Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob Mcgrew, Ilya Sutskever, Mark Chen","year":"2021","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Onuma et al., 2008] Kensuke Onuma, Christos Faloutsos, and Jessica K Hodgins. FMDistance: A Fast and Effec- tive Distance Function for Motion Capture Data. In Euro- graphics (Short Papers), pages 83-86, 2008.","title":"FMDistance: A Fast and Effective Distance Function for Motion Capture Data","authors":"Kensuke Onuma, Christos Faloutsos, Jessica K Hodgins","year":"2008","venue":"Eurographics","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Perez et al., 2018] Ethan Perez, Florian Strub, Harm De Vries, Vincent Dumoulin, and Aaron Courville. FiLM: Visual reasoning with a general conditioning layer, 2018.","title":"FiLM: Visual reasoning with a general conditioning layer","authors":"Ethan Perez, Florian Strub, Harm De Vries, Vincent Dumoulin, Aaron Courville","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Petrovich et al., 2022] Mathis Petrovich, Michael J Black, and Gül Varol. TEMOS: Generating diverse human mo- tions from textual descriptions. In European Conference on Computer Vision, pages 480-497. Springer, 2022.","title":"TEMOS: Generating diverse human motions from textual descriptions","authors":"Mathis Petrovich, Michael J Black, Gül Varol","year":"2022","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Radford et al., 2019] Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. Language models are unsupervised multitask learners. 2019.","title":"Language models are unsupervised multitask learners","authors":"Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Radford et al., 2021] Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agar- wal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from nat- ural language supervision. In International conference on machine learning, pages 8748-8763. PMLR, 2021.","title":"Learning transferable visual models from natural language supervision","authors":"Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark","year":"2021","venue":"International conference on machine learning","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Raffel et al., 2020] Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140):1-67, 2020.","title":"Exploring the limits of transfer learning with a unified text-to-text transformer","authors":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J Liu","year":"2020","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Rombach et al., 2022] Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10684-10695, 2022.","title":"High-resolution image synthesis with latent diffusion models","authors":"Rombach","year":"2022","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Siyao et al., 2022] Li Siyao, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, and Ziwei Liu. Bailando: 3D dance generation by actor- critic GPT with choreographic memory. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, pages 11050-11059, 2022.","title":"Bailando: 3D dance generation by actorcritic GPT with choreographic memory","authors":"Li Siyao, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, Ziwei Liu","year":"2022","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Sun et al., 2020] Guofei Sun, Yongkang Wong, Zhiyong Cheng, Mohan S Kankanhalli, Weidong Geng, and Xi- angdong Li. DeepDance: music-to-dance motion chore- ography with adversarial learning. IEEE Transactions on Multimedia, 23:497-509, 2020.","title":"DeepDance: music-to-dance motion choreography with adversarial learning","authors":"Guofei Sun, Yongkang Wong, Zhiyong Cheng, Mohan S Kankanhalli, Weidong Geng, Xiangdong Li","year":"2020","venue":"IEEE Transactions on Multimedia","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Tevet et al., 2022] Guy Tevet, Sigal Raab, Brian Gordon, Yonatan Shafir, Daniel Cohen-Or, and Amit H Bermano. Human motion diffusion model. In International Confer- ence on Learning Representations, 2022.","title":"Human motion diffusion model","authors":"Guy Tevet, Sigal Raab, Brian Gordon, Yonatan Shafir, Daniel Cohen-Or, Amit H Bermano","year":"2022","venue":"International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Tseng et al., 2023] Jonathan Tseng, Rodrigo Castellon, and Karen Liu. EDGE: Editable dance generation from music. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 448-458, 2023.","title":"EDGE: Editable dance generation from music","authors":"Jonathan Tseng, Rodrigo Castellon, Karen Liu","year":"2023","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Van Den Oord et al., 2017] Aaron Van Den Oord, Oriol Vinyals, et al. Neural discrete representation learning. Advances in neural information processing systems, 30, 2017.","title":"Neural discrete representation learning","authors":"Oord Van Den","year":"2017","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017.","title":"Attention is all you need","authors":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, Illia Polosukhin","year":"2017","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Yoon et al., 2020] Youngwoo Yoon, Bok Cha, Joo-Haeng Lee, Minsu Jang, Jaeyeon Lee, Jaehong Kim, and Gee- hyuk Lee. Speech gesture generation from the trimodal context of text, audio, and speaker identity. ACM Transac- tions on Graphics, 39(6):1-16, 2020.","title":"Speech gesture generation from the trimodal context of text, audio, and speaker identity","authors":"Youngwoo Yoon, Bok Cha, Joo-Haeng Lee, Minsu Jang, Jaeyeon Lee, Jaehong Kim, Geehyuk Lee","year":"2020","venue":"ACM Transactions on Graphics","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Zhang et al., 2023a] Jianrong Zhang, Yangsong Zhang, Xi- aodong Cun, Shaoli Huang, Yong Zhang, Hongwei Zhao, Hongtao Lu, and Xi Shen. T2M-GPT: Generating human motion from textual descriptions with discrete representa- tions. Proceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition, 2023.","title":"T2M-GPT: Generating human motion from textual descriptions with discrete representations","authors":"Zhang","year":"2023","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Zhang et al., 2023b] Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image dif- fusion models, 2023.","title":"Adding conditional control to text-to-image diffusion models","authors":"Zhang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Zhang et al., 2023c] Mingyuan Zhang, Xinying Guo, Liang Pan, Zhongang Cai, Fangzhou Hong, Huirong Li, Lei Yang, and Ziwei Liu. ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 364- 373, 2023.","title":"ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model","authors":"Zhang","year":"2023","venue":"Proceedings of the IEEE/CVF International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Zhang et al., 2024] Mingyuan Zhang, Zhongang Cai, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, and Ziwei Liu. MotionDiffuse: Text-Driven Human Motion Genera- tion With Diffusion Model. IEEE Transactions on Pattern Analysis and Machine Intelligence, pages 1-15, 2024.","title":"MotionDiffuse: Text-Driven Human Motion Generation With Diffusion Model","authors":"Mingyuan Zhang, Zhongang Cai, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, Ziwei Liu","year":"2024","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Zhou and Wang, 2023a] Zixiang Zhou and Baoyuan Wang. UDE: A Unified Driving Engine for Human Motion Gen- eration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5632- 5641, 2023.","title":"UDE: A Unified Driving Engine for Human Motion Generation","authors":"Wang ; Zhou, Zixiang Zhou, Baoyuan Wang","year":"2023","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Zhou and Wang, 2023b] Zixiang Zhou and Baoyuan Wang. UDE: A unified driving engine for human motion gener- ation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5632- 5641, 2023.","title":"UDE: A unified driving engine for human motion generation","authors":"Wang ; Zhou, Zixiang Zhou, Baoyuan Wang","year":"2023","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Zhuang et al., 2022] Wenlin Zhuang, Congyi Wang, Jinxi- ang Chai, Yangang Wang, Ming Shao, and Siyu Xia. Mu- sic2Dance: Dancenet for music-driven dance generation. ACM Transactions on Multimedia Computing, Communi- cations, and Applications (TOMM), 18(2):1-21, 2022.","title":"Music2Dance: Dancenet for music-driven dance generation","authors":"Wenlin Zhuang, Congyi Wang, Jinxiang Chai, Yangang Wang, Ming Shao, Siyu Xia","year":"2022","venue":"ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}