{"type":"ScholarlyArticle","title":"Towards Symbiotic Creativity: A Methodological Approach to Compare Human and AI Robotic Dance Creations","authors":[{"name":"Allegra De Filippo","slug":"allegra-de-filippo","given":"Allegra","family":"De Filippo","affiliation":"DISI , University of Bologna"},{"name":"Luca Giuliani","slug":"luca-giuliani","given":"Luca","family":"Giuliani","affiliation":"DISI , University of Bologna"},{"name":"Eleonora Mancini","slug":"eleonora-mancini","given":"Eleonora","family":"Mancini","affiliation":"DISI , University of Bologna"},{"name":"Andrea Borghesi","slug":"andrea-borghesi","given":"Andrea","family":"Borghesi","affiliation":"DISI , University of Bologna"},{"name":"Paola Mello","slug":"paola-mello","given":"Paola","family":"Mello","affiliation":"DISI , University of Bologna"},{"name":"Michela Milano","slug":"michela-milano","given":"Michela","family":"Milano","affiliation":"DISI , University of Bologna"}],"abstract":"Artificial Intelligence (AI) has gradually attracted attention in the field of artistic creation, resulting in a debate on the evaluation of AI artistic outputs. However, there is a lack of common criteria for objective artistic evaluation both of human and AI creations. This is a frequent issue in the field of dance, where different performance metrics focus either on evaluating human or computational skills separately. This work proposes a methodological approach for the artistic evaluation of both AI and human artistic creations in the field of robotic dance. First, we define a series of common initial constraints to create robotic dance choreographies in a balanced initial setting, in collaboration with a group of human dancers and choreographer. Then, we compare both creation processes through a human audience evaluation. Finally, we investigate which choreography aspects (e.g., the music genre) have the largest impact on the evaluation, and we provide useful guidelines and future research directions for the analysis of interconnections between AI and human dance creation.","doi":"10.24963/ijcai.2023/644","url":"https://ijcai.org/proceedings/2023/644","pdf":"https://ijcai.org/proceedings/2023/0644.pdf","markdown":"https://ijcai.org/proceedings/2023/644.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/644","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"AI and Arts","track":"AI and Arts","number":644,"pages":{"first":5806,"last":5814},"keywords":["Theory and philosophy of arts and creativity in AI systems: Evaluation of artistic or creative outputs produced by AI Systems","Application domains: Performances, dance"],"videos":[],"references":[{"position":1,"raw":"[Angulo et al., 2011] Cecilio Angulo, Joan Comas, and Diego Pardo. Aibo jukebox-a robot dance interactive ex- perience. In International Work-Conference on Artificial Neural Networks, pages 605-612. Springer, 2011.","title":"Aibo jukebox-a robot dance interactive experience","authors":"Cecilio Angulo, Joan Comas, Diego Pardo","year":"2011","venue":"International Work-Conference on Artificial Neural Networks","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Aucouturier et al., 2008] Jean-Julien Aucouturier, Kat- sushi Ikeuchi, Hirohisa Hirukawa, Shin'ichiro Nakaoka, Takaaki Shiratori, Shunsuke Kudoh, Fumio Kanehiro, Tetsuya Ogata, Hideki Kozima, Hiroshi G Okuno, et al. Cheek to chip: Dancing robots and ai's future. IEEE Intelligent Systems, 23(2):74-84, 2008.","title":"Cheek to chip: Dancing robots and ai's future","authors":"Jean-Julien Aucouturier, Katsushi Ikeuchi, Hirohisa Hirukawa, Takaaki Shin'ichiro Nakaoka, Shunsuke Shiratori, Fumio Kudoh, Tetsuya Kanehiro, Hideki Ogata, Kozima, G Hiroshi, Okuno","year":"2008","venue":"IEEE Intelligent Systems","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Benesh and Benesh, 1977] Rudolf Benesh and Joan Be- nesh. Reading dance: The birth of choreology. London: Souvenir Press, 1977.","title":"Rudolf Benesh and Joan Benesh. Reading dance: The birth of choreology","authors":"Benesh Benesh","year":"1977","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Charness et al., 2012] Gary Charness, Uri Gneezy, and Michael A Kuhn. Experimental methods: Between- subject and within-subject design. Journal of economic behavior & organization, 81(1):1-8, 2012.","title":"Experimental methods: Betweensubject and within-subject design","authors":"Gary Charness, Uri Gneezy, Michael A Kuhn","year":"2012","venue":"Journal of economic behavior & organization","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Chatfield and Byrnes, 1990] SJ Chatfield and WC Byrnes. Correlational analysis of aesthetic competency, skill acqui- sition and physiologic capabilities of modern dancers. In 5th Hong Kong International Dance Conference Papers, pages 79-100, 1990.","title":"Correlational analysis of aesthetic competency, skill acquisition and physiologic capabilities of modern dancers","authors":"Byrnes ; Sj Chatfield, W C Chatfield, Byrnes","year":"1990","venue":"5th Hong Kong International Dance Conference Papers","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Ciolfi Felice et al., 2016] Marianela Ciolfi Felice, Sarah Fdili Alaoui, and Wendy E. Mackay. How do choreographers craft dance? designing for a choreographer-technology partnership. In Proceed- ings of the 3rd International Symposium on Movement and Computing, MOCO '16, New York, NY, USA, 2016. Association for Computing Machinery.","title":"How do choreographers craft dance? designing for a choreographer-technology partnership","authors":"Marianela Ciolfi, Felice, Sarah Fdili Alaoui, Wendy E Mackay","year":"2016","venue":"Proceedings of the 3rd International Symposium on Movement and Computing, MOCO '16","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[De Filippo et al., 2022a] Allegra De Filippo, Andrea Borghesi, Andrea Boscarino, and Michela Milano. Hada: An automated tool for hardware dimensioning of ai applications. Knowledge-Based Systems, 251:109199, 2022.","title":"Hada: An automated tool for hardware dimensioning of ai applications","authors":"De Filippo","year":"2022","venue":"Knowledge-Based Systems","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[De Filippo et al., 2022b] Allegra De Filippo, Paola Mello, and Michela Milano. Do you like dancing robots? ai can tell you why. In PAIS 2022, pages 45-58. IOS Press, 2022.","title":"Do you like dancing robots? ai can tell you why","authors":"De Filippo","year":"2022","venue":"PAIS 2022","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Grunberg et al., 2010] David Grunberg, Robert Ellenberg, In Hyuek Kim, Jun Ho Oh, Paul Y Oh, and Youngmoo E Kim. Development of an autonomous dancing robot. International Journal of Hybrid Information Technology, 3(2):33-43, 2010.","title":"Development of an autonomous dancing robot","authors":"David Grunberg, Robert Ellenberg, In Hyuek Kim, Jun Ho Oh, Paul Y Oh, Youngmoo E Kim","year":"2010","venue":"International Journal of Hybrid Information Technology","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Heyward, 2015] Anna Heyward. How to write a dance. The Paris Review: The Daily, February, 4, 2015.","title":"How to write a dance","authors":"Anna Heyward","year":"2015","venue":"The Paris Review: The Daily","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Hong and Curran, 2019] Joo-Wha Hong and Nathaniel Ming Curran. Artificial intelligence, artists, and art: attitudes toward artwork produced by humans vs. artificial intelligence. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 15(2s):1-16, 2019.","title":"Artificial intelligence, artists, and art: attitudes toward artwork produced by humans vs. artificial intelligence","authors":"Curran ; Joo-Wha Hong, Nathaniel Ming Hong, Curran","year":"2019","venue":"ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Joshi and Chakrabarty, 2021] Manish Joshi and Sangeeta Chakrabarty. An extensive review of computational dance automation techniques and applications. Proceedings of the Royal Society A, 477(2251):20210071, 2021.","title":"An extensive review of computational dance automation techniques and applications","authors":"Manish Joshi, Sangeeta Chakrabarty","year":"2021","venue":"Proceedings of the Royal Society A","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Kirkpatrick et al., 1983] S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi. Optimization by simulated annealing. Sci- ence, 220(4598):671-680, 1983.","title":"Optimization by simulated annealing","authors":"S Kirkpatrick, C D Gelatt, M P Vecchi","year":"1983","venue":"Science","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Krasnow and Chatfield, 2009] Donna Krasnow and Steven J Chatfield. Development of the \"performance compe- tence evaluation measure\": assessing qualitative aspects of dance performance. Journal of Dance Medicine & Sci- ence, 13(4):101-107, 2009.","title":"Development of the \"performance competence evaluation measure\": assessing qualitative aspects of dance performance","authors":"Chatfield Krasnow, Donna Krasnow, Steven J Chatfield","year":"2009","venue":"Journal of Dance Medicine & Science","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Likert, 1932] Rensis Likert. A technique for the measure- ment of attitudes. Archives of psychology, 1932.","title":"A technique for the measurement of attitudes","authors":"Rensis Likert","year":"1932","venue":"Archives of psychology","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Liu et al., 2020] Yuechang Liu, Dongbo Xie, Hankz Han- kui Zhuo, and Liqian Lai. Plan2dance: Planning based choreographing from music. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 13624-13625, 2020.","title":"Plan2dance: Planning based choreographing from music","authors":"Liu","year":"2020","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Manfrè et al., 2017] Adriano Manfrè, Ignazio Infantino, Agnese Augello, Giovanni Pilato, and Filippo Vella. Learning by demonstration for a dancing robot within a computational creativity framework. In 2017 First IEEE International Conference on Robotic Computing (IRC), pages 434-439. IEEE, 2017.","title":"Learning by demonstration for a dancing robot within a computational creativity framework","authors":"Adriano Manfrè, Ignazio Infantino, Agnese Augello, Giovanni Pilato, Filippo Vella","year":"2017","venue":"First IEEE International Conference on Robotic Computing (IRC)","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Oliveira et al., 2012] João Lobato Oliveira, Luis Paulo Reis, and Brígida Mónica Faria. Empiric evaluation of robot dancing framework based. TELKOMNIKA, 10(8):1701-8, 2012.","title":"Empiric evaluation of robot dancing framework based","authors":"João Lobato Oliveira, Luis, Paulo Reis, Brígida Mónica, Faria","year":"2012","venue":"TELKOMNIKA","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Peng et al., 2019] Hua Peng, Jing Li, Huosheng Hu, Lip- ing Zhao, Sheng Feng, and Keli Hu. Feature fusion based automatic aesthetics evaluation of robotic dance poses. Robotics and Autonomous Systems, 111:99-109, 2019.","title":"Feature fusion based automatic aesthetics evaluation of robotic dance poses","authors":"Hua Peng, Jing Li, Huosheng Hu, Liping Zhao, Sheng Feng, Keli Hu","year":"2019","venue":"Robotics and Autonomous Systems","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Peng et al., 2021] Hua Peng, Jinghao Hu, Haitao Wang, Hui Ren, Cong Sun, Huosheng Hu, and Jing Li. Multiple vi- sual feature integration based automatic aesthetics eval- uation of robotic dance motions. Information, 12(3):95, 2021.","title":"Multiple visual feature integration based automatic aesthetics evaluation of robotic dance motions","authors":"Hua Peng, Jinghao Hu, Haitao Wang, Hui Ren, Cong Sun, Huosheng Hu, Jing Li","year":"2021","venue":"Information","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Pignatiello et al., 2020] Grant A Pignatiello, Richard J Mar- tin, and Ronald L Hickman Jr. Decision fatigue: A con- ceptual analysis. Journal of health psychology, 25(1):123- 135, 2020.","title":"Decision fatigue: A conceptual analysis","authors":"Richard J Grant A Pignatiello, Ronald L Martin, Hickman","year":"2020","venue":"Journal of health psychology","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Ramos et al., 2015] Oscar E Ramos, Nicolas Mansard, Olivier Stasse, Christophe Benazeth, Sovannara Hak, and Layale Saab. Dancing humanoid robots: Systematic use of osid to compute dynamically consistent movements fol- lowing a motion capture pattern. IEEE Robotics & Au- tomation Magazine, 22(4):16-26, 2015.","title":"Dancing humanoid robots: Systematic use of osid to compute dynamically consistent movements following a motion capture pattern","authors":"Ramos","year":"2015","venue":"IEEE Robotics & Automation Magazine","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Rosner and Grove, 1999] B Rosner and D Grove. Use of the mann-whitney u-test for clustered data. Statistics in medicine, 18(11):1387-1400, 1999.","title":"Use of the mann-whitney u-test for clustered data","authors":"B Rosner, Grove","year":"1999","venue":"Statistics in medicine","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Saffiotti et al., 2020] Alessandro Saffiotti, Peter Fogel, Pe- ter Knudsen, Luis de Miranda, and Oscar Thörn. On human-ai collaboration in artistic performance. In First International Workshop on New Foundations for Human- Centered AI (NeHuAI) co-located with 24th European Conference on Artificial Intelligence (ECAI 2020), San- tiago de Compostella, Spain, September 4, 2020, pages 38-43. CEUR-WS, 2020.","title":"On human-ai collaboration in artistic performance","authors":"Alessandro Saffiotti, Peter Fogel, Peter Knudsen, Luis De Miranda, Oscar Thörn","year":"2020","venue":"First International Workshop on New Foundations for Human-Centered AI (NeHuAI) co-located with 24th European Conference on Artificial Intelligence (ECAI 2020)","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Sagasti, 2019] Francisco Sagasti. Information technology and the arts: the evolution of computer choreography dur- ing the last half century. Dance Chronicle, 42(1):1-52, 2019.","title":"Francisco Sagasti. Information technology and the arts: the evolution of computer choreography during the last half century","authors":"Sagasti","year":"2019","venue":"Dance Chronicle","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Scaringella et al., 2006] Nicolas Scaringella, Giorgio Zoia, and Daniel Mlynek. Automatic genre classification of mu- sic content: a survey. IEEE Signal Processing Magazine, 23(2):133-141, 2006.","title":"Automatic genre classification of music content: a survey","authors":"Nicolas Scaringella, Giorgio Zoia, Daniel Mlynek","year":"2006","venue":"IEEE Signal Processing Magazine","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Schiphorst et al., 1990] T. Schiphorst, T. Calvert, C. Lee, C. Welman, and S. Gaudet. Tools for interaction with the creative process of composition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Sys- tems, CHI '90, page 167-174, New York, NY, USA, 1990. Association for Computing Machinery.","title":"Tools for interaction with the creative process of composition","authors":"T Schiphorst, T Calvert, C Lee, C Welman, S Gaudet","year":"1990","venue":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '90","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Shinozaki et al., 2007] Kuniya Shinozaki, Akitsugu Iwatani, and Ryohei Nakatsu. Concept and construction of a dance robot system. In Proceedings of the 2nd international conference on Digital interactive media in entertainment and arts, pages 161-164, 2007.","title":"Concept and construction of a dance robot system","authors":"Shinozaki","year":"2007","venue":"Proceedings of the 2nd international conference on Digital interactive media in entertainment and arts","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Shinozaki et al., 2008] Kuniya Shinozaki, Akitsugu Iwatani, and Ryohei Nakatsu. Construction and evalua- tion of a robot dance system. In Entertainment Computing Symposium, pages 83-94. Springer, 2008.","title":"Construction and evaluation of a robot dance system","authors":"Shinozaki","year":"2008","venue":"Entertainment Computing Symposium","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Singh et al., 2011] Vikash Singh, Celine Latulipe, Erin Car- roll, and Danielle Lottridge. The choreographer's note- book: a video annotation system for dancers and chore- ographers. In Proceedings of the 8th ACM Conference on Creativity and Cognition, pages 197-206, 2011.","title":"The choreographer's notebook: a video annotation system for dancers and choreographers","authors":"Vikash Singh, Celine Latulipe, Erin Carroll, Danielle Lottridge","year":"2011","venue":"Proceedings of the 8th ACM Conference on Creativity and Cognition","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Sturm, 2012] Bob L Sturm. Two systems for automatic mu- sic genre recognition: What are they really recognizing? In Proceedings of the second international ACM work- shop on Music information retrieval with user-centered and multimodal strategies, pages 69-74, 2012.","title":"Two systems for automatic music genre recognition: What are they really recognizing?","authors":"L Bob, Sturm","year":"2012","venue":"Proceedings of the second international ACM workshop on Music information retrieval with user-centered and multimodal strategies","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Von Laban, 1975] Rudolf Von Laban. Laban's principles of dance and movement notation. Princeton Book Company Pub, 1975.","title":"Rudolf Von Laban. Laban's principles of dance and movement notation","authors":"Von Laban","year":"1975","venue":null,"doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Wang, 2022] Zhigang Wang. Music choreography algo- rithm based on feature matching and fragment segmenta- tion. Computational Intelligence and Neuroscience, 2022, 2022.","title":"Music choreography algorithm based on feature matching and fragment segmentation","authors":"Zhigang Wang","year":"2022","venue":"Computational Intelligence and Neuroscience","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Wolz, 1975] CARL Wolz. Dance in the noh theatre. The World of Music, 17(3):26-32, 1975.","title":"CARL Wolz. Dance in the noh theatre","authors":"Wolz","year":"1975","venue":"The World of Music","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}