{"type":"ScholarlyArticle","title":"Artificial Intelligence in the Concertgebouw","authors":[{"name":"Andreas Arzt","slug":"andreas-arzt","given":"Andreas","family":"Arzt","affiliation":") Johannes Kepler University , Linz , Austria (; ) Austrian Research Institute for Artificial Intelligence , Vienna , Austria"},{"name":"Harald Frostel","slug":"harald-frostel","given":"Harald","family":"Frostel","affiliation":") Johannes Kepler University , Linz , Austria ("},{"name":"Thassilo Gadermaier","slug":"thassilo-gadermaier","given":"Thassilo","family":"Gadermaier","affiliation":") Austrian Research Institute for Artificial Intelligence , Vienna , Austria"},{"name":"Martin Gasser","slug":"martin-gasser","given":"Martin","family":"Gasser","affiliation":") Austrian Research Institute for Artificial Intelligence , Vienna , Austria"},{"name":"Maarten Grachten","slug":"maarten-grachten","given":"Maarten","family":"Grachten","affiliation":") Austrian Research Institute for Artificial Intelligence , Vienna , Austria"},{"name":"Gerhard Widmer","slug":"gerhard-widmer","given":"Gerhard","family":"Widmer","affiliation":") Johannes Kepler University , Linz , Austria (; ) Austrian Research Institute for Artificial Intelligence , Vienna , Austria"}],"abstract":"In this paper we present a real-world application (the first of its kind) of machine listening in the context of a live concert in a world-famous concert hall - the Concertgebouw in Amsterdam. A real-time music tracking algorithm listens to the Royal Concertgebouw Orchestra performing Richard Strauss' Alpensinfonie and follows the progress in the sheet music, i.e., continuously tracks the most likely position of the live music in the printed score. This information, in turn, is used to enrich the concert experience for members of the audience by streaming synchronised visual content (the sheet music, explanatory text and videos) onto tablet computers in the concert hall. The main focus of this paper is on the challenges involved in tracking live orchestral music, i.e., how to deal with heavily polyphonic music, how to prepare the data needed, and how to achieve the necessary robustness and precision.","doi":null,"url":"https://ijcai.org/proceedings/2015/343","pdf":"https://ijcai.org/proceedings/2015/0343.pdf","markdown":"https://ijcai.org/proceedings/2015/343.md","bibtex":"https://ijcai.org/proceedings/2015/bibtex/343","volume":{"slug":"2015","title":"Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2015","url":"https://ijcai.org/proceedings/2015/","year":2015,"location":"Buenos Aires, Argentina","dates":"25–31 July 2015","editors":"Qiang Yang and Michael Wooldridge","isbn":"978-1-57735-738-4","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":"Special Track on Artificial Intelligence and the Arts","track":"Special Track on Artificial Intelligence and the Arts","number":343,"pages":{"first":2424,"last":2429},"keywords":[],"videos":[],"references":[{"position":1,"raw":"[Arzt and Widmer, 2010] Andreas Arzt and Gerhard Wid- mer. Simple tempo models for real-time music tracking. In Proceedings of the 7th Sound and Music Computing Con- ference (SMC 2010), Barcelona, Spain, 2010.","title":"Simple tempo models for real-time music tracking","authors":"Widmer Arzt, Andreas Arzt, Gerhard Widmer","year":"2010","venue":"Proceedings of the 7th Sound and Music Computing Conference (SMC 2010)","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Arzt et al., 2008] Andreas Arzt, Gerhard Widmer, and Si- mon Dixon. Automatic page turning for musicians via real-time machine listening. In Proceedings of the 18th European Conference on Artificial Intelligence (ECAI 2008), Patras, Greece, 2008.","title":"Automatic page turning for musicians via real-time machine listening","authors":"Andreas Arzt, Gerhard Widmer, Simon Dixon","year":"2008","venue":"Proceedings of the 18th European Conference on Artificial Intelligence (ECAI 2008)","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Arzt et al., 2012] Andreas Arzt, Gerhard Widmer, and Si- mon Dixon. Adaptive distance normalization for real- time music tracking. In Proceedings of the 20th European Signal Processing Conference (Eusipco 2012), Bucharest, Romania, 2012.","title":"Adaptive distance normalization for realtime music tracking","authors":"Andreas Arzt, Gerhard Widmer, Simon Dixon","year":"2012","venue":"Proceedings of the 20th European Signal Processing Conference (Eusipco 2012)","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Arzt et al., 2014] Andreas Arzt, Sebastian Böck, Sebastian Flossmann, Harald Frostel, Martin Gasser, and Gerhard Widmer. The complete classical music companion v0. 9. In Proceedings of the 53rd AES Conference on Semantic Audio, London, England, 2014.","title":"The complete classical music companion v0. 9","authors":"Andreas Arzt, Sebastian Böck, Sebastian Flossmann, Harald Frostel, Martin Gasser, Gerhard Widmer","year":"2014","venue":"Proceedings of the 53rd AES Conference on Semantic Audio","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cont, 2009] Arshia Cont. A coupled duration-focused ar- chitecture for realtime music to score alignment. IEEE Transactions on Pattern Analysis and Machine Intelli- gence, 32(6):837-846, 2009.","title":"A coupled duration-focused architecture for realtime music to score alignment","authors":"Arshia Cont","year":"2009","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Dannenberg, 1984] Roger Dannenberg. An on-line algo- rithm for real-time accompaniment. In Proceedings of the International Computer Music Conference (ICMC 1984), Paris, France, 1984.","title":"An on-line algorithm for real-time accompaniment","authors":"Roger Dannenberg","year":"1984","venue":"Proceedings of the International Computer Music Conference (ICMC 1984)","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Dixon, 2005] Simon Dixon. An on-line time warping algo- rithm for tracking musical performances. In Proceedings of the 19th International Joint Conference on Artificial In- telligence (IJCAI 2005), Edinburgh, Scotland, 2005.","title":"An on-line time warping algorithm for tracking musical performances","authors":"Simon Dixon","year":"2005","venue":"Proceedings of the 19th International Joint Conference on Artificial Intelligence (IJCAI 2005)","doi":null,"url":null,"internal_url":"/proceedings/2005/240"},{"position":8,"raw":"[Ewert et al., 2009] Sebastian Ewert, Meinard Müller, and Peter Grosche. High resolution audio synchronization us- ing chroma onset features. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2009), Taipei, Taiwan, 2009.","title":"High resolution audio synchronization using chroma onset features","authors":"Sebastian Ewert, Meinard Müller, Peter Grosche","year":"2009","venue":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2009","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Grachten et al., 2013] Maarten Grachten, Martin Gasser, Andreas Arzt, and Gerhard Widmer. Automatic alignment of music performances with structural differences. In Pro- ceedings of the 14th International Society for Music In- formation Retrieval Conference (ISMIR 2013), Curitiba, Brazil, 2013.","title":"Automatic alignment of music performances with structural differences","authors":"Grachten","year":"2013","venue":"Proceedings of the 14th International Society for Music Information Retrieval Conference (ISMIR 2013)","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Hu et al., 2003] Ning Hu, Roger Dannenberg, and George Tzanetakis. Polyphonic audio matching and alignment for music retrieval. In IEEE Workshop on Applications of Sig- nal Processing to Audio and Acoustics, New Paltz, USA, 2003.","title":"Polyphonic audio matching and alignment for music retrieval","authors":"Ning Hu, Roger Dannenberg, George Tzanetakis","year":"2003","venue":"IEEE Workshop on Applications of Signal Processing to Audio and Acoustics","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Joder et al., 2010] Cyril Joder, Slim Essid, and Gael Richard. A comparative study of tonal acoustic features for a symbolic level music-to-score alignment. In Pro- ceedings of the IEEE International Conference on Acous- tics Speech and Signal Processing (ICASSP 2010), Dallas, USA, 2010.","title":"A comparative study of tonal acoustic features for a symbolic level music-to-score alignment","authors":"Cyril Joder, Slim Essid, Gael Richard","year":"2010","venue":"Proceedings of the IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP 2010","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Korzeniowski et al., 2013] Filip Korzeniowski, Florian Krebs, Andreas Arzt, and Gerhard Widmer. Tracking rests and tempo changes: Improved score following with parti- cle filters. In Proceedings of the International Computer Music Conference (ICMC 2013), Perth, Australia, 2013.","title":"Tracking rests and tempo changes: Improved score following with particle filters","authors":"Filip Korzeniowski, Florian Krebs, Andreas Arzt, Gerhard Widmer","year":"2013","venue":"Proceedings of the International Computer Music Conference (ICMC 2013)","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Miron et al., 2014] Marius Miron, Julio José Carabias-Orti, and Jordi Janer. Audio-to-score alignment at note level for orchestral recordings. In Proceedings of the 15th Interna- tional Society for Music Information Retrieval Conference (ISMIR 2014), Taipei, Taiwan, 2014.","title":"Audio-to-score alignment at note level for orchestral recordings","authors":"Marius Miron, Julio José Carabias-Orti, Jordi Janer","year":"2014","venue":"Proceedings of the 15th International Society for Music Information Retrieval Conference (ISMIR 2014)","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Raphael, 2010] Christopher Raphael. Music Plus One and machine learning. In Proceedings of the 27th International Conference on Machine Learning (ICML 2010), Haifa, Is- rael, 2010.","title":"Music Plus One and machine learning","authors":"Christopher Raphael","year":"2010","venue":"Proceedings of the 27th International Conference on Machine Learning (ICML 2010)","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Vercoe, 1984] Barry Vercoe. The synthetic performer in the context of live performance. In Proceedings of the Inter- national Computer Music Conference (ICMC 1984), Paris, France, 1984.","title":"The synthetic performer in the context of live performance","authors":"Barry Vercoe","year":"1984","venue":"Proceedings of the International Computer Music Conference (ICMC 1984)","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Wang et al., 2014] Siying Wang, Sebastian Ewert, and Si- mon Dixon. Robust joint alignment of multiple versions of a piece of music. In Proceedings of the 15th Interna- tional Society for Music Information Retrieval Conference (ISMIR 2014), Taipei, Taiwan, 2014.","title":"Robust joint alignment of multiple versions of a piece of music","authors":"Siying Wang, Sebastian Ewert, Simon Dixon","year":"2014","venue":"Proceedings of the 15th International Society for Music Information Retrieval Conference (ISMIR 2014)","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}