Artificial Intelligence in the Concertgebouw

Arzt, Andreas; Frostel, Harald; Gadermaier, Thassilo; Gasser, Martin; Grachten, Maarten; Widmer, Gerhard

Artificial Intelligence in the Concertgebouw

Andreas Arzt, Harald Frostel, Thassilo Gadermaier, Martin Gasser, Maarten Grachten, Gerhard Widmer

Download BibTeX Cite

Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence. Special Track on Artificial Intelligence and the Arts. Pages 2424-2429.

Abstract

In this paper we present a real-world application (the first of its kind) of machine listening in the context of a live concert in a world-famous concert hall - the Concertgebouw in Amsterdam. A real-time music tracking algorithm listens to the Royal Concertgebouw Orchestra performing Richard Strauss' Alpensinfonie and follows the progress in the sheet music, i.e., continuously tracks the most likely position of the live music in the printed score. This information, in turn, is used to enrich the concert experience for members of the audience by streaming synchronised visual content (the sheet music, explanatory text and videos) onto tablet computers in the concert hall. The main focus of this paper is on the challenges involved in tracking live orchestral music, i.e., how to deal with heavily polyphonic music, how to prepare the data needed, and how to achieve the necessary robustness and precision.

Andreas Arzt, Harald Frostel, Thassilo Gadermaier, Martin Gasser, Maarten Grachten, and Gerhard Widmer. 2015. Artificial Intelligence in the Concertgebouw. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI-15. IJCAI, 2424–2429. https://ijcai.org/proceedings/2015/343

@inproceedings{ijcai2015p343,
  title     = {Artificial Intelligence in the Concertgebouw},
  author    = {Arzt, Andreas and Frostel, Harald and Gadermaier, Thassilo and Gasser, Martin and Grachten, Maarten and Widmer, Gerhard},
  booktitle = {Proceedings of the Twenty-Fourth International Joint Conference on
               Artificial Intelligence, {IJCAI-15}},
  publisher = {International Joint Conferences on Artificial Intelligence},
  editor    = {Qiang Yang and Michael Wooldridge},
  pages     = {2424--2429},
  year      = {2015},
  month     = {7},
  note      = {Special Track on Artificial Intelligence and the Arts},
  url       = {https://ijcai.org/proceedings/2015/343},
}

TY  - CPAPER
TI  - Artificial Intelligence in the Concertgebouw
AU  - Arzt, Andreas
AU  - Frostel, Harald
AU  - Gadermaier, Thassilo
AU  - Gasser, Martin
AU  - Grachten, Maarten
AU  - Widmer, Gerhard
T2  - Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI-15
PB  - International Joint Conferences on Artificial Intelligence
PY  - 2015
SP  - 2424
EP  - 2429
UR  - https://ijcai.org/proceedings/2015/343
ER  -