{"type":"ScholarlyArticle","title":"Mappa Mundi: An Interactive Artistic Mind Map Generator with Artificial Imagination","authors":[{"name":"Ruixue Liu","slug":"ruixue-liu","given":"Ruixue","family":"Liu","affiliation":"JD AI , Beijing , China"},{"name":"Baoyang Chen","slug":"baoyang-chen","given":"Baoyang","family":"Chen","affiliation":"Central Academy of Fine Arts , Beijing , China"},{"name":"Meng Chen","slug":"meng-chen","given":"Meng","family":"Chen","affiliation":"JD AI , Beijing , China"},{"name":"Youzheng Wu","slug":"youzheng-wu","given":"Youzheng","family":"Wu","affiliation":"JD AI , Beijing , China"},{"name":"Zhijie Qiu","slug":"zhijie-qiu","given":"Zhijie","family":"Qiu","affiliation":"Central Academy of Fine Arts , Beijing , China"},{"name":"Xiaodong He","slug":"xiaodong-he","given":"Xiaodong","family":"He","affiliation":"JD AI , Beijing , China"}],"abstract":"We present a novel real-time, collaborative, and interactive AI painting system, Mappa Mundi, for artistic Mind Map creation. The system consists  of a voice-based input interface, an automatic topic expansion module, and an image projection module. The key innovation is to inject Artificial Imagination into painting creation by considering lexical and phonological similarities of language, learning and inheriting\r\nartist’s original painting style, and applying the principles of Dadaism and impossibility of improvisation. Our system indicates that AI and artist can collaborate seamlessly to create imaginative artistic painting and Mappa Mundi has been applied in art exhibition in UCCA, Beijing.","doi":"10.24963/ijcai.2019/951","url":"https://ijcai.org/proceedings/2019/951","pdf":"https://ijcai.org/proceedings/2019/0951.pdf","markdown":"https://ijcai.org/proceedings/2019/951.md","bibtex":"https://ijcai.org/proceedings/2019/bibtex/951","volume":{"slug":"2019","title":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2019","url":"https://ijcai.org/proceedings/2019/","year":2019,"location":"Macao","dates":"10-16 August 2019","editors":"Sarit Kraus","isbn":"978-0-9992411-4-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2019"},"section":"Demos","track":"Demos","number":951,"pages":{"first":6545,"last":6547},"keywords":["AI: Natural Language Processing","AI: Human-Computer Interactive Systems","AI: AI Modelling and Simulation"],"videos":[],"references":[{"position":1,"raw":"[Cheng et al., 2018] Wen-Feng Cheng, Chao-Chung Wu, Ruihua Song, Jianlong Fu, Xing Xie, and Jian-Yun Nie. Image inspired poetry generation in xiaoice. arXiv preprint arXiv:1808.03090, 2018.","title":"Image inspired poetry generation in xiaoice","authors":"Wen-Feng Cheng, Chao-Chung Wu, Ruihua Song, Jianlong Fu, Xing Xie, Jian-Yun Nie","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Elger, 2004] Dietmar Elger. Dadaism. Taschen, 2004.","title":"Dadaism","authors":"Dietmar Elger","year":"2004","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Hadjeres et al., 2017] Gaëtan Hadjeres, Franc ¸ois Pachet, and Frank Nielsen. Deepbach: a steerable model for bach chorales generation. In Proceedings of the 34th Interna- tional Conference on Machine Learning-Volume 70, pages 1362-1371. JMLR. org, 2017.","title":"Deepbach: a steerable model for bach chorales generation","authors":"Gaëtan Hadjeres, Frank Franc ¸ois Pachet, Nielsen","year":"2017","venue":"Proceedings of the 34th International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Isola et al., 2017] Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. Image-to-image translation with con- ditional adversarial networks. CVPR, 2017.","title":"Image-to-image translation with conditional adversarial networks","authors":"Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, Alexei A Efros","year":"2017","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Kant, 1987] Immanuel Kant. Critique of judgment. Hackett Publishing, 1987.","title":"Immanuel Kant. Critique of judgment","authors":"Kant","year":"1987","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Liu et al., 2019] Ruixue Liu, Baoyang Chen, Xiaoyu Guo, Yan Dai, Meng Chen, Zhijie Qiu, and Xiaodong He. From knowledge map to mind map: Artificial imagination. Pro- ceedings of the Second International Conference on Mul- timedia Information Processing and Retrieval, pages 496- 501, 2019.","title":"From knowledge map to mind map: Artificial imagination","authors":"Liu","year":"2019","venue":"Proceedings of the Second International Conference on Multimedia Information Processing and Retrieval","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Manzelli et al., 2018] Rachel Manzelli, Vijay Thakkar, Ali Siahkamari, and Brian Kulis. Conditioning deep gener- ative raw audio models for structured automatic music. arXiv preprint arXiv:1806.09905, 2018.","title":"Conditioning deep generative raw audio models for structured automatic music","authors":"Rachel Manzelli, Vijay Thakkar, Ali Siahkamari, Brian Kulis","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Mikolov et al., 2013] Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig. Linguistic regularities in continuous space word representations. In Proceedings of the 2013 Conference of the North American Chapter of the Asso- ciation for Computational Linguistics: Human Language Technologies, pages 746-751, 2013.","title":"Linguistic regularities in continuous space word representations","authors":"Mikolov","year":"2013","venue":"Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Pennington et al., 2014] Jeffrey Pennington, Richard Socher, and Christopher Manning. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pages 1532-1543, 2014.","title":"Glove: Global vectors for word representation","authors":"Jeffrey Pennington, Richard Socher, Christopher Manning","year":"2014","venue":"Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP)","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Peters et al., 2018] Matthew E Peters, Mark Neumann, Mo- hit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. Deep contextualized word repre- sentations. arXiv preprint arXiv:1802.05365, 2018.","title":"Deep contextualized word representations","authors":"Mark Matthew E Peters, Mohit Neumann, Matt Iyyer, Christopher Gardner, Kenton Clark, Luke Lee, Zettlemoyer","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Toutanova and Manning, 2000] Kristina Toutanova and Christopher D Manning. Enriching the knowledge sources used in a maximum entropy part-of-speech tagger. In Proceedings of the 2000 Joint SIGDAT conference on Empirical methods in natural language processing and very large corpora: held in conjunction with the 38th Annual Meeting of the Association for Computational Linguistics-Volume 13, pages 63-70. Association for Computational Linguistics, 2000.","title":"Enriching the knowledge sources used in a maximum entropy part-of-speech tagger","authors":"Kristina Toutanova, Christopher D Manning","year":"2000","venue":"Proceedings of the 2000 Joint SIGDAT conference on Empirical methods in natural language processing and very large corpora: held in conjunction with the 38th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[van den Oord et al., 2016] Aaron van den Oord, Nal Kalch- brenner, Lasse Espeholt, Oriol Vinyals, Alex Graves, et al. Conditional image generation with pixelcnn de- coders. In Advances in Neural Information Processing Systems, pages 4790-4798, 2016.","title":"Conditional image generation with pixelcnn decoders","authors":"Oord Van Den","year":"2016","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Xu et al., 2018] Tao Xu, Pengchuan Zhang, Qiuyuan Huang, Han Zhang, Zhe Gan, Xiaolei Huang, and Xi- aodong He. Attngan: Fine-grained text to image gener- ation with attentional generative adversarial networks. In 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2018.","title":"Attngan: Fine-grained text to image generation with attentional generative adversarial networks","authors":"Xu","year":"2018","venue":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Yan et al., 2016] Xinchen Yan, Jimei Yang, Kihyuk Sohn, and Honglak Lee. Attribute2image: Conditional image generation from visual attributes. In European Conference on Computer Vision, pages 776-791. Springer, 2016.","title":"Attribute2image: Conditional image generation from visual attributes","authors":"Yan","year":"2016","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Zhang and Lapata, 2014] Xingxing Zhang and Mirella Lap- ata. Chinese poetry generation with recurrent neural net- works. In Proceedings of the 2014 Conference on Empir- ical Methods in Natural Language Processing (EMNLP), pages 670-680, 2014.","title":"Chinese poetry generation with recurrent neural networks","authors":"Lapata ; Zhang, Mirella Zhang, Lapata","year":"2014","venue":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}