{"type":"ScholarlyArticle","title":"Story Embedding: Learning Distributed Representations of Stories based on Character Networks (Extended Abstract)","authors":[{"name":"O-Joun Lee","slug":"o-joun-lee","given":"O-Joun","family":"Lee","affiliation":"Future IT Innovation Laboratory , Pohang University of Science and Technology , Republic of Korea"},{"name":"Jason J. Jung","slug":"jason-j-jung","given":"Jason J.","family":"Jung","affiliation":"Department of Computer Engineering , Chung-Ang University , Seoul , Republic of Korea"}],"abstract":"This study aims to represent stories in narrative works (i.e., creative works that contain stories) with a fixed-length vector. We apply subgraph-based graph embedding models to dynamic social networks of characters that appeared in stories (character networks). We suppose that interactions between characters reflect the content of stories. We discretize the interactions by discovering the subgraphs and learn representations of stories by predicting occurrences of the subgraphs in corresponding character networks. We find subgraphs rooted in each character on each scene in multiple scales, using the WL (Weisfeiler-Lehman) relabeling process. To predict occurrences of subgraphs, we apply two approaches: (i) considering changes in subgraphs according to scenes and (ii) focusing on subgraphs on the last scene. We evaluated the proposed models by measuring the similarity between real movies with vector representations that were generated by the models.","doi":"10.24963/ijcai.2020/709","url":"https://ijcai.org/proceedings/2020/709","pdf":"https://ijcai.org/proceedings/2020/0709.pdf","markdown":"https://ijcai.org/proceedings/2020/709.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/709","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Journal track","track":"Journal track","number":709,"pages":{"first":5070,"last":5074},"keywords":["Machine Learning Applications: Networks","Multidisciplinary Topics and Applications: Social Sciences","Machine Learning: Learning Generative Models"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/25054/file_25054.m3u8","length_sec":289,"provider":"hls"}],"references":[{"position":1,"raw":"[Bost et al., 2019] Xavier Bost, Serigne Gueye, Vincent La- batut, Martha Larson, Georges Linarès, Damien Malinas, and Raphaël Roth. Remembering winter was coming. Multimedia Tools and Applications, 78(24):35373-35399, September 2019.","title":"Remembering winter was coming","authors":"Xavier Bost, Serigne Gueye, Vincent Labatut, Martha Larson, Georges Linarès, Damien Malinas, Raphaël Roth","year":"2019","venue":"Multimedia Tools and Applications","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Callaway and Lester, 2002] Charles B. Callaway and James C. Lester. Narrative prose generation. Artificial Intelligence, 139(2):213-252, August 2002.","title":"Narrative prose generation","authors":"Charles B Callaway, James C Lester","year":"2002","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2001/164"},{"position":3,"raw":"[Jung et al., 2017] Jai E. Jung, O-Joun Lee, Eun-Soon You, and Myoung-Hee Nam. A computational model of trans- media ecosystem for story-based contents. Multimedia Tools and Applications, 76(8):10371-10388, April 2017.","title":"A computational model of transmedia ecosystem for story-based contents","authors":"Jai E Jung, O-Joun Lee, Eun-Soon You, Myoung-Hee Nam","year":"2017","venue":"Multimedia Tools and Applications","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Labatut and Bost, 2019] Vincent Labatut and Xavier Bost. Extraction and analysis of fictional character networks: A survey. ACM Computing Surveys, 52(5):1-40, September 2019.","title":"Extraction and analysis of fictional character networks: A survey","authors":"Bost Labatut, Vincent Labatut, Xavier Bost","year":"2019","venue":"ACM Computing Surveys","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Le and Mikolov, 2014] Quoc V. Le and Tomas Mikolov. Distributed representations of sentences and documents. In Eric P. Xing and Tony Jebara, editors, Proceedings of the 31th International Conference on Machine Learning (ICML 2014), volume 32 of JMLR Workshop and Confer- ence Proceedings, pages 1188-1196, Beijing, China, June 2014. JMLR.org.","title":"Distributed representations of sentences and documents","authors":"V Quoc, Tomas Le, Mikolov","year":"2014","venue":"Proceedings of the 31th International Conference on Machine Learning (ICML 2014)","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Lee and Jung, 2018] O-Joun Lee and Jason J. Jung. Ex- plainable movie recommendation systems by using story- based similarity. In Alan Said and Takanori Komatsu, editors, Joint Proceedings of the ACM IUI 2018 Work- shops co-located with the 23rd ACM Conference on In- telligent User Interfaces (ACM IUI 2018), volume 2068 of CEUR Workshop Proceedings, Tokyo, Japan, March 2018. CEUR-WS.org.","title":"Explainable movie recommendation systems by using storybased similarity","authors":"O-Joun Lee, Jason J Jung","year":"2018","venue":"Joint Proceedings of the ACM IUI 2018 Workshops co-located with the 23rd ACM Conference on Intelligent User Interfaces (ACM IUI 2018)","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Lee and Jung, 2019a] O-Joun Lee and Jason J. Jung. Inte- grating character networks for extracting narratives from multimodal data. Information Processing and Manage- ment, 56(5):1894-1923, September 2019.","title":"Integrating character networks for extracting narratives from multimodal data","authors":"Lee, Jung ; A] O-Joun Lee, Jason J Jung","year":"2019","venue":"Information Processing and Management","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Lee and Jung, 2019b] O-Joun Lee and Jason J. Jung. Mod- eling affective character network for story analytics. Fu- ture Generation Computer Systems, 92:458-478, March 2019.","title":"Modeling affective character network for story analytics","authors":"Lee, Jung ; B] O-Joun Lee, Jason J Jung","year":"2019","venue":"Future Generation Computer Systems","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Lee and Jung, 2020] O-Joun Lee and Jason J. Jung. Story embedding: Learning distributed representations of sto- ries based on character networks. Artificial Intelligence, 281:103235, April 2020.","title":"Story embedding: Learning distributed representations of stories based on character networks","authors":"O-Joun Lee, Jason J Jung","year":"2020","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Lee et al., 2020] O-Joun Lee, Jason J. Jung, and Jin-Taek Kim. Learning hierarchical representations of stories by using multi-layered structures in narrative multimedia. Sensors, 20(7):1978, April 2020.","title":"Learning hierarchical representations of stories by using multi-layered structures in narrative multimedia","authors":"O-Joun Lee, Jason J Jung, Jin-Taek Kim","year":"2020","venue":"Sensors","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Mani, 2012] Inderjeet Mani. Computational Modeling of Narrative. Synthesis Lectures on Human Language Tech- nologies. Morgan & Claypool Publishers, 2012.","title":"Computational Modeling of Narrative","authors":"Inderjeet Mani","year":"2012","venue":"Synthesis Lectures on Human Language Technologies","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Mani, 2016] Inderjeet Mani. Animation motion in narra- tiveml. In Ben Miller, Antonio Lieto, Rémi Ronfard, Stephen G. Ware, and Mark A. Finlayson, editors, Pro- ceedings of the 7th Workshop on Computational Models of Narrative (CMN 2016), volume 53 of OASICS, pages 3:1-3:16, Kraków, Poland, July 2016. Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik.","title":"Animation motion in narrativeml","authors":"Inderjeet Mani","year":"2016","venue":"Proceedings of the 7th Workshop on Computational Models of Narrative (CMN 2016)","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[McKee, 1997] Robert McKee. Story: Substance, Structure, Style and the Principles of Screenwriting. HarperCollins, New York, NY, USA, November 1997.","title":"Story: Substance, Structure, Style and the Principles of Screenwriting","authors":"Robert Mckee","year":"1997","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Mikolov et al., 2013] Tomas Mikolov, Ilya Sutskever, Kai Chen, Gregory S. Corrado, and Jeffrey Dean. Distributed representations of words and phrases and their composi- tionality. In Christopher J. C. Burges, Léon Bottou, Zoubin Ghahramani, and Kilian Q. Weinberger, editors, Advances in Neural Information Processing Systems 26: Proceed- ings of 27th Annual Conference on Neural Information Processing Systems (NIPS 2013), pages 3111-3119, Lake Tahoe, Nevada, US, December 2013.","title":"Distributed representations of words and phrases and their compositionality","authors":"Mikolov","year":"2013","venue":"Advances in Neural Information Processing Systems 26: Proceedings of 27th Annual Conference on Neural Information Processing Systems (NIPS 2013)","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"Curran Associates, Inc. [Narayanan et al., 2016]","title":null,"authors":"Inc [ Curran Associates, Narayanan","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"Annamalai Narayanan, Mahinthan Chandramohan, Lihui Chen, Yang Liu, and Santhoshku- mar Saminathan. subgraph2vec: Learning distributed rep- resentations of rooted sub-graphs from large graphs. arXiv preprint: 1606.08928, June 2016.","title":"subgraph2vec: Learning distributed representations of rooted sub-graphs from large graphs","authors":"Annamalai Narayanan, Mahinthan Chandramohan, Lihui Chen, Yang Liu, Santhoshkumar Saminathan","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Park et al., 2012] Seung-Bo Park, Kyeong-Jin Oh, and Ge- unSik Jo. Social network analysis in a movie us- ing character-net. Multimedia Tools and Applications, 59(2):601-627, January 2012.","title":"Social network analysis in a movie using character-net","authors":"Seung-Bo Park, Kyeong-Jin Oh, Ge-Unsik Jo","year":"2012","venue":"Multimedia Tools and Applications","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Purdy and Riedl, 2016] Christopher Purdy and Mark O. Riedl. Reading between the lines: Using plot graphs to draw inferences from stories. In Frank Nack and An- drew S. Gordon, editors, Proceedings of the 9th Inter- national Conference on Interactive Digital Storytelling (ICIDS 2016), volume 10045 of Lecture Notes in Com- puter Science, pages 197-208, Los Angeles, CA, US, November 2016. Springer.","title":"Reading between the lines: Using plot graphs to draw inferences from stories","authors":"Christopher Purdy, Mark O Riedl","year":"2016","venue":"Proceedings of the 9th International Conference on Interactive Digital Storytelling (ICIDS 2016)","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Shervashidze et al., 2011] Nino Shervashidze, Pascal Schweitzer, Erik Jan van Leeuwen, Kurt Mehlhorn, and Karsten M. Borgwardt. Weisfeiler-lehman graph kernels. Journal of Machine Learning Research, 12:2539-2561, September 2011.","title":"Weisfeiler-lehman graph kernels","authors":"Nino Shervashidze, Pascal Schweitzer, Erik Jan Van Leeuwen, Kurt Mehlhorn, Karsten M Borgwardt","year":"2011","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Tran and Jung, 2015] Quang Dieu Tran and Jai E. Jung. Cocharnet: Extracting social networks using character co- occurrence in movies. Journal of Universal Computer Sci- ence, 21(6):796-815, June 2015.","title":"Cocharnet: Extracting social networks using character cooccurrence in movies","authors":"Tran, Jung ; ] Quang, Dieu Tran, Jai E Jung","year":"2015","venue":"Journal of Universal Computer Science","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Tran et al., 2017] Quang Dieu Tran, Dosam Hwang, O-Joun Lee, and Jai E. Jung. Exploiting character networks for movie summarization. Multimedia Tools and Applications, 76(8):10357-10369, April 2017.","title":"Exploiting character networks for movie summarization","authors":"Quang Dieu Tran, Dosam Hwang, O-Joun Lee, Jai E Jung","year":"2017","venue":"Multimedia Tools and Applications","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Weng et al., 2009] Chung-Yi Weng, Wei-Ta Chu, and Ja- Ling Wu. RoleNet: Movie analysis from the perspective of social networks. IEEE Transactions on Multimedia, 11(2):256-271, February 2009.","title":"RoleNet: Movie analysis from the perspective of social networks","authors":"Chung-Yi Weng, Wei-Ta Chu, Ja-Ling Wu","year":"2009","venue":"IEEE Transactions on Multimedia","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}