{"type":"ScholarlyArticle","title":"A Unified Model for Financial Event Classification, Detection and Summarization","authors":[{"name":"Quanzhi Li","slug":"quanzhi-li","given":"Quanzhi","family":"Li","affiliation":""},{"name":"Qiong Zhang","slug":"qiong-zhang","given":"Qiong","family":"Zhang","affiliation":""}],"abstract":"There is massive amount of news on financial events every day.  In this paper, we present a unified model for detecting, classifying and summarizing financial events.  This model exploits a multi-task learning approach, in which a pre-trained BERT model is used to encode the news articles, and the encoded information are shared by event type classification, detection and summarization tasks. For event summarization, we use a Transformer structure as the decoder. In addition to the input document encoded by BERT, the decoder also utilizes the predicted event type and cluster information, so that it can focus on the specific aspects of the event when generating summary. Our experiments show that our approach outperforms other methods.","doi":"10.24963/ijcai.2020/644","url":"https://ijcai.org/proceedings/2020/644","pdf":"https://ijcai.org/proceedings/2020/0644.pdf","markdown":"https://ijcai.org/proceedings/2020/644.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/644","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Special Track on AI in FinTech","track":"Special Track on AI in FinTech","number":644,"pages":{"first":4668,"last":4674},"keywords":["Foundation for AI in FinTech: Data mining and knowledge discovery for FinTech","Foundation for AI in FinTech: Computational intelligence for FinTech"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/25358/file_25358.m3u8","length_sec":252,"provider":"hls"}],"references":[{"position":1,"raw":"[Gottlob et al., 2002] Georg Gottlob, Nicola Leone, and Fran- cesco Scarcello. Hypertree decompositions and tractable queries. Journal of Computer and System Sciences, 64(3):579-627, May 2002.","title":"Hypertree decompositions and tractable queries","authors":"Gottlob","year":"2002","venue":"Journal of Computer and System Sciences","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Gottlob, 1992] Georg Gottlob. Complexity results for non- monotonic logics. Journal of Logic and Computation, 2(3):397-425, June 1992.","title":"Complexity results for nonmonotonic logics","authors":"Georg Gottlob, Gottlob","year":"1992","venue":"Journal of Logic and Computation","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Aggarwal and Subbian, 2012] Charu C Aggarwal and Karthik Subbian. Event detection in social streams. In SDM, volume 12, pages 624-635. SIAM 2012.","title":"Event detection in social streams","authors":"C Charu, Karthik Aggarwal, Subbian","year":"2012","venue":"SDM","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Allan et al., 2000a] James Allan, Victor Lavrenko, and Hu- bert Jin, First story detection in TDT is hard. CIKM 2000","title":"First story detection in TDT is hard","authors":"Allan","year":"2000","venue":"CIKM 2000","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Allan et al., 2000b] James Allan, Victor Lavrenko, Daniella Malin, and Russell Swan, Detections, bounds, and time- lines: UMass and TDT-3. TDT-3 2000.","title":"Detections, bounds, and timelines: UMass and TDT-3","authors":"Allan","year":"2000","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Allan, 2002] James Allan, editor. Topic Detection and Tracking: Event-based Information Organization. Kluwer Academic Publishers, 2002.","title":"Topic Detection and Tracking: Event-based Information Organization","authors":null,"year":"2002","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Amigo et al., 2008] Enrique Amigó, Julio Gonzalo, Javier Artiles and Felisa Verdejo. A comparison of extrinsic clustering evaluation metrics based on formal constraints. Information Retrieval, 2008.","title":"A comparison of extrinsic clustering evaluation metrics based on formal constraints","authors":"Enrique Amigó, Julio Gonzalo, Javier Artiles, Felisa Verdejo","year":"2008","venue":"Information Retrieval","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Celikyilmaz et al., 2018] Asli Celikyilmaz, Antoine Bosselut, Xiaodong He, and Yejin Choi. Deep communicating agents for abstractive summarization. NAACL 2018 [","title":"Deep communicating agents for abstractive summarization","authors":"Asli Celikyilmaz, Antoine Bosselut, Xiaodong He, Yejin Choi","year":null,"venue":"NAACL 2018","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Collobert et al., 2011] Ronan Collobert, Jason Weston, L´eon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel P. Kuksa. Natural language processing (almost) from scratch. JMLR, 12:2493-2537, 2011.","title":"Natural language processing (almost) from scratch","authors":"Ronan Collobert, Jason Weston, L´eon Bottou, Michael Karlen, Koray Kavukcuoglu, Pavel P Kuksa","year":"2011","venue":"JMLR","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Devlin et al., 2019] Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: Pre-training of deep bidirectional transformers for language understanding. NAACL 2019 [","title":"BERT: Pre-training of deep bidirectional transformers for language understanding","authors":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova","year":null,"venue":"NAACL 2019","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Edunov et al., 2019] Sergey Edunov, Alexei Baevski, and Michael Auli. Pre-trained language model representa- tions for language generation. NAACL 2019","title":"Pre-trained language model representations for language generation","authors":"Sergey Edunov, Alexei Baevski, Michael Auli","year":null,"venue":"NAACL 2019","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Erkan and Radev, 2004] Gunes Erkan, Dragomir R. Radev. Lexrank: graph-based centrality as salience in text sum- marization, JAIR 2014 [Hong and Nenkova 2004]","title":"Lexrank: graph-based centrality as salience in text summarization","authors":"Gunes Erkan, R Dragomir, Radev","year":"2004","venue":"JAIR","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"Kai Hong and Ani Nenkova. 2014. Improving the estimation of word importance for news multidocument summarization. EACL 2004","title":"Improving the estimation of word importance for news multidocument summarization","authors":"Kai Hong, Ani Nenkova","year":"2014","venue":"EACL 2004","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Howard and Ruder, 2018] Jeremy Howard and Sebastian Ruder. 2018. Universal language model fine-tuning for text classification. arXiv preprint arXiv:1801.06146 .","title":"Universal language model fine-tuning for text classification","authors":"Jeremy Howard, Sebastian Ruder","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Katiyar and Cardie, 2016] Arzoo Katiyar and Claire Cardie. Investigating lstms for joint extraction of opinion entities and relations. ACL 2016.","title":"Investigating lstms for joint extraction of opinion entities and relations","authors":"Cardie Katiyar, Arzoo Katiyar, Claire Cardie","year":"2016","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Lan et al, 2019] Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, Radu Soricut, ALBERT: A Lite BERT for Self-supervised Learning of Language Representations, https://arxiv.org/abs/1909.11942, 2019","title":"ALBERT: A Lite BERT for Self-supervised Learning of Language Representations","authors":"Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, Radu Soricut","year":null,"venue":null,"doi":null,"url":"https://arxiv.org/abs/1909.11942,2019","internal_url":null},{"position":17,"raw":"[Li et al., 2017a] Quanzhi Li, Armineh Nourbakhsh, Sameena Shah, Xiaomo Liu, Real-Time Novel Event Detection in Twitter, IEEE ICDE 2017","title":"Real-Time Novel Event Detection in Twitter","authors":"Li","year":"2017","venue":"IEEE ICDE","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Li et al., 2018] Quanzhi Li, Armineh Nourbakhsh, Sameena Shah, Systems and methods for event detection and clustering, US Patent App. 15/800,876, 2018.","title":"Systems and methods for event detection and clustering","authors":"Li","year":"2018","venue":"US Patent App","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Li et al., 2017b] Quanzhi Li, Sameena Shah, Xiaomo Liu, Armineh Nourbakhsh, Data sets: Word embeddings learned from tweets and general data, The 11th International AAAI Conference on Web and Social Media (ICWSM-2017)","title":"Data sets: Word embeddings learned from tweets and general data","authors":"Li","year":"2017","venue":"The 11th International AAAI Conference on Web and Social Media (ICWSM-2017)","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Li et al., 2019] Quanzhi Li, Qiong Zhang, Luo Si, Rumor Detection by Exploiting User Credibility Information, Attention and Multi-task Learning, ACL 2019","title":"Rumor Detection by Exploiting User Credibility Information, Attention and Multi-task Learning","authors":"Li","year":"2019","venue":"ACL 2019","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Lin and Hovy, 2003] Chin-Yew Lin and Eduard Hovy. Automatic evaluation of summaries using n-gram co- occurrence statistics. NAACL 2003","title":"Automatic evaluation of summaries using n-gram cooccurrence statistics","authors":"Lin, Hovy ; Chin-Yew Lin, Eduard Hovy","year":"2003","venue":"NAACL 2003","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Liu and Lapata, 2019] Yang Liu and Mirella Lapata, Text Summarization with Pretrained Encoders, EMNLP 2019","title":"Text Summarization with Pretrained Encoders","authors":"Yang Liu, Mirella Lapata","year":null,"venue":"EMNLP 2019","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Liu et al., 2019] Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, et al., RoBERTa: A Robustly Optimized BERT Pretraining Approach, https://arxiv.org/abs/1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","authors":"Liu","year":"2019","venue":null,"doi":null,"url":"https://arxiv.org/abs/1907.11692","internal_url":null},{"position":24,"raw":"[Liu et al., 2017] Xiaomo Liu, Armineh Nourbakhsh, Quanzhi Li, et al., Reuters Tracer: Toward Automated News Production Using Large Scale Social Media Data, IEEE BigData 2017","title":"Reuters Tracer: Toward Automated News Production Using Large Scale Social Media Data","authors":"Liu","year":"2017","venue":"IEEE BigData","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Mannin g et al., 2008] Christopher D. Manning. Prabhakar Raghavan. Hinrich Schütze. Introduction to Information Retrieval. Cambridge Univ. Press, 2008","title":"Introduction to Information Retrieval","authors":"D Christopher, Manning, Prabhakar Raghavan, Hinrich Schütze","year":"2008","venue":null,"doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Mueller and Thyagarajan, 2016] Jonas Mueller and Aditya Thyagarajan. Siamese recurrent architectures for learning sentence similarity. AAAI 2016.","title":"Siamese recurrent architectures for learning sentence similarity","authors":"Thyagarajan Mueller, Jonas Mueller, Aditya Thyagarajan","year":"2016","venue":"AAAI 2016","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Nallapati et al., 2016] Ramesh Nallapati, Bowen Zhou, Cicero Nogueira dos santos, Caglar Gulcehre, Bing Xiang. Abstractiv text summarization using sequence- tosequence RNNs and beyond. CoNLL 2016 [","title":"Abstractiv text summarization using sequencetosequence RNNs and beyond","authors":"Ramesh Nallapati, Bowen Zhou, Cicero Nogueira Dos Santos, Caglar Gulcehre, Bing Xiang","year":"2016","venue":"CoNLL","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Peters, et al., 2018] Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, Luke Zettlemoyer, Deep contextualized word representations, NAACL 2018 [","title":"Deep contextualized word representations","authors":"Matthew E Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, Luke Zettlemoyer","year":null,"venue":"NAACL 2018","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Petrovic et al., 2010] Sasa Petrovic, Miles Osborne, and Victor Lavrenko. Streaming first story detection with application to Twitter. HLT-ACL 2010 [","title":"Streaming first story detection with application to Twitter","authors":"Sasa Petrovic, Miles Osborne, Victor Lavrenko","year":null,"venue":"HLT-ACL 2010","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Rothe et al., 2019] Sascha Rothe, Shashi Narayan, and Aliaksei Severyn. Leveraging pre-trained checkpoints for sequence generation tasks. arXiv preprint arXiv:1907.12461, 2019","title":"Leveraging pre-trained checkpoints for sequence generation tasks","authors":"Sascha Rothe, Shashi Narayan, Aliaksei Severyn","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Rush et al., 2015] Alexander M. Rush, Sumit Chopra, and Jason Weston. A neural attention model for abstractive sentence summarization. EMNLP 2015 [See et al., 2017]","title":"A neural attention model for abstractive sentence summarization","authors":"Alexander M Rush, Sumit Chopra, Jason Weston","year":"2017","venue":"EMNLP 2015","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"Abigail See, Peter J. Liu, and Christopher D. Manning. Get to the point: Summarization with pointer generator networks. ACL 2017 [","title":"Get to the point: Summarization with pointer generator networks","authors":"Abigail See, Peter J Liu, Christopher D Manning","year":"2017","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Strehl et al., 2002] Alexander Strehl, Joydeep Ghosh. Cluster ensembles -a knowledge reuse framework for combining multiple partitions. JMLR, 3:583 -617, 2002.","title":"Cluster ensembles -a knowledge reuse framework for combining multiple partitions","authors":"Alexander Strehl, Joydeep Ghosh","year":"2002","venue":"JMLR","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Sutskever et al., 2014] lya Sutskever, Oriol Vinyals, and Quoc V. Le. Sequence to sequence learning with neural networks. NIPS 2014","title":"Quoc V. Le. Sequence to sequence learning with neural networks","authors":"Sutskever","year":"2014","venue":"NIPS 2014","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Wang and Zhang, 2017] Zhongqing Wang and Yue Zhang, A Neural Model for Joint Event Detection and Summarization, IJCAI 2017 [","title":"A Neural Model for Joint Event Detection and Summarization","authors":"Wang, Zhang, Wang, Yue Zhang","year":"2017","venue":"IJCAI 2017","doi":null,"url":null,"internal_url":"/proceedings/2017/581"},{"position":36,"raw":"[Wurzer et al. , 2015] DominikWurzer, Victor Lavrenko, and Miles Osborne. Twitter-scale new event detection via kterm hashing. EMNLP 2015.","title":"Miles Osborne. Twitter-scale new event detection via kterm hashing","authors":"Wurzer","year":"2015","venue":"EMNLP 2015","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Yang et al., 2019a] Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Ruslan Salakhutdinov, Quoc V. Le, XLNet: Generalized Autoregressive Pretraining for Language Understanding, NIPS 2019 [","title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","authors":"Yang","year":"2019","venue":"NIPS 2019","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Yang et al., 2016] Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. Hierarchical attention networks for document classification. NAACL 2016 [","title":"Hierarchical attention networks for document classification","authors":"Yang","year":"2016","venue":"NAACL 2016","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Yasunaga et al., 2017] Michihiro Yasunaga, Rui Zhang, Kshitijh Meelu, et al. Graph-based Neural Multi- Document Summarization, CoNLL 2017Conference Name:ACM Woodstock conference [","title":"Graph-based Neural Multi-Document Summarization","authors":"Michihiro Yasunaga, Rui Zhang, Kshitijh Meelu","year":null,"venue":"CoNLL 2017Conference Name:ACM Woodstock conference","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Ye et al., 2018] Hai Ye, Xin Jiang, Zhunchen Luo, Wenhan Chao, Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptions, NAACL 2018","title":"Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptions","authors":"Hai Ye, Xin Jiang, Zhunchen Luo, Wenhan Chao","year":null,"venue":"NAACL 2018","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}