{"type":"ScholarlyArticle","title":"Optimizing Sentence Modeling and Selection for Document Summarization","authors":[{"name":"Wenpeng Yin","slug":"wenpeng-yin","given":"Wenpeng","family":"Yin","affiliation":""},{"name":"Yulong Pei","slug":"yulong-pei","given":"Yulong","family":"Pei","affiliation":""}],"abstract":"Extractive document summarization aims to conclude given documents by extracting some salient sentences. Often, it faces two challenges: 1) how to model the information redundancy among candidate sentences; 2) how to select the most appropriate sentences. This paper attempts to build a strong summarizer DivSelect+CNNLM by presenting new algorithms to optimize each of them. Concretely, it proposes CNNLM, a novel neural network language model (NNLM) based on convolutional neural network (CNN), to project sentences into dense distributed representations, then models sentence redundancy by cosine similarity. Afterwards, it formulates the selection process as an optimization problem, constructing a diversified selection process (DivSelect) with the aim of selecting some sentences which have high prestige, meantime, are dis-similar with each other. Experimental results on DUC2002 and DUC2004 benchmark data sets demonstrate the effectiveness of our approach.","doi":null,"url":"https://ijcai.org/proceedings/2015/199","pdf":"https://ijcai.org/proceedings/2015/0199.pdf","markdown":"https://ijcai.org/proceedings/2015/199.md","bibtex":"https://ijcai.org/proceedings/2015/bibtex/199","volume":{"slug":"2015","title":"Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2015","url":"https://ijcai.org/proceedings/2015/","year":2015,"location":"Buenos Aires, Argentina","dates":"25–31 July 2015","editors":"Qiang Yang and Michael Wooldridge","isbn":"978-1-57735-738-4","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":"Natural Language Processing","track":"Main Track","number":199,"pages":{"first":1383,"last":1388},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}