{"type":"ScholarlyArticle","title":"Short and Sparse Text Topic Modeling via Self-Aggregation","authors":[{"name":"Xiaojun Quan","slug":"xiaojun-quan","given":"Xiaojun","family":"Quan","affiliation":""},{"name":"Chunyu Kit","slug":"chunyu-kit","given":"Chunyu","family":"Kit","affiliation":""},{"name":"Yong Ge","slug":"yong-ge","given":"Yong","family":"Ge","affiliation":""},{"name":"Sinno Jialin Pan","slug":"sinno-jialin-pan","given":"Sinno Jialin","family":"Pan","affiliation":""}],"abstract":"The overwhelming amount of short text data on social media and elsewhere has posed great challenges to topic modeling due to the sparsity problem. Most existing attempts to alleviate this problem resort to heuristic strategies to aggregate short texts into pseudo-documents before the application of standard topic modeling. Although such strategies cannot be well generalized to more general genres of short texts, the success has shed light on how to develop a generalized solution. In this paper, we present a novel model towards this goal by integrating topic modeling with short text aggregation during topic inference. The aggregation is founded on general topical affinity of texts rather than particular heuristics, making the model readily applicable to various short texts. Experimental results on real-world datasets validate the effectiveness of this new model, suggesting that it can distill more meaningful topics from short texts.","doi":null,"url":"https://ijcai.org/proceedings/2015/321","pdf":"https://ijcai.org/proceedings/2015/0321.pdf","markdown":"https://ijcai.org/proceedings/2015/321.md","bibtex":"https://ijcai.org/proceedings/2015/bibtex/321","volume":{"slug":"2015","title":"Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2015","url":"https://ijcai.org/proceedings/2015/","year":2015,"location":"Buenos Aires, Argentina","dates":"25–31 July 2015","editors":"Qiang Yang and Michael Wooldridge","isbn":"978-1-57735-738-4","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":"Web and Knowledge-Based Information Systems","track":"Main Track","number":321,"pages":{"first":2270,"last":2275},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}