{"type":"ScholarlyArticle","title":"Lexicons on Demand: Neural Word Embeddings for Large-Scale Text Analysis","authors":[{"name":"Ethan Fast","slug":"ethan-fast","given":"Ethan","family":"Fast","affiliation":"Stanford University"},{"name":"Binbin Chen","slug":"binbin-chen","given":"Binbin","family":"Chen","affiliation":"Stanford University"},{"name":"Michael S. Bernstein","slug":"michael-s-bernstein","given":"Michael S.","family":"Bernstein","affiliation":"Stanford University"}],"abstract":"Human language is colored by a broad range of topics, but existing text analysis tools only focus on a small number of them. We present Empath, a tool that can generate and validate new lexical categories on demand from a small set of seed terms (like \"bleed\" and \"punch\" to generate the category violence). Empath draws connotations between words and phrases by learning a neural embedding across billions of words on the web. Given a small set of seed words that characterize a category, Empath uses its neural embedding to discover new related terms, then validates the category with a crowd-powered filter. Empath also analyzes text across 200 built-in, pre-validated categories we have generated such as neglect, government, and social media. We show that Empath's data-driven, human validated categories are highly correlated (r=0.906) with similar categories in LIWC.","doi":"10.24963/ijcai.2017/677","url":"https://ijcai.org/proceedings/2017/677","pdf":"https://ijcai.org/proceedings/2017/0677.pdf","markdown":"https://ijcai.org/proceedings/2017/677.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/677","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Best Sister Conferences","track":"Best Sister Conferences","number":677,"pages":{"first":4836,"last":4840},"keywords":["Artificial Intelligence: knowledge representation and reasoning","Artificial Intelligence: natural language processing","Artificial Intelligence: human computer interaction"],"videos":[],"references":[{"position":1,"raw":"[Bradley and Lang, 1999] Margaret M Bradley and Peter J Lang. Affective norms for english words (anew): Instruc- tion manual and affective ratings. In Technical Report C-1, The Center for Research in Psychophysiology, University of Florida, 1999.","title":"Affective norms for english words (anew): Instruction manual and affective ratings","authors":"M Margaret, Peter J Bradley, Lang","year":"1999","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Chambers and Jurafsky, 2009] Nathanael Chambers and Dan Jurafsky. Unsupervised learning of narrative schemas and their participants. In ACL, 2009.","title":"Unsupervised learning of narrative schemas and their participants","authors":"Jurafsky Chambers, Nathanael Chambers, Dan Jurafsky","year":"2009","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Danescu-Niculescu-Mizil et al., 2013] Cristian Danescu- Niculescu-Mizil, Moritz Sudhof, Dan Jurafsky, Jure Leskovec, and Christopher Potts. A computational approach to politeness with application to social factors. In ACL, 2013.","title":"A computational approach to politeness with application to social factors","authors":"Cristian Danescu-Niculescu-Mizil, Moritz Sudhof, Dan Jurafsky, Jure Leskovec, Christopher Potts","year":"2013","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Esuli and Sebastiani, 2006] Andrea Esuli and Fabrizio Se- bastiani. Sentiwordnet: A publicly available lexical re- source for opinion mining. In LREC, 2006.","title":"Sentiwordnet: A publicly available lexical resource for opinion mining","authors":"Andrea Esuli, Fabrizio Sebastiani","year":"2006","venue":"LREC","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Fast and Horvitz, 2016a] Ethan Fast and Eric Horvitz. Iden- tifying dogmatism in social media: Signals and models. EMNLP, 2016.","title":"Identifying dogmatism in social media: Signals and models. EMNLP","authors":"Horvitz Fast, Ethan Fast, Eric Horvitz","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Fast and Horvitz, 2016b] Ethan Fast and Eric Horvitz. Long-term trends in the public perception of artificial in- telligence. AAAI, 2016.","title":"Long-term trends in the public perception of artificial intelligence","authors":"Horvitz Fast, Ethan Fast, Eric Horvitz","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Fast et al., 2014] Ethan Fast, Daniel Steffe, Lucy Wang, Michael Bernstein, and Joel Brandt. Emergent, crowd- scale programming practice in the ide. In CHI, 2014.","title":"Emergent, crowdscale programming practice in the ide","authors":"Ethan Fast, Daniel Steffe, Lucy Wang, Michael Bernstein, Joel Brandt","year":"2014","venue":"CHI","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Fast et al., 2016a] Ethan Fast, Binbin Chen, and Michael S Bernstein. Empath: Understanding topic signals in large- scale text. In CHI, pages 4647-4657. ACM, 2016.","title":"Empath: Understanding topic signals in largescale text","authors":"Fast","year":"2016","venue":"CHI","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Fast et al., 2016b] Ethan Fast, Will McGrath, Pranav Ra- jpurkar, and Michael Bernstein. Mining human behaviors from fiction to power interactive systems. In CHI, 2016.","title":"Mining human behaviors from fiction to power interactive systems","authors":"Fast","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Golder and Macy, 2011] Scott A. Golder and Michael W. Macy. Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. In Science, volume 333, pages 1878-1881, 2011. [Gutenberg, 2016] Gutenberg. Project gutenberg. In https://www.gutenberg.org/, 2016.","title":"Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures","authors":"Scott A Golder, Michael W Macy","year":"2011","venue":"Science","doi":null,"url":"https://www.gutenberg.org/,2016","internal_url":null},{"position":11,"raw":"[Hatzivassiloglou and McKeown, 1997] Vasileios Hatzivas- siloglou and Kathleen R McKeown. Predicting the seman- tic orientation of adjectives. In Proceedings of the 35th annual meeting of the association for computational lin- guistics and eighth conference of the european chapter of the association for computational linguistics, pages 174- 181. Association for Computational Linguistics, 1997.","title":"Predicting the semantic orientation of adjectives","authors":"Vasileios Hatzivassiloglou, Kathleen R Mckeown","year":"1997","venue":"Proceedings of the 35th annual meeting of the association for computational linguistics and eighth conference of the european chapter of the association for computational linguistics","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Hutto and Gilbert, 2014] C. Hutto and Eric Gilbert. Vader: A parsimonious rule-based model for sentiment analysis of social media text. In AAAI, 2014.","title":"Vader: A parsimonious rule-based model for sentiment analysis of social media text","authors":"C Hutto, Eric Gilbert","year":"2014","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Kiciman, 2015] Emre Kiciman. Towards learning a knowl- edge base of actions from experiential microblogs. In AAAI Spring Symposium, 2015.","title":"Towards learning a knowledge base of actions from experiential microblogs","authors":"Emre Kiciman","year":"2015","venue":"AAAI Spring Symposium","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Kramer et al., 2014] Adam D. I. Kramer, Jamie E. Guil- lory, and Jeffrey T. Hancock. Experimental evidence of massive-scale emotional contagion through social net- works. In Proceedings of the National Academy of Sci- ences, volume 111, pages 8788-8790, 2014.","title":"Experimental evidence of massive-scale emotional contagion through social networks","authors":"D I Adam, Jamie E Kramer, Jeffrey T Guillory, Hancock","year":"2014","venue":"Proceedings of the National Academy of Sciences","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Kumar et al., 2013] Ranjitha Kumar, Arvind Satyanarayan, Cesar Torres, Maxine Lim, Salman Ahmad, Scott R Klem- mer, and Jerry O Talton. Webzeitgeist: Design Mining the Web. In CHI, 2013.","title":"Webzeitgeist: Design Mining the Web","authors":"Ranjitha Kumar, Arvind Satyanarayan, Cesar Torres, Maxine Lim, Salman Ahmad, Scott R Klemmer, Jerry O Talton","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Liu and Singh, 2004] H. Liu and P. Singh. Conceptnet -a practical commonsense reasoning tool-kit. In BT Technol- ogy Journal, 2004.","title":"Conceptnet -a practical commonsense reasoning tool-kit","authors":"H Liu, P Singh","year":"2004","venue":"BT Technology Journal","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Luo and Xu, 2015] Qun Luo and Weiran Xu. Learning word vectors efficiently using shared representations and docu- ment representations. In AAAI, 2015.","title":"Learning word vectors efficiently using shared representations and document representations","authors":"Qun Luo, Weiran Xu","year":"2015","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Mikolov et al., 2013a] Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. Distributed repre- sentations of words and phrases and their compositionality. In NIPS, 2013.","title":"Distributed representations of words and phrases and their compositionality","authors":"Mikolov","year":"2013","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Mikolov et al., 2013b] Tomas Mikolov, Wen tau Yih, and Geoffrey Zweig. Linguistic regularities in continuous space word representations. In NAACL-HLT, 2013.","title":"Linguistic regularities in continuous space word representations","authors":"Mikolov","year":"2013","venue":"NAACL-HLT","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Miller, 1995] George A. Miller. WordNet: A lexical database for english. In In Commun. ACM, 1995.","title":"WordNet: A lexical database for english","authors":"George A Miller","year":"1995","venue":"Commun. ACM","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Mohammad and Turney, 2013] Saif M. Mohammad and Pe- ter D. Turney. Crowdsourcing a word-emotion association lexicon. In Computational Intelligence, volume 29, pages 436-465, 2013.","title":"Crowdsourcing a word-emotion association lexicon","authors":"M Saif, Peter D Mohammad, Turney","year":"2013","venue":"Computational Intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Mohammad et al., 2014] Saif M Mohammad, Xiaodan Zhu, Svetlana Kiritchenko, and Joel Martin. Sentiment, emo- tion, purpose, and style in electoral tweets. In Information Processing & Management. Elsevier, 2014.","title":"Sentiment, emotion, purpose, and style in electoral tweets","authors":"Xiaodan Saif M Mohammad, Svetlana Zhu, Joel Kiritchenko, Martin","year":"2014","venue":"Information Processing & Management","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Ott et al., 2011] Myle Ott, Yejin Choi, Claire Cardie, and Jeffrey T Hancock. Finding deceptive opinion spam by any stretch of the imagination. In ACL, 2011.","title":"Finding deceptive opinion spam by any stretch of the imagination","authors":"Myle Ott, Yejin Choi, Claire Cardie, Jeffrey T Hancock","year":"2011","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Pang et al., 2002] Bo Pang, Lillian Lee, and Shivakumar Vaithyanathan. Thumbs up?: sentiment classification us- ing machine learning techniques. In ACL, 2002.","title":"Thumbs up?: sentiment classification using machine learning techniques","authors":"Bo Pang, Lillian Lee, Shivakumar Vaithyanathan","year":"2002","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Pennebaker et al., 2001] James W Pennebaker, Martha E Francis, and Roger J Booth. Linguistic inquiry and word count. In Mahway: Lawrence Erlbaum Associates, 2001.","title":"Linguistic inquiry and word count","authors":"Martha E James W Pennebaker, Roger J Francis, Booth","year":"2001","venue":"Mahway","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Shaver et al., 1987] Phillip Shaver, Judith Schwartz, Don- ald Kirson, and Cary O'connor. Emotion knowledge: fur- ther exploration of a prototype approach. In Journal of personality and social psychology, volume 52, page 1061. American Psychological Association, 1987.","title":"Emotion knowledge: further exploration of a prototype approach","authors":"Phillip Shaver, Judith Schwartz, Donald Kirson, Cary O' Connor","year":"1987","venue":"Journal of personality and social psychology","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Sheng et al., 2008] Victor S Sheng, Foster Provost, and Panagiotis G Ipeirotis. Get another label? improving data quality and data mining using multiple, noisy labelers. In SIGKDD, 2008.","title":"Get another label? improving data quality and data mining using multiple, noisy labelers","authors":"Foster Victor S Sheng, Panagiotis G Provost, Ipeirotis","year":"2008","venue":"SIGKDD","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Socher et al., 2013] Richard Socher, Alex Perelygin, Jean Y. Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng, and Christopher Potts. Recursive deep models for semantic compositionality over a sentiment treebank. In EMNLP, 2013.","title":"Recursive deep models for semantic compositionality over a sentiment treebank","authors":"Richard Socher, Alex Perelygin, Jean Y Wu, Jason Chuang, Christopher D Manning, Andrew Y Ng, Christopher Potts","year":"2013","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Stone et al., 1966] Philip J Stone, Dexter C Dunphy, and Marshall S Smith. The general inquirer: A computer ap- proach to content analysis. MIT press, 1966.","title":"The general inquirer: A computer approach to content analysis","authors":"J Philip, Dexter C Stone, Marshall S Dunphy, Smith","year":"1966","venue":null,"doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Turney, 2002] Peter D. Turney. Thumbs up or thumbs down?: Semantic orientation applied to unsupervised clas- sification of reviews. In ACL, 2002.","title":"Thumbs up or thumbs down?: Semantic orientation applied to unsupervised classification of reviews","authors":"D Peter, Turney","year":"2002","venue":"ACL","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}