{"type":"ScholarlyArticle","title":"Joint Learning on Relevant User Attributes in Micro-blog","authors":[{"name":"Jingjing Wang","slug":"jingjing-wang","given":"Jingjing","family":"Wang","affiliation":"Natural Language Processing Lab , School of Computer Science and Technology Soochow University , Suzhou , 215006 , China"},{"name":"Shoushan Li","slug":"shoushan-li","given":"Shoushan","family":"Li","affiliation":"Natural Language Processing Lab , School of Computer Science and Technology Soochow University , Suzhou , 215006 , China"},{"name":"Guodong Zhou","slug":"guodong-zhou","given":"Guodong","family":"Zhou","affiliation":"Natural Language Processing Lab , School of Computer Science and Technology Soochow University , Suzhou , 215006 , China"}],"abstract":"User attribute classification aims to identify users’ attributes (e.g., gender, age and profession) by leveraging user generated content. However, conventional approaches to user attribute classification focus on single attribute classification involving only one user attribute, which completely ignores the relationship among various user attributes. In this paper, we confront a novel scenario in user attribute classification where relevant user attributes are jointly learned, attempting to make the relevant attribute classification tasks help each other. Specifically, we propose a joint learning approach, namely Aux-LSTM, which first learns a proper auxiliary representation between the related tasks and then leverages the auxiliary representation to integrate the learning process in both tasks. Empirical studies demonstrate the effectiveness of our proposed approach to joint learning on relevant user attributes.","doi":"10.24963/ijcai.2017/577","url":"https://ijcai.org/proceedings/2017/577","pdf":"https://ijcai.org/proceedings/2017/0577.pdf","markdown":"https://ijcai.org/proceedings/2017/577.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/577","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Natural Language Processing","track":"Main track","number":577,"pages":{"first":4130,"last":4136},"keywords":["Natural Language Processing: NLP Applications and Tools","Natural Language Processing: Natural Language Processing"],"videos":[],"references":[{"position":1,"raw":"[Ciot et al., 2013] Morgane Ciot, Morgan Sonderegger, and Derek Ruths. Gender inference of twitter users in non- english contexts. In Proceedings of EMNLP-2013, 18-21 October 2013, Grand Hyatt Seattle, Seattle, Washington, USA, pages 1136-1145, 2013.","title":"Gender inference of twitter users in non-english contexts","authors":"Ciot","year":"2013","venue":"Proceedings of EMNLP-2013","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Collobert et al., 2011] Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel P. Kuksa. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12:2493- 2537, 2011.","title":"Natural language processing (almost) from scratch","authors":"Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, Pavel P Kuksa","year":"2011","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Duchi et al., 2011] John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12:2121-2159, 2011.","title":"Adaptive subgradient methods for online learning and stochastic optimization","authors":"John Duchi, Elad Hazan, Yoram Singer","year":"2011","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Gianfortoni et al., 2011] Philip Gianfortoni, David Adam- son, and Carolyn P Rosé. Modeling of stylistic varia- tion in social media with stretchy patterns. In Proceedings of EMNLP-2011, pages 49-59. Association for Computa- tional Linguistics, 2011.","title":"Modeling of stylistic variation in social media with stretchy patterns","authors":"Philip Gianfortoni, David Adamson, Carolyn P Rosé","year":"2011","venue":"Proceedings of EMNLP-2011","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Glorot and Bengio, 2010] Xavier Glorot and Yoshua Ben- gio. Understanding the difficulty of training deep feedfor- ward neural networks. In Proceedings of AISTATS-2010, Chia Laguna Resort, Sardinia, Italy, May 13-15, 2010, pages 249-256, 2010.","title":"Xavier Glorot and Yoshua Bengio. Understanding the difficulty of training deep feedforward neural networks","authors":"Bengio Glorot","year":"2010","venue":"Proceedings of AISTATS-2010","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Graves, 2013] Alex Graves. Generating sequences with re- current neural networks. CoRR, abs/1308.0850, 2013.","title":"Generating sequences with recurrent neural networks","authors":"Alex Graves","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Hochreiter and Schmidhuber, 1997] Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural Computation, 9(8):1735-1780, 1997.","title":"Long short-term memory","authors":"Schmidhuber Hochreiter, Sepp Hochreiter, Jürgen Schmidhuber","year":"1997","venue":"Neural Computation","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Johnson and Zhang, 2015] Rie Johnson and Tong Zhang. Effective use of word order for text categorization with convolutional neural networks. In Proceedings of NAACL- 2015, Denver, Colorado, USA, May 31 -June 5, 2015, pages 103-112, 2015.","title":"Effective use of word order for text categorization with convolutional neural networks","authors":"Johnson, Zhang ; ] Rie Johnson, Tong Zhang","year":"2015","venue":"Proceedings of NAACL-2015","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Li et al., 2015] Shoushan Li, Jingjing Wang, Guodong Zhou, and Hanxiao Shi. Interactive gender inference with integer linear programming. In Proceedings of IJCAI- 2015, Buenos Aires, Argentina, July 25-31, 2015, pages 2341-2347, 2015.","title":"Interactive gender inference with integer linear programming","authors":"Shoushan Li, Jingjing Wang, Guodong Zhou, Hanxiao Shi","year":"2015","venue":"Proceedings of IJCAI-2015","doi":null,"url":null,"internal_url":"/proceedings/2015/331"},{"position":10,"raw":"[Marquardt et al., 2014] James Marquardt, Golnoosh Far- nadi, Gayathri Vasudevan, Marie-Francine Moens, Sergio Davalos, Ankur Teredesai, and Martine De Cock. Age and gender identification in social media. In Proceedings of CLEF-2014, Sheffield, UK, September 15-18, 2014., pages 1129-1136, 2014.","title":"Age and gender identification in social media","authors":"James Marquardt, Golnoosh Farnadi, Gayathri Vasudevan, Marie-Francine Moens, Sergio Davalos, Ankur Teredesai, Martine De Cock","year":"2014","venue":"Proceedings of CLEF-2014","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Mohammad and Yang, 2013] Saif Mohammad and Tony Yang. Tracking sentiment in mail: How genders differ on emotional axes. In Proceedings of ACL-HLT-2011, Port- land, Oregon, USA, 24 June, 2011, pages 70-79, 2013.","title":"Tracking sentiment in mail: How genders differ on emotional axes","authors":"Mohammad, Yang ;, Saif Mohammad, Tony Yang","year":"2011","venue":"Proceedings of ACL-HLT-2011","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Mukherjee and Liu, 2010] Arjun Mukherjee and Bing Liu. Improving gender classification of blog authors. In Pro- ceedings of EMNLP-2010, 9-11 October 2010, MIT Stata Center, Massachusetts, USA, pages 207-217, 2010.","title":"Improving gender classification of blog authors","authors":"Liu Mukherjee, Arjun Mukherjee, Bing Liu","year":"2010","venue":"Proceedings of EMNLP-2010","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[O'Connor et al., 2010] Brendan O'Connor, Ramnath Bala- subramanyan, Bryan R. Routledge, and Noah A. Smith. From tweets to polls: Linking text sentiment to public opinion time series. In Proceedings of ICWSM-2010, Washington, DC, USA, May 23-26, 2010, 2010.","title":"From tweets to polls: Linking text sentiment to public opinion time series","authors":"O' Brendan, Ramnath Connor, Bryan R Balasubramanyan, Noah A Routledge, Smith","year":"2010","venue":"Proceedings of ICWSM-2010","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Peersman et al., 2011] Claudia Peersman, Walter Daele- mans, and Leona Van Vaerenbergh. Predicting age and gender in online social networks. In Proceedings of CIKM- 2011, Glasgow, United Kingdom, October 28, 2011, pages 37-44, 2011.","title":"Predicting age and gender in online social networks","authors":"Claudia Peersman, Walter Daelemans, Leona Van Vaerenbergh","year":"2011","venue":"Proceedings of CIKM-2011","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Preotiuc-Pietro et al., 2015] Daniel Preotiuc-Pietro, Vasileios Lampos, and Nikolaos Aletras. An analy- sis of the user occupational class through twitter content. In Proceedings of ACL-2015, July 26-31, 2015, Beijing, China, Volume 1: Long Papers, pages 1754-1764, 2015.","title":"An analysis of the user occupational class through twitter content","authors":"Daniel Preotiuc-Pietro, Vasileios Lampos, Nikolaos Aletras","year":"2015","venue":"Proceedings of ACL-2015","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Schler et al., 2006] Jonathan Schler, Moshe Koppel, Shlomo Argamon, and James W. Pennebaker. Effects of age and gender on blogging. In Proceedings of AAAI- 2006, Stanford, California, USA, March 27-29, 2006, pages 199-205, 2006.","title":"Effects of age and gender on blogging","authors":"Jonathan Schler, Moshe Koppel, Shlomo Argamon, James W Pennebaker","year":"2006","venue":"Proceedings of AAAI-2006","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Tu et al., 2015] Cunchao Tu, Zhiyuan Liu, and Maosong Sun. Prism: Profession identification in social media with personal information and community structure. In Chinese National Conference on Social Media Processing, pages 15-27. Springer, 2015.","title":"Prism: Profession identification in social media with personal information and community structure","authors":"Tu","year":"2015","venue":"Chinese National Conference on Social Media Processing","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Volkova et al., 2013] Svitlana Volkova, Theresa Wilson, and David Yarowsky. Exploring demographic language variations to improve multilingual sentiment analysis in social media. In Proceedings of EMNLP-2013, 18-21 October 2013, Grand Hyatt Seattle, Seattle, Washington, USA, pages 1815-1827, 2013.","title":"Exploring demographic language variations to improve multilingual sentiment analysis in social media","authors":"Svitlana Volkova, Theresa Wilson, David Yarowsky","year":"2013","venue":"Proceedings of EMNLP-2013","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Wang et al., 2015a] Jingjing Wang, Yunxia Xue, Shoushan Li, and Guodong Zhou. Leveraging interactive knowl- edge and unlabeled data in gender classification with co- training. In Proceedings of DASFAA-2015 International Workshops, SeCoP, BDMS, and Posters, Hanoi, Vietnam, April 20-23, 2015, Revised Selected Papers, pages 246- 251, 2015.","title":"Leveraging interactive knowledge and unlabeled data in gender classification with cotraining","authors":"Wang","year":"2015","venue":"Proceedings of DASFAA-2015 International Workshops, SeCoP, BDMS, and Posters","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Wang et al., 2015b] Xin Wang, Yuanchao Liu, Chengjie Sun, Baoxun Wang, and Xiaolong Wang. Predicting polar- ities of tweets by composing word embeddings with long short-term memory. In Proceedings of ACL-2015, July 26- 31, 2015, Beijing, China, Volume 1: Long Papers, pages 1343-1353, 2015.","title":"Predicting polarities of tweets by composing word embeddings with long short-term memory","authors":"Wang","year":"2015","venue":"Proceedings of ACL-2015","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Yang and Liu, 1999] Yiming Yang and Xin Liu. A re- examination of text categorization methods. In Proceed- ings of SIGIR-1999, August 15-19, 1999, Berkeley, CA, USA, pages 42-49, 1999.","title":"A reexamination of text categorization methods","authors":"Yiming Yang, Xin Liu","year":"1999","venue":"Proceedings of SIGIR-1999","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Zhu et al., 2015] Zhu Zhu, Jingjing Wang, Shoushan Li, and Guodong Zhou. Interactive gender inference in social media. In Database Systems for Advanced Applications -DASFAA 2015 International Workshops, SeCoP, BDMS, and Posters, Hanoi, Vietnam, April 20-23, 2015, Revised Selected Papers, pages 252-258, 2015.","title":"Interactive gender inference in social media","authors":"Zhu Zhu, Jingjing Wang, Shoushan Li, Guodong Zhou","year":"2015","venue":"Database Systems for Advanced Applications -DASFAA 2015 International Workshops, SeCoP, BDMS, and Posters","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}