Hashtag Recommendation for Multimodal Microblog Using Co-Attention Network

Hashtag Recommendation for Multimodal Microblog Using Co-Attention Network

Qi Zhang, Jiawen Wang, Haoran Huang, Xuanjing Huang, Yeyun Gong

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence
Main track. Pages 3420-3426. https://doi.org/10.24963/ijcai.2017/478

In microblogging services, authors can use hashtags to mark keywords or topics. Many live social media applications (e.g., microblog retrieval, classification) can gain great benefits from these manually labeled tags. However, only a small portion of microblogs contain hashtags inputed by users. Moreover, many microblog posts contain not only textual content but also images. These visual resources also provide valuable information that may not be included in the textual content. So that it can also help to recommend hashtags more accurately. Motivated by the successful use of the attention mechanism, we propose a co-attention network incorporating textual and visual information to recommend hashtags for multimodal tweets. Experimental result on the data collected from Twitter demonstrated that the proposed method can achieve better performance than state-of-the-art methods using textual information only.
Keywords:
Machine Learning: Neural Networks
Multidisciplinary Topics and Applications: AI and Social Sciences