Feature-level Deeper Self-Attention Network for Sequential Recommendation

Tingting Zhang, Pengpeng Zhao, Yanchi Liu, Victor S. Sheng, Jiajie Xu, Deqing Wang, Guanfeng Liu, Xiaofang Zhou

Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence

Main track. Pages 4320-4326.

https://doi.org/10.24963/ijcai.2019/600

PDF BibTeX

Abstract

Sequential recommendation, which aims to recommend next item that the user will likely interact in a near future, has become essential in various Internet applications. Existing methods usually consider the transition patterns between items, but ignore the transition patterns between features of items. We argue that only the item-level sequences cannot reveal the full sequential patterns, while explicit and implicit feature-level sequences can help extract the full sequential patterns. In this paper, we propose a novel method named Feature-level Deeper Self-Attention Network (FDSA) for sequential recommendation. Specifically, FDSA first integrates various heterogeneous features of items into feature sequences with different weights through a vanilla mechanism. After that, FDSA applies separated self-attention blocks on item-level sequences and feature-level sequences, respectively, to model item transition patterns and feature transition patterns. Then, we integrate the outputs of these two blocks to a fully-connected layer for next item recommendation. Finally, comprehensive experimental results demonstrate that considering the transition relationships between features can significantly improve the performance of sequential recommendation.

Keywords

  • Machine Learning: Data Mining
  • Machine Learning: Recommender Systems
Welcome Future Conferences AI Journal Division IJCAI Proceedings Travel Grant Program IJCAI Awards