Recommender Systems, Missing Data and Statistical Model Estimation

Marlin, Benjamin M.; Zemel, Richard S.; Roweis, Sam T.; Slaney, Malcolm

doi:10.5591/978-1-57735-516-8/IJCAI11-447

Recommender Systems, Missing Data and Statistical Model Estimation

Benjamin M. Marlin, Richard S. Zemel, Sam T. Roweis, Malcolm Slaney

Download BibTeX Cite

Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence. Pages 2686-2690.

https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-447

Abstract

The goal of rating-based recommender systems is to make personalized predictions and recommendations for individual users by leveraging the preferences of a community of users with respect to a collection of items like songs or movies. Recommender systems are often based on intricate statistical models that are estimated from data sets containing a very high proportion of missing ratings. This work describes evidence of a basic incompatibility between the properties of recommender system data sets and the assumptions required for valid estimation and evaluation of statistical models in the presence of missing data. We discuss the implications of this problem and describe extended modelling and evaluation frameworks that attempt to circumvent it. We present prediction and ranking results showing that models developed and tested under these extended frameworks can significantly outperform standard models.

Benjamin M. Marlin, Richard S. Zemel, Sam T. Roweis, and Malcolm Slaney. 2011. Recommender Systems, Missing Data and Statistical Model Estimation. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI-11. IJCAI, 2686–2690. https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-447

@inproceedings{ijcai2011p447,
  title     = {Recommender Systems, Missing Data and Statistical Model Estimation},
  author    = {Marlin, Benjamin M. and Zemel, Richard S. and Roweis, Sam T. and Slaney, Malcolm},
  booktitle = {Proceedings of the Twenty-Second International Joint Conference on
               Artificial Intelligence, {IJCAI-11}},
  publisher = {AAAI Press/International Joint Conferences on Artificial Intelligence},
  editor    = {Toby Walsh},
  pages     = {2686--2690},
  year      = {2011},
  month     = {7},
  doi       = {10.5591/978-1-57735-516-8/IJCAI11-447},
  url       = {https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-447},
}

TY  - CPAPER
TI  - Recommender Systems, Missing Data and Statistical Model Estimation
AU  - Marlin, Benjamin M.
AU  - Zemel, Richard S.
AU  - Roweis, Sam T.
AU  - Slaney, Malcolm
T2  - Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI-11
PB  - AAAI Press/International Joint Conferences on Artificial Intelligence
PY  - 2011
SP  - 2686
EP  - 2690
DO  - 10.5591/978-1-57735-516-8/IJCAI11-447
UR  - https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-447
ER  -