{"type":"ScholarlyArticle","title":"Identifying vulnerabilities in trust and reputation systems","authors":[{"name":"Taha D. Güneş","slug":"taha-d-gunes","given":"Taha D.","family":"Güneş","affiliation":"Electronics and Computer Science , University of Southampton , UK"},{"name":"Long Tran-Thanh","slug":"long-tran-thanh","given":"Long","family":"Tran-Thanh","affiliation":"Electronics and Computer Science , University of Southampton , UK"},{"name":"Timothy J. Norman","slug":"timothy-j-norman","given":"Timothy J.","family":"Norman","affiliation":"Electronics and Computer Science , University of Southampton , UK"}],"abstract":"Online communities use trust and reputation systems to assist their users in evaluating other parties. Due to the preponderance of these systems, malicious entities have a strong incentive to attempt to influence them, and strategies employed are increasingly sophisticated. Current practice is to evaluate trust and reputation systems against known attacks, and hence are heavily reliant on expert analysts. We present a novel method for automatically identifying vulnerabilities in such systems by formulating the problem as a derivative-free optimisation problem and applying efficient sampling methods. We illustrate the application of this method for attacks that involve the injection of false evidence, and identify vulnerabilities in existing trust models. In this way, we provide reliable and objective means to assess how robust trust and reputation systems are to different kinds of attacks.","doi":"10.24963/ijcai.2019/44","url":"https://ijcai.org/proceedings/2019/44","pdf":"https://ijcai.org/proceedings/2019/0044.pdf","markdown":"https://ijcai.org/proceedings/2019/44.md","bibtex":"https://ijcai.org/proceedings/2019/bibtex/44","volume":{"slug":"2019","title":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2019","url":"https://ijcai.org/proceedings/2019/","year":2019,"location":"Macao","dates":"10-16 August 2019","editors":"Sarit Kraus","isbn":"978-0-9992411-4-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2019"},"section":"Agent-based and Multi-agent Systems","track":"Main track","number":44,"pages":{"first":308,"last":314},"keywords":["Agent-based and Multi-agent Systems: Trust and Reputation","Multidisciplinary Topics and Applications: Security and Privacy"],"videos":[],"references":[{"position":1,"raw":"[Bidgoly and Ladani, 2016] A. J. Bidgoly and B. T. Ladani. Modeling and quantitative verification of trust systems against malicious attackers. The Computer Journal, 59(7):1005-1027, 2016.","title":"Modeling and quantitative verification of trust systems against malicious attackers","authors":"A J Bidgoly, B T Ladani","year":"2016","venue":"The Computer Journal","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Brundage et al., 2018] M. Brundage, S. Avin, J. Clark, H. Toner, P. Eckersley, B. Garfinkel, A. Dafoe, P. Scharre, T. Zeitzoff, B. Filar, et al. The malicious use of artificial in- telligence: Forecasting, prevention, and mitigation. arXiv preprint arXiv:1802.07228, 2018.","title":"The malicious use of artificial intelligence: Forecasting, prevention, and mitigation","authors":"M Brundage, S Avin, J Clark, H Toner, P Eckersley, B Garfinkel, A Dafoe, P Scharre, T Zeitzoff, B Filar","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bubeck et al., 2011] S. Bubeck, R. Munos, G. Stoltz, and C. Szepesvári. X-armed bandits. J. Mach. Learn. Res., 12:1655-1695, 2011.","title":"X-armed bandits","authors":"S Bubeck, R Munos, G Stoltz, C Szepesvári","year":"2011","venue":"J. Mach. Learn. Res","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Burnett et al., 2010] C. Burnett, T. J. Norman, and K. Sycara. Bootstrapping trust evaluations through stereotypes. In Proc. AAMAS, pages 241-248, 2010.","title":"Bootstrapping trust evaluations through stereotypes","authors":"C Burnett, T J Norman, K Sycara","year":"2010","venue":"Proc. AAMAS","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Emont and Bürge, 2018] J. Emont and C. Bürge. How Scammers in China Manipulate Amazon. Wall Street Journal, 2018. https://www.wsj.com/articles/ how-scammers-in-china-manipulate-amazon-11545044402 Accessed on 02/01/2019.","title":"How Scammers in China Manipulate Amazon","authors":"J Emont, C Bürge","year":"2018","venue":"Wall Street Journal","doi":null,"url":"https://www.wsj.com/articles/how-scammers-in-china-manipulate-amazon-11545044402","internal_url":null},{"position":6,"raw":"[Godefroid et al., 2008] P. Godefroid, M. Y. Levin, and D. Molnar. Automated Whitebox Fuzz Testing. In NDSS, volume 8, pages 151-166, 2008.","title":"Automated Whitebox Fuzz Testing","authors":"P Godefroid, M Y Levin, D Molnar","year":"2008","venue":"NDSS","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Günes ¸et al., 2019] T. D. Günes ¸, L. Tran-Thanh, and T. J. Norman. Attack strategies and analysis for trust and repu- tation systems. (dataset). https://doi.org/10.5258/SOTON/ D0937, 2019. Accessed on 03/06/2019.","title":"Attack strategies and analysis for trust and reputation systems","authors":"T D Günes, ¸, L Tran-Thanh, T J Norman","year":"2019","venue":null,"doi":"10.5258/soton/d0937,2019","url":"https://doi.org/10.5258/SOTON/D0937,2019","internal_url":null},{"position":8,"raw":"[Hoffman et al., 2009] K. Hoffman, D. Zage, and C. Nita- Rotaru. A survey of attack and defense techniques for rep- utation systems. ACM Comput. Surv., 42(1):1-31, 2009.","title":"A survey of attack and defense techniques for reputation systems","authors":"K Hoffman, D Zage, C Nita-Rotaru","year":"2009","venue":"ACM Comput. Surv","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Jøsang and Golbeck, 2009] A. Jøsang and J. Golbeck. Chal- lenges for robust trust and reputation systems. In Proc. SMT, pages 52-64, 2009.","title":"Challenges for robust trust and reputation systems","authors":"A Jøsang, J Golbeck","year":"2009","venue":"Proc. SMT","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Jøsang and Ismail, 2002] A. Jøsang and R. Ismail. The beta reputation system. In Proc. 15th Bled Electronic Com- merce Conference, volume 5, pages 2502-2511, 2002.","title":"The beta reputation system","authors":"A Jøsang, R Ismail","year":"2002","venue":"Proc. 15th Bled Electronic Commerce Conference","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Kamvar et al., 2003] S. D. Kamvar, M. T. Schlosser, and H. Garcia-Molina. The Eigentrust algorithm for reputa- tion management in P2P networks. In Proc. WWW, pages 640-651, 2003.","title":"The Eigentrust algorithm for reputation management in P2P networks","authors":"S D Kamvar, M T Schlosser, H Garcia-Molina","year":"2003","venue":"Proc. WWW","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Kerr and Cohen, 2009] R. Kerr and R. Cohen. Smart cheaters do prosper: Defeating trust and reputation sys- tems. In Proc. AAMAS, pages 993-1000, 2009.","title":"Smart cheaters do prosper: Defeating trust and reputation systems","authors":"R Kerr, R Cohen","year":"2009","venue":"Proc. AAMAS","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Kleywegt et al., 2002] A. J. Kleywegt, A. Shapiro, and T. Homem-de-Mello. The sample average approximation method for stochastic discrete optimization. SIAM J. Op- timization, 12(2):479-502, 2002.","title":"The sample average approximation method for stochastic discrete optimization","authors":"A J Kleywegt, A Shapiro, T Homem-De-Mello","year":"2002","venue":"SIAM J. Optimization","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Liu et al., 2009] X. Liu, A. Datta, K. Razdca, and E. P. Lim. Stereotrust: A group-based personalized trust model. In Proc. 18th ACM CIKM, pages 7-16, 2009.","title":"Stereotrust: A group-based personalized trust model","authors":"Liu","year":"2009","venue":"Proc. 18th ACM CIKM","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Muller et al., 2015] T. Muller, Y. Liu, and J. Zhang. The fallacy of Endogenous Discounting of Trust Recommen- dations. In Proc. AAMAS, pages 563-572, 2015.","title":"The fallacy of Endogenous Discounting of Trust Recommendations","authors":"T Muller, Y Liu, J Zhang","year":"2015","venue":"Proc. AAMAS","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Muller et al., 2016] T. Muller, D. Wang, Y. Liu, and J. Zhang. How to use information theory to mitigate un- fair rating attacks. In Trust Management X, pages 17-32. Springer, 2016.","title":"How to use information theory to mitigate unfair rating attacks","authors":"T Muller, D Wang, Y Liu, J Zhang","year":"2016","venue":"Trust Management X","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Ruan and Durresi, 2016] Y. Ruan and A. Durresi. A sur- vey of trust management systems for online social com- munities -Trust modeling, trust inference and attacks. Knowledge-Based Systems, 106:150 -163, 2016.","title":"A survey of trust management systems for online social communities -Trust modeling, trust inference and attacks","authors":"Y Ruan, A Durresi","year":"2016","venue":"Knowledge-Based Systems","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Teacy et al., 2006] W. T. L. Teacy, J. Patel, N. R. Jennings, and M. Luck. TRAVOS: Trust and reputation in the con- text of inaccurate information sources. Auton. Agent. Multi-Agent Syst., 12(2):183-198, 2006.","title":"TRAVOS: Trust and reputation in the context of inaccurate information sources","authors":"W T L Teacy, J Patel, N R Jennings, M Luck","year":"2006","venue":"Auton. Agent. Multi-Agent Syst","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Teacy et al., 2012] W. T. L. Teacy, M. Luck, A. Rogers, and N. R. Jennings. An efficient and versatile approach to trust and reputation using hierarchical Bayesian modelling. Ar- tif. Intell., 193:149-185, 2012.","title":"An efficient and versatile approach to trust and reputation using hierarchical Bayesian modelling","authors":"W T L Teacy, M Luck, A Rogers, N R Jennings","year":"2012","venue":"Artif. Intell","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Wang et al., 2014] D. Wang, T. Muller, Y. Liu, and J. Zhang. Towards robust and effective trust management for security: A survey. In Proc. PST, pages 511-518, 2014.","title":"Towards robust and effective trust management for security: A survey","authors":"D Wang, T Muller, Y Liu, J Zhang","year":"2014","venue":"Proc. PST","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Wang et al., 2015] D. Wang, T. Muller, A. A. Irissappane, J. Zhang, and Y. Liu. Using information theory to improve the robustness of trust systems. In Proc. AAMAS, pages 791-799, 2015.","title":"Using information theory to improve the robustness of trust systems","authors":"D Wang, T Muller, A A Irissappane, J Zhang, Y Liu","year":"2015","venue":"Proc. AAMAS","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Whitby et al., 2004] A. Whitby, A. Jøsang, and J. Indulska. Filtering out unfair ratings in Bayesian reputation systems. In Proc. 7th Int. Workshop on Trust in Agent Societies, pages 106-117, 2004.","title":"Filtering out unfair ratings in Bayesian reputation systems","authors":"A Whitby, A Jøsang, J Indulska","year":"2004","venue":"Proc. 7th Int. Workshop on Trust in Agent Societies","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}