{"type":"ScholarlyArticle","title":"Contextual Outlier Interpretation","authors":[{"name":"Ninghao Liu","slug":"ninghao-liu","given":"Ninghao","family":"Liu","affiliation":"Department of Computer Science and Engineering , Texas A&M University"},{"name":"Donghwa Shin","slug":"donghwa-shin","given":"Donghwa","family":"Shin","affiliation":"Department of Computer Science and Engineering , Texas A&M University"},{"name":"Xia Hu","slug":"xia-hu","given":"Xia","family":"Hu","affiliation":"Department of Computer Science and Engineering , Texas A&M University; Center for Remote Health Technologies and Systems , Texas A&M Engineering Experiment Station"}],"abstract":"While outlier detection has been intensively studied in many applications, interpretation is becoming increasingly important to help people trust and evaluate the developed detection models through providing intrinsic reasons why the given outliers are identified. It is a nontrivial task for interpreting the abnormality of outliers due to the distinct characteristics of different detection models, complicated structures of data in certain applications, and imbalanced distribution of outliers and normal instances. In addition, contexts where outliers locate, as well as the relation between outliers and the contexts, are usually overlooked in existing interpretation frameworks. To tackle the issues, in this paper, we propose a Contextual Outlier INterpretation (COIN) framework to explain the abnormality of outliers spotted by detectors. The interpretability of an outlier is achieved through three aspects, i.e., outlierness score, attributes that contribute to the abnormality, and contextual description of its neighborhoods. Experimental results on various types of datasets demonstrate the flexibility and effectiveness of the proposed framework.","doi":"10.24963/ijcai.2018/341","url":"https://ijcai.org/proceedings/2018/341","pdf":"https://ijcai.org/proceedings/2018/0341.pdf","markdown":"https://ijcai.org/proceedings/2018/341.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/341","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Machine Learning","track":"Main track","number":341,"pages":{"first":2461,"last":2467},"keywords":["Machine Learning: Interpretability","Machine Learning Applications: Applications of Unsupervised Learning"],"videos":[],"references":[{"position":1,"raw":"[Aggarwal and Yu, 2001] Charu C Aggarwal and Philip S Yu. Outlier detection for high dimensional data. In ACM Sigmod Record, volume 30, pages 37-46. ACM, 2001.","title":"Outlier detection for high dimensional data","authors":"C Charu, Philip S Aggarwal, Yu","year":"2001","venue":"ACM Sigmod Record","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Asuncion and Newman, 2007] A. Asuncion and D.J. New- man. UCI machine learning repository, 2007.","title":"UCI machine learning repository","authors":"A Asuncion, D J","year":"2007","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Breunig et al., 2000] Markus Breunig, Hans-Peter Kriegel, Raymond T Ng, and Jörg Sander. Lof: identifying density- based local outliers. In ACM sigmod record, 2000.","title":"Lof: identifying densitybased local outliers","authors":"Markus Breunig, Hans-Peter Kriegel, Raymond T Ng, Jörg Sander","year":"2000","venue":"ACM sigmod record","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen et al., 2016] Ting Chen, Lu-An Tang, Yizhou Sun, Zhengzhang Chen, and Kai Zhang. Entity embedding- based anomaly detection for heterogeneous categorical events. In IJCAI, 2016.","title":"Entity embeddingbased anomaly detection for heterogeneous categorical events","authors":"Ting Chen, Lu-An Tang, Yizhou Sun, Zhengzhang Chen, Kai Zhang","year":"2016","venue":"IJCAI","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Davis and Goadrich, 2006] Jesse Davis and Mark Goadrich. The relationship between precision-recall and roc curves. In ICML, 2006.","title":"The relationship between precision-recall and roc curves","authors":"Goadrich Davis, Jesse Davis, Mark Goadrich","year":"2006","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Duan et al., 2014] Lei Duan, Guanting Tang, Jian Pei, James Bailey, Guozhu Dong, Akiko Campbell, and Changjie Tang. Mining contrast subspaces. In PAKDD, 2014.","title":"Mining contrast subspaces","authors":"Lei Duan, Guanting Tang, Jian Pei, James Bailey, Guozhu Dong, Akiko Campbell, Changjie Tang","year":"2014","venue":"PAKDD","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Filzmoser et al., 2008] Peter Filzmoser, Ricardo Maronna, and Mark Werner. Outlier identification in high dimen- sions. CSDA, 2008.","title":"Outlier identification in high dimensions","authors":"Peter Filzmoser, Ricardo Maronna, Mark Werner","year":"2008","venue":"CSDA","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Gao et al., 2010] J. Gao, F. Liang, W. Fan, C. Wang, Y. Sun, and J. Han. On community outliers and their efficient de- tection in information networks. KDD, 2010.","title":"On community outliers and their efficient detection in information networks","authors":"J Gao, F Liang, W Fan, C Wang, Y Sun, J Han","year":"2010","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Gao et al., 2017] Jun Gao, Ninghao Liu, Mark Lawley, and Xia Hu. An interpretable classification framework for in- formation extraction from online healthcare forums. Jour- nal of healthcare engineering, 2017.","title":"An interpretable classification framework for information extraction from online healthcare forums","authors":"Gao","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[He and Garcia, 2009] Haibo He and Edwardo A Garcia. Learning from imbalanced data. TKDE, 2009.","title":"Learning from imbalanced data","authors":"Haibo He, Edwardo A Garcia","year":"2009","venue":"TKDE","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[He et al., 2003] Zengyou He, Xiaofei Xu, and Shengchun Deng. Discovering cluster-based local outliers. Pattern Recognition Letters, 24(9):1641-1650, 2003.","title":"Shengchun Deng. Discovering cluster-based local outliers","authors":"He","year":"2003","venue":"Pattern Recognition Letters","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[He et al., 2017] Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. Neural collabo- rative filtering. In WWW, 2017.","title":"Neural collaborative filtering","authors":"He","year":"2017","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Keller et al., 2012] Fabian Keller, Emmanuel Muller, and Klemens Bohm. Hics: high contrast subspaces for density- based outlier ranking. In ICDE. IEEE, 2012.","title":"Hics: high contrast subspaces for densitybased outlier ranking","authors":"Fabian Keller, Emmanuel Muller, Klemens Bohm","year":"2012","venue":"ICDE. IEEE","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Knorr and Ng, 1999] Edwin M Knorr and Raymond T Ng. Finding intensional knowledge of distance-based outliers. In VLDB, 1999.","title":"Finding intensional knowledge of distance-based outliers","authors":"M Edwin, Raymond T Knorr, Ng","year":"1999","venue":"VLDB","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Koh and Liang, 2017] Pang Wei Koh and Percy Liang. Un- derstanding black-box predictions via influence functions. arXiv preprint arXiv:1703.04730, 2017.","title":"Understanding black-box predictions via influence functions","authors":"Pang Wei, Koh, Percy Liang","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Li et al., 2017] Jundong Li, Harsh Dani, Xia Hu, and Huan Liu. Radar: Residual analysis for anomaly detection in attributed networks. In IJCAI, 2017.","title":"Radar: Residual analysis for anomaly detection in attributed networks","authors":"Li","year":"2017","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2017/299"},{"position":17,"raw":"[Liang and Parthasarathy, 2016] Jiongqian Liang and Srini- vasan Parthasarathy. Robust contextual outlier detection: Where context meets sparsity. In CIKM, 2016.","title":"Jiongqian Liang and Srinivasan Parthasarathy. Robust contextual outlier detection: Where context meets sparsity","authors":"Parthasarathy Liang","year":"2016","venue":"CIKM","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Liu et al., 2012] Fei Tony Liu, Kai Ming Ting, and Zhi-Hua Zhou. Isolation-based anomaly detection. TKDD, 2012.","title":"Isolation-based anomaly detection","authors":"Tony Fei, Kai Liu, Ming Ting, Zhi-Hua Zhou","year":"2012","venue":"TKDD","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Liu et al., 2017a] Ninghao Liu, Xiao Huang, and Xia Hu. Accelerated local anomaly detection via resolving at- tributed networks. In IJCAI, 2017.","title":"Accelerated local anomaly detection via resolving attributed networks","authors":"Liu","year":"2017","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2017/325"},{"position":20,"raw":"[Liu et al., 2017b] Yuli Liu, Yiqun Liu, Ke Zhou, Min Zhang, and Shaoping Ma. Detecting collusive spamming activities in community question answering. In WWW, 2017.","title":"Detecting collusive spamming activities in community question answering","authors":"Liu","year":"2017","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Lucic et al., 2016] Mario Lucic, Olivier Bachem, and An- dreas Krause. Linear-time outlier detection via sensitivity. In IJCAI, 2016.","title":"Linear-time outlier detection via sensitivity","authors":"Mario Lucic, Olivier Bachem, Andreas Krause","year":"2016","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2016/257"},{"position":22,"raw":"[Micenková et al., 2013] Barbora Micenková, Raymond T Ng, Xuan-Hong Dang, and Ira Assent. Explaining outliers by subspace separability. In ICDM, 2013.","title":"Explaining outliers by subspace separability","authors":"Barbora Micenková, Raymond T Ng, Xuan-Hong Dang, Ira Assent","year":"2013","venue":"ICDM","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Ntoulas et al., 2006] Alexandros Ntoulas, Marc Najork, Mark Manasse, and Dennis Fetterly. Detecting spam web pages through content analysis. In WWW, 2006.","title":"Detecting spam web pages through content analysis","authors":"Alexandros Ntoulas, Marc Najork, Mark Manasse, Dennis Fetterly","year":"2006","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Perozzi et al., 2014] Bryan Perozzi, Leman Akoglu, Patri- cia Iglesias Sánchez, and Emmanuel Müller. Focused clustering and outlier detection in large attributed graphs. KDD, 2014.","title":"Focused clustering and outlier detection in large attributed graphs","authors":"Bryan Perozzi, Leman Akoglu, Patricia Iglesias Sánchez, Emmanuel Müller","year":"2014","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Ramaswamy et al., 2000] S. Ramaswamy, R. Rastogi, and K. Shim. Efficient algorithms for mining outliers from large data sets. In ACM SIGMOD Record, 2000.","title":"Efficient algorithms for mining outliers from large data sets","authors":"S Ramaswamy, R Rastogi, K Shim","year":"2000","venue":"ACM SIGMOD Record","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Ribeiro et al., 2016] Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. \" why should i trust you?\": Explain- ing the predictions of any classifier. In KDD, 2016.","title":"why should i trust you?\": Explaining the predictions of any classifier","authors":"Marco Tulio Ribeiro, Sameer Singh, Carlos Guestrin","year":"2016","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Shah, 2017] Neil Shah. Flock: Combating astroturfing on livestreaming platforms. In WWW, 2017.","title":"Flock: Combating astroturfing on livestreaming platforms","authors":"Neil Shah","year":"2017","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Tibshirani and Walther, 2005] Robert Tibshirani and Guen- ther Walther. Cluster validation by prediction strength. JCGS, 2005.","title":"Cluster validation by prediction strength","authors":"Walther Tibshirani","year":"2005","venue":null,"doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Tong and Lin, 2011] Hanghang Tong and Ching-Yung Lin. Non-negative residual matrix factorization with applica- tion to graph anomaly detection. SDM, 2011.","title":"Non-negative residual matrix factorization with application to graph anomaly detection","authors":"Lin ; Tong, Hanghang Tong, Ching-Yung Lin","year":"2011","venue":"SDM","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Vinh et al., 2016] Nguyen Xuan Vinh, Jeffrey Chan, Si- mone Romano, James Bailey, Christopher Leckie, Kota- giri Ramamohanarao, and Jian Pei. Discovering outlying aspects in large datasets. DMKD, 2016.","title":"Discovering outlying aspects in large datasets","authors":"Xuan Nguyen, Jeffrey Vinh, Simone Chan, James Romano, Christopher Bailey, Kotagiri Leckie, Jian Ramamohanarao, Pei","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Wong et al., 2002] W. Wong, A. Moore, G. Cooper, and M. Wagner. Rule-based anomaly pattern detection for de- tecting disease outbreaks. In AAAI/IAAI, 2002.","title":"Rule-based anomaly pattern detection for detecting disease outbreaks","authors":"W Wong, A Moore, G Cooper, M Wagner","year":"2002","venue":"AAAI/IAAI","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Yang et al., 2011] Chao Yang, Robert Chandler Harkreader, and Guofei Gu. Die free or live hard? empirical evaluation and new design for fighting evolving twitter spammers. In International Workshop on RAID, 2011.","title":"Die free or live hard? empirical evaluation and new design for fighting evolving twitter spammers","authors":"Chao Yang, Robert Chandler Harkreader, Guofei Gu","year":"2011","venue":"International Workshop on RAID","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Zhu et al., 2004] Ji Zhu, Saharon Rosset, Trevor Hastie, and Rob Tibshirani. 1-norm support vector machines. NIPS, 16(1):49-56, 2004.","title":"1-norm support vector machines","authors":"Ji Zhu, Saharon Rosset, Trevor Hastie, Rob Tibshirani","year":"2004","venue":"NIPS","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}