Proceedings

One-Class Conditional Random Fields for Sequential Anomaly Detection

Download BibTeX Cite

Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. Pages 1685-1690.

© 2013 International Joint Conferences on Artificial Intelligence

Abstract

Sequential anomaly detection is a challenging problem due to the one-class nature of the data (i.e., data is collected from only one class) and the temporal dependence in sequential data. We present One-Class Conditional Random Fields (OCCRF) for sequential anomaly detection that learn from a one-class dataset and capture the temporal dependence structure, in an unsupervised fashion. We propose a hinge loss in a regularized risk minimization framework that maximizes the margin between each sequence being classified as normal and abnormal. This allows our model to accept most (but not all) of the training data as normal, yet keeps the solution space tight. Experimental results on a number of real-world datasets show our model outperforming several baselines. We also report an exploratory study on detecting abnormal organizational behavior in enterprise social networks.

  1. [Abe et al., 2006] Naoki Abe, Bianca Zadrozny, and John Langford. Outlier detection by active learning. In KDD, 2006.
  2. [Blei et al., 2003] David M. Blei, Andrew Y. Ng, and Michael I. Jordan. Latent dirichlet allocation. Journal of Machine Learning Research, 3, 2003.
  3. [Breunig et al., 2000] Markus M. Breunig, Hans-Peter Kriegel, Raymond T. Ng, and Jörg Sander. Lof: Identify- ing density-based local outliers. In SIGMOD, 2000.
  4. [Chandola et al., 2009] Varun Chandola, Arindam Banerjee, and Vipin Kumar. Anomaly detection: A survey. ACM Comput. Surv., 41(3), 2009.
  5. [Chandola, 2009] Varun Chandola. Anomaly detection for symbolic sequences and time series data. PhD thesis, Uni- versity of Minnesota, 2009.
  6. [Chang and Lin, 2011] Chih-Chung Chang and Chih-Jen Lin. Libsvm: A library for support vector machines. ACM TIST, 2(3):27, 2011.
  7. [Cheng et al., 2009] Haibin Cheng, Pang-Ning Tan, Christo- pher Potter, and Steven A. Klooster. Detection and char- acterization of anomalies in multivariate time series. In SDM, 2009.
  8. [Do and Artieres, 2012] Trinh-Minh-Tri Do and Thierry Artieres. Regularized bundle methods for convex and non- convex risks. Journal of Machine Learning Research, 13, 2012.
  9. [Erdogan, 2011] Goker Erdogan. Outlier Detection Toolbox in Matlab, 2011.
  10. [Ghasemi et al., 2012] Alireza Ghasemi, Hamid R. Rabiee, Mohammad Taghi Manzuri, and Mohammad Hossein Ro- hban. A bayesian approach to the data description prob- lem. In AAAI, 2012.
  11. [He and Garcia, 2009] Haibo He and Edwardo A. Garcia. Learning from imbalanced data. IEEE Trans. Knowl. Data Eng., 21(9), 2009.
  12. [Lafferty et al., 2001] John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In ICML, 2001.
  13. [Lafferty et al., 2004] John D. Lafferty, Xiaojin Zhu, and Yan Liu. Kernel conditional random fields: representation and clique selection. In ICML, 2004.
  14. [Liao et al., 2010] Zicheng Liao, Yizhou Yu, and Baoquan Chen. Anomaly detection in gps data based on visual ana- lytics. In IEEE VAST, 2010.
  15. [Lin et al., 2012] Ching-Yung Lin, Lynn Wu, Zhen Wen, Hanghang Tong, Vicky Griffiths-Fisher, Lei Shi, and David Lubensky. Social network analysis in enterprise. Proceedings of the IEEE, 100(9), 2012.
  16. [Liu et al., 2011] Zhiyuan Liu, Yuzhou Zhang, Edward Y. Chang, and Maosong Sun. PLDA+: Parallel Latent Dirichlet Allocation with Data Placement and Pipeline Processing. ACM TIST, 2011. Software available at http://code.google.com/p/plda. Link
  17. [Murphy, 1998] Kevin Murphy. Hidden Markov Model (HMM) Toolbox for Matlab, 1998.
  18. [Parzen, 1962] Emanuel Parzen. On Estimation of a Proba- bility Density Function and Mode. The Annals of Mathe- matical Statistics, 33(3):1065-1076, 1962.
  19. [Patterson et al., 2002] Eric K. Patterson, Sabri Gurbuz, Zekeriya Tufekci, and John N. Gowdy. Cuave: A new audio-visual database for multimodal human-computer in- terface research. In ICASSP, 2002.
  20. [Pearl, 1982] Judea Pearl. Reverend bayes on inference en- gines: A distributed hierarchical approach. In AAAI, 1982.
  21. [Peng et al., 2009] Jian Peng, Liefeng Bo, and Jinbo Xu. Conditional neural fields. In NIPS, 2009.
  22. [Quattoni et al., 2007] Ariadna Quattoni, Sy Bor Wang, Louis-Philippe Morency, Michael Collins, and Trevor Dar- rell. Hidden conditional random fields. IEEE Trans. Pat- tern Anal. Mach. Intell., 29(10), 2007.
  23. [Rabiner, 1989] Lawrence R. Rabiner. A tutorial on hidden markov models and selected applications in speech recog- nition. In Proceedings of the IEEE, 1989.
  24. [Saenko and Livescu, 2006] Kate Saenko and Karen Livescu. An asynchronous dbn for audio-visual speech recognition. In SLT, 2006.
  25. [Schölkopf et al., 2001] Bernhard Schölkopf, John C. Platt, John Shawe-Taylor, Alex J. Smola, and Robert C. Williamson. Estimating the support of a high-dimensional distribution. Neural Computation, 13(7), 2001.
  26. [Song et al., 2011] Yale Song, David Demirdjian, and Ran- dall Davis. Tracking body and hands for gesture recog- nition: Natops aircraft handling signals database. In FG, 2011.
  27. [Sun et al., 2006] Pei Sun, Sanjay Chawla, and Bavani Arunasalam. Mining for outliers in sequential databases. In SDM, 2006.
  28. [Tan et al., 2011] Swee Chuan Tan, Kai Ming Ting, and Fei Tony Liu. Fast anomaly detection for streaming data. In IJCAI, 2011. IJCAI
  29. [Tax and Duin, 2004] David M. J. Tax and Robert P. W. Duin. Support vector data description. Machine Learn- ing, 54(1), 2004.
  30. [Teo et al., 2010] Choon Hui Teo, S. V. N. Vishwanathan, Alex J. Smola, and Quoc V. Le. Bundle methods for reg- ularized risk minimization. Journal of Machine Learning Research, 11, 2010.
  31. [Xu, 2010] Xin Xu. Sequential anomaly detection based on temporal-difference learning: Principles, models and case studies. Appl. Soft Comput., 10(3), 2010.
  32. [Yu and Joachims, 2009] Chun-Nam John Yu and Thorsten Joachims. Learning structural svms with latent variables. In ICML, page 147, 2009.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards