Proceedings

A General MCMC Method for Bayesian Inference in Logic-Based Probabilistic Modeling

Download BibTeX Cite

Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence. Pages 1472-1476.

https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-248

© 2011 International Joint Conferences on Artificial Intelligence

Abstract

We propose a general MCMC method for Bayesian inference in logic-based probabilistic modeling. It covers a broad class of generative models including Bayesian networks and PCFGs. The idea is to generalize an MCMC method for PCFGs to the one for a Turing-complete probabilistic modeling language PRISM in the context of statistical abduction where parse trees are replaced with explanations. We describe how to estimate the marginal probability of data from MCMC samples and how to perform Bayesian Viterbi inference using an example of Naive Bayes model augmented with a hidden variable.

  1. [Angelopoulos and Cussens, 2008] N. Angelopoulos and J. Cussens. Bayesian learning of Bayesian networks with informative priors. Annals of Mathematics and Artificial Intelligence, 54(1-3):53-98, 2008.
  2. [Cussens, 2010] J. Cussens. Approximate Bayesian compu- tation for the parameters of Prism programs. In Pro- ceedings of the 20th International Conference on Induc- tive Logic Programming (ILP'10), pages -, 2010.
  3. [De Raedt and Kersting, 2008] L. De Raedt and K. Kersting. Probabilistic inductive logic programming. In L. De Raedt, P. Frasconi, K. Kersting, and S. Muggleton, edi- tors, Probabilistic Inductive Logic Programming -The- ory and Applications, Lecture Notes in Computer Sci- ence 4911, pages 1-27. Springer, 2008.
  4. [Getoor and Taskar, 2007] L. Getoor and B. Taskar, editors. Introduction to Statistical Relational Learning. MIT Press, Cambridge, MA, 2007.
  5. [Goodman et al., 2008] N.D. Goodman, V.K. Mansinghka, D. Roy, K. Bonawitz, and J.B. Tenenbaum. Church: a language for generative models. In Proceedings of the Twenty fourth Conference on Uncertainty in Artificial Intelligence (UAI'08), 2008.
  6. [Johnson et al., 2007] M. Johnson, T. Griffiths, and S. Gold- water. Bayesian inference for PCFGs via Markov chain monte carlo. In Proceedings of the North American Chapter of the Association for Computational Linguis- tics (NAACL'07), pages 139-146, 2007.
  7. [Lunn et al., 2000] D.J. Lunn, A. Thomas, N. Best, and D. Spiegelhalter. Winbugs -a Bayesian modelling framework: concepts, structure, and extensibility. Statistics and Computing, 10:325-337, 2000.
  8. [McCallum et al., 2009] A. McCallum, K. Schultz, and S. Singh. Factorie: Probabilistic programming via im- peratively defined factor graphs. In Advances in Neural Information Processing Systems 22, pages 1249-1257, 2009.
  9. [Milch and Russell, 2006] B. Milch and S. Russell. General- Purpose MCMC Inference over Relational Structures. In Proceedings of the 22nd Annual Conference on Un- certainty in Artificial Intelligence (UAI'06), pages 349- 358, 2006.
  10. [Milch et al., 2005] B. Milch, B. Marthi, S. Russell, D. Son- tag, D.L. Ong, and A. Kolobov. BLOG: Probabilistic models with unknown objects. In Proceedings of the 19th International Joint Conference on Artificial Intelli- gence (IJCAI'05), pages 1352-1359, 2005. IJCAI
  11. [Muggleton, 1996] S. Muggleton. Stochastic logic pro- grams. In L. De Raedt, editor, Advances in Inductive Logic Programming, pages 254-264. IOS Press, 1996.
  12. [Sato and Kameya, 1997] T. Sato and Y. Kameya. PRISM: a language for symbolic-statistical modeling. In Proceed- ings of the 15th International Joint Conference on Arti- ficial Intelligence (IJCAI'97), pages 1330-1335, 1997. IJCAI
  13. [Sato and Kameya, 2001] T. Sato and Y. Kameya. Parame- ter learning of logic programs for symbolic-statistical modeling. Journal of Artificial Intelligence Research, 15:391-454, 2001.
  14. [Stoye et al., 1998] J. Stoye, D. Evers, and F. Meyer. Rose: generating sequence families. Bioinformatics, 14(2):157-163, 1998.
  15. [Uratani et al., 1994] N. Uratani, T. Takezawa, H. Matsuo, and C. Morita. ATR integrated speech and language database. Technical Report TR-IT-0056, ATR Interpret- ing Telecommunications Research Laboratories, 1994. In Japanese.
  16. [Zhang et al., 2005] H. Zhang, L. Jiang, and J. Su. Hidden naive Bayes. In Twentieth National Conference on Arti- ficial Intelligence, pages 919-924. AAAI Press, 2005.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards