Proceedings

When Discriminative Learning of Bayesian Network Parameters Is Easy

Hannes Wettig, Peter Grünwald, Teemu Roos, Petri Myllymäki, Henry Tirri

Download BibTeX Cite

Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence. Pages 491-497.

Abstract

Bayesian network models are widely used for discriminative prediction tasks such as classification. Usually their parameters are determined using 'unsupervised' methods such as maximization of the joint likelihood. The reason is often that it is unclear how to find the parameters maximizing the conditional (supervised) likelihood. We show how the discriminative learning problem can be solved efficiently for a large class of Bayesian network models, including the Naive Bayes (NB) and treeaugmented Naive Bayes (TAN) models. We do this by showing that under a certain general condition on the network structure, the discriminative learning problem is exactly equivalent to logistic regression with unconstrained convex parameter spaces. Hitherto this was known only for Naive Bayes models. Since logistic regression models have a concave log-likelihood surface, the global maximum can be easily found by local optimization methods.

Hannes Wettig, Peter Grünwald, Teemu Roos, Petri Myllymäki, and Henry Tirri. 2003. When Discriminative Learning of Bayesian Network Parameters Is Easy. In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence, IJCAI-03. IJCAI, 491–497. https://ijcai.org/proceedings/2003/73
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards