Proceedings

Generating Production Rules from Decision Trees

Download BibTeX Cite

Proceedings of the Tenth International Joint Conference on Artificial Intelligence. Knowledge Acquisition. Pages 304-306.

© 1987 International Joint Conferences on Artificial Intelligence

Abstract

Many inductive knowledge acquisition algorithms generate classifiers in the form of decision trees. This paper describes a technique for transforming such trees to small sets of production rules, a common formalism for expressing knowledge in expert systems. The method makes use of the training set of cases from which the decision tree was generated, first to generalize and assess the reliability of individual rules extracted from the tree, and subsequently to refine the collection of rules as a whole. The final set of production rules is usually both simpler than the decision tree from which it was obtained, and more accurate when classifying unseen cases. Transformation to production rules also provides a way of combining different decision trees for the same classification domain.

  1. Breiman, L., Friedman, J.H., Olshen, R.A. and Stone, C.J . (1984}, Classification and Regressio~ Trees, Belmont: Wadsworth.
  2. Bundy, A., Silver, B. and Plummer, D. (1985}, An analytical comparison of some rule-learning programs, Artificial Intelligence £1, pp 137-181.
  3. Finney, D.J., Latscha, R., Bennett, B.M. and Hsu, P . (1963}, Tables for Testing Significance in a 2 X 2 Contingency Table, Cambridge University Press.
  4. Hunt, E.B., Marin, J. and Stone, P.J. (1966), Experiments in Induction, New York: Academic Press.
  5. Kononenko, 1., Bratko, I. and Rollkar, E. (1984}, Experiments in automatic learning of medical diagnostic rules, Technical Report, Jozef Stefan Institute, Ljubljana, Yugoslavia.
  6. Michalski, R.S., Mozetil:, I., Hong, J . and Lavral:, N. (1986}, The multi-purpose incremental learning system AQ15 and its test- ing application to three medical domains, Proc. Fifth National Conference on Artificial Intelligence, Philadelphia.
  7. Quinlan, J.R. (1986}, Induction of decision trees, Machine Learn- ing 1, 1.
  8. Quinlan, J.R., Compton, P.J., Horn, K.A. and Lazarus, L. (1986}, Inductive knowledge acquisition: a case study, Proc. Second A us- tralian Conference on Applications of Expert Systems, Sydney.
  9. Quinlan, J .R. (1987), Simplifying decision trees, Int. Journal Man-Machine Studies, to appear.
  10. Snedecor, G.W. and Cochran, W.G. (1980}, Statistical Methods (7th edition), Iowa State University Press.
  11. Winston, P.H. (1984}, Artificial Intelligence (2nd edition), Addison- Wesley.
  12. Quinlan

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards