Alternatives for Classifier System Credit Assignment

Liepins, Gunar E.; Hilliard, Mike R.; Palmer, Mark R.; Rangarajan, Gita

Alternatives for Classifier System Credit Assignment

Gunar E. Liepins, Mike R. Hilliard, Mark R. Palmer, Gita Rangarajan

Download BibTeX Cite

Proceedings of the Eleventh International Joint Conference on Artificial Intelligence. Machine Learning. Pages 756-760.

Abstract

Classifier systems are production rule systems that automatically generate populations of rules cooperating to accomplish desired tasks. The genetic algorithm is the systems' discovery mechanism, and its effectiveness is dependent in part on the accurate estimation of the relative merit of each of the rules (classifiers) in the current population. Merit is estimated conventionally by use of the bucket brigade for credit assignment. This paper addresses the adequacy of the bucket brigade and provides a preliminary exploration of two variants in conjunction with enumerated rules and with discovery. In limited experiments, a variant that combines the bucket brigade, "classifier chunking," and "backwards averaging" has yielded improved performance on simple maze problems. Tentative similarities between this hybrid and Sutton's Adaptive Heuristic Critic (AHC) are suggested. Area B: Fundamental Problems, Methods, Approaches Subarea B2 : Knowledge Acquisition, Learning, Analogy

Gunar E. Liepins, Mike R. Hilliard, Mark R. Palmer, and Gita Rangarajan. 1989. Alternatives for Classifier System Credit Assignment. In Proceedings of the Eleventh International Joint Conference on Artificial Intelligence, IJCAI-89. IJCAI, 756–760. https://ijcai.org/proceedings/1989/121

@inproceedings{ijcai1989p121,
  title     = {Alternatives for Classifier System Credit Assignment},
  author    = {Liepins, Gunar E. and Hilliard, Mike R. and Palmer, Mark R. and Rangarajan, Gita},
  booktitle = {Proceedings of the Eleventh International Joint Conference on
               Artificial Intelligence, {IJCAI-89}},
  publisher = {International Joint Conferences on Artificial Intelligence},
  editor    = {N. S. Sridharan},
  pages     = {756--760},
  year      = {1989},
  month     = {8},
  note      = {Machine Learning},
  url       = {https://ijcai.org/proceedings/1989/121},
}

TY  - CPAPER
TI  - Alternatives for Classifier System Credit Assignment
AU  - Liepins, Gunar E.
AU  - Hilliard, Mike R.
AU  - Palmer, Mark R.
AU  - Rangarajan, Gita
T2  - Proceedings of the Eleventh International Joint Conference on Artificial Intelligence, IJCAI-89
PB  - International Joint Conferences on Artificial Intelligence
PY  - 1989
SP  - 756
EP  - 760
UR  - https://ijcai.org/proceedings/1989/121
ER  -