Proceedings

Recurrent Neural Networks for Sequence Production

Download BibTeX Cite

Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence. Machine Learning. Pages 1114-1118.

© 1993 International Joint Conferences on Artificial Intelligence

Abstract

In an empirical study, simple recurrent networks (SRN s, Elman, 1990) and recurrent cascade correlation networks (RCC, Fahlman, 1991) are compared with respect to a sequence production task. The application system that includes these networks extracts relevant information from incoming e-mail messages during a training period, learns the reaction to the incoming message, i.e., a sequence of user actions, and uses the learned representation for the proposal and preparation of user reactions. The performance of both network architectures in terms of network size and learning speed for a given data set is examined. Our results show that (1) RCC generates smaller networks with better performance compared to SRNs and (2) learns significantly faster than SRNs.

  1. Diederich, J.; Thuemmel, A.; Bartels, E.: Recurrent and Feedforward Networks for Human-Computer Interaction. In: Neumann, B. (Ed.): ECAI-92, lOth European Conference on Artificial Intelligence. Chichester: John Wiley & Sons 1992, 206-207
  2. Elman, J .L.: Finding Structure in Time. Cognitive Science 14 (1990) 179-211
  3. Fahlman, S.E.: The Recurrent Cascade-Correlation Architecture. Pittsburgh, Penn.: Carnegie-Mellon University (CMU), May 1991 = CMU-CS-91-110
  4. Jordan, M.L. : Attractor dynamics and parallelism in a connectionist sequential machine. Proc. of the 8th conference of the Cognitive Science Society 1986.
  5. Hillsdale, N.J: LEA 1986. Reprinted in: Diederich, J. (Ed.): Artificial Neural Networks: Concept Learn- ing. IEEE Computer Society Neural Network Tech- nology Series, 112-127, Los Alamitos, Ca. 1990
  6. Yang, J. & Honavar, V.: Experiments with the Cascade-Correlation Algorithm. Dep. of Computer Sciencs, Iowa State University, lA, USA., 1991 = Tech. Report #91-16

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards