{"type":"ScholarlyArticle","title":"Quantitative Evaluation of Explanation-Based Learning as an Optimisation Tool for a Large-Scale Natural Language System","authors":[{"name":"Christer Samuelsson","slug":"christer-samuelsson","given":"Christer","family":"Samuelsson","affiliation":"Swedish Institute of Computer Science Box 1263 , S-164 28 KISTA Sweden"},{"name":"Manny Rayner","slug":"manny-rayner","given":"Manny","family":"Rayner","affiliation":"SRI International , 23 Millers Yard , Cambridge , CB2 1RQ , UK"}],"abstract":"This paper describes the application of explanationbased learning, a machine learning technique, to the SRI Core Language Engine, a large scale general purpose natural language analysis system. The idea is to bypass normal morphological, syntactic and (partly) semantic processing, for most input sentences, instead using a set of learned rules. Explanation-based learning is used to extract the learned rules automatically from sample sentences submitted by a user and thus tune the system for that particular user. By indexing the learned rules efficiently, it is possible to achieve dramatic speedups. Performance measurements were carried out using a training set of 1500 sentences and a separate test set of 100 sentences, all from the ATIS corpus. A set of 680 learned rules was derived from the training set. These rules covered 90 percent of the test sentences and reduced the total processing time to a third. An overall speed-up of 50 percent was accomplished using a set of only 250 learned rules.","doi":null,"url":"https://ijcai.org/proceedings/1991/89","pdf":"https://ijcai.org/proceedings/1991/0089.pdf","markdown":"https://ijcai.org/proceedings/1991/89.md","bibtex":"https://ijcai.org/proceedings/1991/bibtex/89","volume":{"slug":"1991","title":"Proceedings of the Twelfth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 1991","url":"https://ijcai.org/proceedings/1991/","year":1991,"location":"Sydney, New South Wales, Australia","dates":"24-30 August 1991","editors":"John Mylopoulos and Ray Reiter","isbn":"","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":"Learning Be Knowledge Acquisition","track":"Learning Be Knowledge Acquisition","number":89,"pages":{"first":609,"last":614},"keywords":[],"videos":[],"references":[{"position":1,"raw":"forthcoming] Alshawi, H. (ed.). The Core Language Engine, MIT Press, Cambridge, Mass., to appear 1991.","title":"The Core Language Engine","authors":null,"year":"1991","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"Alshawi et al., 89]","title":null,"authors":"Alshawi","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"Alshawi, H., Carter, D.M., van Eijck, J., Moore, R.C., Moran, D.B ., Pereira, F.N.C., Pulman, S.G and Smith, A.G. \"Research Program in Natural Language Processing: Final Report\", SRI Technical Report, 1989.","title":"Research Program in Natural Language Processing: Final Report","authors":"H Alshawi, D M Carter, J Van Eijck, R C Moore, D B Moran, F N C Pereira, S Pulman, A G Smith","year":"1989","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"Dejong & Mooney, 86]","title":null,"authors":"& Dejong, Mooney","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"DeJong, G. F. and Mooney, R. \"Explanation-Based Generalization: A Alternative View\", Machine Learning, 1(2) pp. 145-176, 1986.","title":"Explanation-Based Generalization: A Alternative View","authors":"G F Dejong, R Mooney","year":"1986","venue":"Machine Learning","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"van Harmelen & Bundy, 88] van Harmelen, F. and Bundy, A. \"Explanation-Based Generalization = Partial Evaluation (Research Note)\", Artificial Intelligence 36, pp. 401-412, 1988.","title":"Explanation-Based Generalization = Partial Evaluation (Research Note)","authors":"& Van Harmelen, Bundy, F Van Harmelen, A Bundy","year":"1988","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"Hirsh, 87","title":null,"authors":"Hirsh","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"Hirsh, H., \"Explanation-Based Generalization in a Logic-Programming Environment\", Proceedings of the Tenth International Joint Conference on Artificial Intelligence, pp. 221-227, Milano, 1987.","title":"Explanation-Based Generalization in a Logic-Programming Environment","authors":"H Hirsh","year":"1987","venue":"Proceedings of the Tenth International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/1987/45"},{"position":9,"raw":"Kedar-Cabelli & McCarty, 87]","title":null,"authors":"Kedar-Cabelli & Mccarty","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"Kedar-Cabelli, S. T., and McCarty, L. \"Explanation-Based Generalization as Resolution Theorem Proving\", Proceedings of the Fourth International Workshop on Machine Learning, Irving, CA, Morgan Kaufmann, 1987.","title":"Explanation-Based Generalization as Resolution Theorem Proving","authors":"S T Kedar-Cabelli, L Mccarty","year":"1987","venue":"Proceedings of the Fourth International Workshop on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"Minton, 88","title":null,"authors":"Minton","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"Minton, S., \"Quantitative Results Concerning the Utility of Explanation-Based Learning\", Proceedings of the Seventh AAAI, pp. 564-569, Saint Paul, Minnesota, 1988.","title":"Quantitative Results Concerning the Utility of Explanation-Based Learning","authors":"S Minton","year":"1988","venue":"Proceedings of the Seventh AAAI","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"Minton et al., 89]","title":null,"authors":"Minton","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"Minton, S., Carbonell, J.G., Knoblock, C.A., Kuokka, D.R ., Etzioni, 0 . & Gil , Y., \"Explanation-Based Learning: A Problem-Solving Perspective\", Artificial Intelligence, (40):11-62, 1989.","title":"Explanation-Based Learning: A Problem-Solving Perspective","authors":"S Minton, J G Carbonell, C A Knoblock, D R Kuokka, Etzioni, Y Gil","year":"1989","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"Mitchell et al., 86]","title":null,"authors":"Mitchell","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"Mitchell, T., Keller, R. and Kedar- Cabelli, S. \"Explanation-Based Generalization : A Unifying View\", Machine Learning, 1(1), pp. 47-80, 1986.","title":"Explanation-Based Generalization : A Unifying View","authors":"T Mitchell, R Keller, S Kedar-Cabelli","year":"1986","venue":"Machine Learning","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"Pereira & Shieber, 85]","title":null,"authors":"Shieber Pereira","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"Pereira, F.N.C. and Shieber, S. Prolog and Natural Language Understanding, CSLI Lecture Notes, University of Chicago Press, 1985.","title":"Prolog and Natural Language Understanding","authors":"F N C Pereira, S Shieber","year":"1985","venue":"CSLI Lecture Notes","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"Rayner, 88","title":null,"authors":"Rayner","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"Rayner, M. \"Applying Explanation-Based Generalization to Natural-Language Processing\", Proceedings of the International Conference on Fifth Generation Computer Systems, Tokyo, 1988.","title":"Applying Explanation-Based Generalization to Natural-Language Processing","authors":"M Rayner","year":"1988","venue":"Proceedings of the International Conference on Fifth Generation Computer Systems","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"Rayner & Samuelsson, 89]","title":null,"authors":"Samuelsson Rayner","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":22,"raw":"Rayner, M. and Samuelsson, C., \"Applying Explanation-Based Generalization to Natural-Language Processing (Part 2)\" , SICS Research Report R89015, 1989.","title":"Applying Explanation-Based Generalization to Natural-Language Processing (Part 2)","authors":"M Rayner, C Samuelsson","year":"1989","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"Rayner & Samuelsson, 90]","title":null,"authors":"Samuelsson Rayner","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":24,"raw":"Rayner, M. and Samuelsson, C., \"Using Explanation-Based Learning to Increase Performance in a Large-Scale NL Query System\", Proceedings of the Third DARPA Workshop on Speech and Natural Language, Morgan Kaufmann, 1990.","title":"Using Explanation-Based Learning to Increase Performance in a Large-Scale NL Query System","authors":"M Rayner, C Samuelsson","year":"1990","venue":"Proceedings of the Third DARPA Workshop on Speech and Natural Language","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"Winograd & Flores, 85] Understanding Computers and Cognitions, Winograd, T. and Flores, F., Norwood NJ : Ablex, 1985.","title":"Understanding Computers and Cognitions","authors":"& Winograd, Flores","year":"1985","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}