Proceedings

Layering Predictions: Flexible Use of Dialog Expectation in Speech Recognition

Download BibTeX Cite

Proceedings of the Eleventh International Joint Conference on Artificial Intelligence. Speech and Natural Language. Pages 1543-1548.

© 1989 International Joint Conferences on Artificial Intelligence

Abstract

When computer speech recognition is used for problem solving or any plan based task, predictable features of the user's behavior may be inferred and used to aid the recognition of the speech input. The MINDS system generates expectations of what will be said next and uses them to assist speech recognition. Since a user does not always conform to system expectations, MINDS handles violated expectations. We use pragmatic knowledge to dynamically derive constraints about what the user is likely to say next. Then we loosen the constraints in a principled manner to generate layered sets of predictions which range from very specific to very general. To enable the speech system to give priority to recognizing what a user is most likely to say, each prediction set dynamically generates a grammar which is used by the speech recognizer. A different set of grammars is created after each user utterance. The grammars are tried in order of most specific frrst, until an acceptable parse is found. This allows optimal performance when users behave predictably, and displays graceful degradation when they do not.

  1. Allen, J. F. and Perrault, C. R. "Analyzing Intention in Utterances". Artificial Intelligence 15,3 (1980), 143-178.
  2. Biermann, A., Rodman R., Ballard B., Betancourt, T., Bilbro, G., Deas, H., Fineman, L., Fink, P., Gilbert, K., Gregory, D. and Heidlage, F. Interactive natural language problem solving: A pragmatic approach. Conference on Applied Natural Language Processing, 1983, pp. 180-191.
  3. Borghesi, L. and Favareto, C. Flexible Parsing of Discretely Uttered Sentences. COLING-82, Association for Computational Linguistics, Prague, July, 1982, pp. 37-48.
  4. Carbonell, J. G. "POLITICS: Automated Ideological Reasoning.". Cognitive Science 2, 1 (1978), 27-51.
  5. Cohen, P.R. and Perrault, C. R. "Elements of a Plan- Based Theory of Speech Acts". Cognitive Science 3 (1979), 177-212.
  6. Ennan, L.D. and Lesser, V .R. The Hearsay-II Speech Understanding System: A Tutorial. In Lea, W.A., Ed., Trends in Speech Recognition, Prentice-Hall, Englewood Cliffs, NJ, 1980, pp. 340-360.
  7. Fikes, R. E. and Nilsson, N.J. "STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving". Artificial Intelligence 2 (1971), 189-208. IJCAI
  8. Fink, P. K. and Biennann, A. W. "The Correction of Ill-Fonned Input Using History-Based Expectation With Applications to Speech Understanding". Computational Linguistics 12 (1986), 13-36.
  9. Gatward, R.A., Johnson, S.R. and Conolly, J.H. A Natural Language Processing System Based on Functional Grammar. Speech Input/Output; Techniques and Applications, Institute for Electrical Engineers, 1986, pp. 125-128.
  10. Grosz, B. J. and Sidner, C. L. "Attention, Intentions and the Structure of Discourse". Computation Linguistics 12 (1986), 175-204.
  11. Hauptmann, A. G., Young, S. R. and Ward, W. H. Using Dialog Level Knowledge Sources to Improve Speech Recognition. Proceedings of the Seventh National Conference on Artificial Intelligence, 1988.
  12. Hayes, P J., Hauptmann, A.G., Carbonell, J.G. and Tomita, M. Parsing Spoken Language: a Semantic Caseframe Approach. Proceedings of COLING-86, Association for Computational Linguistics, Bonn, Gennany, August, 1986.
  13. Kimball, 0., Price, P., Roucos, S., Schwartz, R., Kubala, F., Chow, Y.-L., Haas, A., Krasner, M. and Makhoul, J. Recognition Perfonnance and Grammatical Constraints. Proceedings of the DARPA Speech Recognition Workshop, Science Applications International Corporation Report Number SAIC-86/1546, 1986, pp. 53 - 59.
  14. Lea, W.A. (Ed.). Trends in Speech Recognition.
  15. Lee, K. SPHINX: Large Vocabulary, Speaker- Independent Speech Recognition. Ph.D. Th., Carnegie- Mellon University, 1988.
  16. Levinson, S. E. and Shipley, K. L. "A Conversational- Mode Airline lnfonnation and Reservation System Using Speech Input and Output". The Bell Systems Technical Journal 59 (1980), 119-137.
  17. Levinson, S. E. and Rabiner, L. R. "A Task-Oriented Conversational Mode Speech Understanding System". Bibliotheca Phonetica 12 (1985), 149-196.
  18. Litman, D. J. and Allen, J. F. "A Plan Recognition Model for Subdialogues in Conversation". Cognitive Science 11 (1987), 163-200.
  19. Lowerre, B. and Reddy, R. The 1-~arpy Speech Understanding System. In Lea, W.A., Ed., Trends in Speech Recognition, Prentice-Hall, En6lewood Cliffs, NJ, 1980, pp. 340-360.
  20. Newell, A. and Simon, H. A.. Human Problem Solving. New Jersey: Prentice-Hall, 1972.
  21. Sacerdoti, E. D. "Planning in a llierarchy of Abstraction Spaces". Artificial Intelligence 5, 2 (1974), 115-135.
  22. Searle, J. R. Indirect Speech Acts. In Syntax and Semantics, Volume 3: Speech Acts, New York: Academic Press, 1975.
  23. Walker, D.E. SRI Research on S~eech Understanding. In Lea, W.A., Ed., Trends in Speech Rc?cognition, Prentice- Hall, Englewood Cliffs, NJ, 1980, pp. 294-315.
  24. Wilensky, R. Understanding Goal-Based Stories. Ph.D. Th., Yale University, Sept 1978.
  25. Wilensky, R.. Planning and Understanding. Addison Wesley, Reading, MA, 1983.
  26. Woods, W.A., Bates, M., Brown, G., Bruce, B., Cook, C., Klovstad, J., Makhoul, J., Nash-W.:bber, B., Schwartz, R., Wolf, J., and Zue, V. Speech UncLrstanding Systems- Final Technical Report. Tech. Rept. 3438, Bolt, Beranek, and Newman, Inc., Cambridge, MA, 1976.
  27. Young, S. R. and Ward, W. H. Towards Habitable Systems: Use of World Knowledge to Dynamically Constrain Speech Recognition. In The Second Symposium on Advanced Man Machine Interface Through Spoken Language,, 1988.
  28. Young, S. R., Hauptmann, A. G., Ward, W. H., Smith, E. T. and Werner, P. "High Level Knowledge Sources in Usable Speech Recognition Systems". Communications of the ACM 32,2 (1989),.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards