Proceedings

Domain-Specific Keyphrase Extraction

Download BibTeX Cite

Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence. Machine Learning. Pages 668-672.

© 1999 International Joint Conferences on Artificial Intelligence

Abstract

Keyphrases are an important means of document summarization, clustering, and topic search. Only a small minority of documents have author-assigned keyphrases, and manually assigning keyphrases to existing documents is very laborious. Therefore it is highly desirable to automate the keyphrase extraction process. This paper shows that a simple procedure for keyphrase extraction based on the naive Bayes learning scheme performs comparably to the state of the art. It goes on to explain how this procedure's performance can be boosted by automatically tailoring the extraction process to the particular document collection at hand. Results on a large collection of technical reports in computer science show that the quality of the extracted keyphrases improves significantly when domain-specific information is exploited.

  1. [Breiman, 1996] Leo Breiman. Bagging predictors. Ma- chine Learning, 24(2):123-140, 1996.
  2. [Domingos and Pazzani, 1997] P. Domingos and M. Pazzani. On the optimality of the simple bayesian classifier under zero-one loss. Ma- chine Learning, 29(2/3):103-130, 1997.
  3. [Dumais et al., 1998] S. T. Dumais, J. Platt, D. Hecker- man, and M. Sahami. Inductive learning algorithms and representations for text categorization. In Pro- ceedings of the 7th International Conference on Infor- mation and Knowledge Management, 1998.
  4. Fayyad and Irani, 1993)
  5. Usama M. Fayyad and Keki B. Irani. Multi-interval discretization of continuous- valued attributes for classification learning. In Pro- ceedings of the 13th International Joint Conference on Artifical Intelligence, pages 1022-1027.
  6. Morgan Kauf- mann, 1993.
  7. [Lovins, 1968] J.B. Lovins. Development of a stemming algorithm. Mechanical translation and computational linguistics, 11:22-31, 1968.
  8. [Quinlan, 1992] J.R. Quinlan. C4.5: Programs forMa- chine Learning.
  9. Morgan Kaufmann, Los Altos, CA, 1992.
  10. [Turney, 1999] P.D. Turney. Learning to extract keyphrases from text. Technical Report ERB-1057, National Research Council, Institute for Information Technology, 1999.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards