Proceedings

Conceptual Grouping in Word Co-Occurrence Networks

Download BibTeX Cite

Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence. Machine Learning. Pages 694-700.

© 1999 International Joint Conferences on Artificial Intelligence

Abstract

Information Retrieval queries often result in a large number of documents found to be relevant. These documents are usually sorted by relevance, not by an analysis of what the user meant. If the document collection contains many documents on one of those meanings, it is hard to find other documents. We present a technique called conceptual grouping that automatically distinguishes between different meanings of a user query, given a document collection . By analysing a word cooccurrence network of a text database, we are able to form groups of words related to the query, grouped by semantic coherence. These groups are used to reorganise the results according to what the user has meant by his query. Testing shows that this automated technique can improve precision, help users find what they need more easily and give them a semantic overview of the document collection.

  1. [Doyle, 1962] Lauren Doyle. Indexing and Abstracting by Association. In [Sparck Jones, 1997], pages 25-38.
  2. [Fisher, 1987] D.H. Fisher. Knowledge acquisisition via incremental conceptual clustering. Machine Learning, Vol. 2, pages 139-172, 1987.
  3. [Grefenstette, 1994] Gregory Grefenstette. Explorations in Automatic Thesaurus Discovery. Kluwer Academic Publishers, Boston, USA, 1994.
  4. [Maron and Kuhns, 1967] M.E. Maron and J.L. Kuhns. On Relevance, Probabilistic Indexing and Information Retrieval. In [Sparck Jones, 1997], pages 25-38.
  5. [Michalski, 1983] R. Michalski. A theory and method of inductive learning, in Machine Learning: An Artificial Intelligence Approach, Tioga Press, Palo Alto, Califor- nia, 1983.
  6. [Patel et al., 1997] Malti Patel, John Bullinaria, and Jo- seph Levy. Extracting Semantic Representations from Large Text Corpora. Paper given at NCPW '97, London.
  7. [Rousselot, 1998] N.T.F. Rousselot. Application of clustering in a system of query reformulation, presenta- tion of Saros. ERIC-LilA report, University of Stras- bourg, France, 1998.
  8. [Smadja and Mckeown, 1990] Frank Smadja and Kath- leen Mckeown. Automatically extracting and represent- ing collocations for language generation. ACL '90, 1990
  9. [Sparck Jones, 1997] Karen Sparck Jones (editor). Readings in Information Retrieval.
  10. Morgan Kaufmann, San Francisco, California, 1997.
  11. [Veling, 1997] Anne Veling, The Aqua Browser: Visu- alisation of large Information Spaces in Context. In Journal of AGSI, Volume 6, Issue 3, pages 136-142, No- vember 1997.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards