---
title: "Automatic Evaluation of Text Coherence: Models and Representations"
authors:
  - "Mirella Lapata"
  - "Regina Barzilay"
doi: ""
url: "https://ijcai.org/proceedings/2005/30"
pdf: "https://ijcai.org/proceedings/2005/0030.pdf"
venue: "Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence"
year: 2005
pages: "1085-1089"
track: ""
keywords:
---

# Automatic Evaluation of Text Coherence: Models and Representations

Mirella Lapata, Regina Barzilay

*Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence*, pages 1085-1089.

## Abstract

This paper investigates the automatic evaluation of text coherence for machine-generated texts. We introduce a fully-automatic, linguistically rich model of local coherence that correlates with human judgments. Our modeling approach relies on shallow text properties and is relatively inexpensive. We present experimental results that assess the predictive power of various discourse representations proposed in the linguistic literature. Our results demonstrate that certain models capture complementary aspects of coherence and thus can be combined to improve performance.