---
title: "Framing Image Description as a Ranking Task: Data, Models and Evaluation Metrics (Extended Abstract)"
authors:
  - "Micah Hodosh"
  - "Peter Young"
  - "Julia Hockenmaier"
doi: ""
url: "https://ijcai.org/proceedings/2015/593"
pdf: "https://ijcai.org/proceedings/2015/0593.pdf"
venue: "Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence"
year: 2015
pages: "4188-4191"
track: "Journal Track"
keywords:
---

# Framing Image Description as a Ranking Task: Data, Models and Evaluation Metrics (Extended Abstract)

Micah Hodosh, Peter Young, Julia Hockenmaier

*Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence*, pages 4188-4191.

## Abstract

In [Hodosh et al., 2013], we established a ranking based framework for sentence-based image description and retrieval. We introduce a new dataset of images paired with multiple descriptive captions that was specifically designed for these tasks. We also present strong KCCA-based baseline systems for description and search, and perform an in-depth study of evaluation metrics for these two tasks. Our results indicate that automatic evaluation metrics for our ranking-based tasks are more accurate and robust than those proposed for generation-based image description.