{"type":"ScholarlyArticle","title":"Framing Image Description as a Ranking Task: Data, Models and Evaluation Metrics (Extended Abstract)","authors":[{"name":"Micah Hodosh","slug":"micah-hodosh","given":"Micah","family":"Hodosh","affiliation":""},{"name":"Peter Young","slug":"peter-young","given":"Peter","family":"Young","affiliation":""},{"name":"Julia Hockenmaier","slug":"julia-hockenmaier","given":"Julia","family":"Hockenmaier","affiliation":""}],"abstract":"In [Hodosh et al., 2013], we established a ranking based framework for sentence-based image description and retrieval. We introduce a new dataset of images paired with multiple descriptive captions that was specifically designed for these tasks. We also present strong KCCA-based baseline systems for description and search, and perform an in-depth study of evaluation metrics for these two tasks. Our results indicate that automatic evaluation metrics for our ranking-based tasks are more accurate and robust than those proposed for generation-based image description.","doi":null,"url":"https://ijcai.org/proceedings/2015/593","pdf":"https://ijcai.org/proceedings/2015/0593.pdf","markdown":"https://ijcai.org/proceedings/2015/593.md","bibtex":"https://ijcai.org/proceedings/2015/bibtex/593","volume":{"slug":"2015","title":"Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2015","url":"https://ijcai.org/proceedings/2015/","year":2015,"location":"Buenos Aires, Argentina","dates":"25–31 July 2015","editors":"Qiang Yang and Michael Wooldridge","isbn":"978-1-57735-738-4","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":"Journal Track","track":"Journal Track","number":593,"pages":{"first":4188,"last":4191},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}