Proceedings

A Dual-layer CRFs Based Joint Decoding Method for Cascaded Segmentation and Labeling Tasks

Yanxin Shi, Mengqiu Wang

Download BibTeX Cite

Proceedings of the Twentieth International Joint Conference on Artificial Intelligence. Pages 1707-1711.

Abstract

Many problems in NLP require solving a cascade of subtasks. Traditional pipeline approaches yield to error propagation and prohibit joint training/decoding between subtasks. Existing solutions to this problem do not guarantee non-violation of hard-constraints imposed by subtasks and thus give rise to inconsistent results, especially in cases where segmentation task precedes labeling task. We present a method that performs joint decoding of separately trained Conditional Random Field (CRF) models, while guarding against violations of hard-constraints. Evaluated on Chinese word segmentation and part-of-speech (POS) tagging tasks, our proposed method achieved state-of-the-art performance on both the Penn Chinese Treebank and First SIGHAN Bakeoff datasets. On both segmentation and POS tagging tasks, the proposed method consistently improves over baseline methods that do not perform joint decoding.

Yanxin Shi, and Mengqiu Wang. 2007. A Dual-layer CRFs Based Joint Decoding Method for Cascaded Segmentation and Labeling Tasks. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, IJCAI-07. IJCAI, 1707–1711. https://ijcai.org/proceedings/2007/276
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards