{"type":"ScholarlyArticle","title":"Pseudo-Aligned Multilingual Corpora","authors":[{"name":"Fernando Diaz","slug":"fernando-diaz","given":"Fernando","family":"Diaz","affiliation":""},{"name":"Donald Metzler","slug":"donald-metzler","given":"Donald","family":"Metzler","affiliation":""}],"abstract":"In machine translation, document alignment refers to finding correspondences between documents which are exact translations of each other. We define pseudo-alignment as the task of finding topical-as opposed to exact-correspondences between documents in different languages. We apply semisupervised methods to pseudo-align multilingual corpora. Specifically, we construct a topic-based graph for each language. Then, given exact correspondences between a subset of documents, we project the unaligned documents into a shared lower-dimensional space. We demonstrate that close documents in this lower-dimensional space tend to share the same topic. This has applications in machine translation and cross-lingual information analysis. Experimental results show that pseudo-alignment of multilingual corpora is feasible and that the document alignments produced are qualitatively sound. Our technique requires no linguistic knowledge of the corpus. On average when 10% of the corpus consists of exact correspondences, an on-topic correspondence occurs within the top 5 foreign neighbors in the lower-dimensional space while the exact correspondence occurs within the top 10 foreign neighbors in this this space. We also show how to substantially improve these results with a novel method for incorporating language-independent information.","doi":null,"url":"https://ijcai.org/proceedings/2007/438","pdf":"https://ijcai.org/proceedings/2007/0438.pdf","markdown":"https://ijcai.org/proceedings/2007/438.md","bibtex":"https://ijcai.org/proceedings/2007/bibtex/438","volume":{"slug":"2007","title":"Proceedings of the Twentieth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2007","url":"https://ijcai.org/proceedings/2007/","year":2007,"location":"Hyderabad, India","dates":"","editors":"Ramon López de Mántaras","isbn":"","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":438,"pages":{"first":2727,"last":2731},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}