{"type":"ScholarlyArticle","title":"Solving Analogies on Words based on Minimal Complexity Transformation","authors":[{"name":"Pierre-Alexandre Murena","slug":"pierre-alexandre-murena","given":"Pierre-Alexandre","family":"Murena","affiliation":"Helsinki Institute for Information Technology HIIT , Department of Computer Science , Aalto University , Espoo , Finland; LTCI , Télécom Paris , Institut Polytechnique de Paris , Palaiseau , France"},{"name":"Marie Al-Ghossein","slug":"marie-al-ghossein","given":"Marie","family":"Al-Ghossein","affiliation":"LTCI , Télécom Paris , Institut Polytechnique de Paris , Palaiseau , France"},{"name":"Jean-Louis Dessalles","slug":"jean-louis-dessalles","given":"Jean-Louis","family":"Dessalles","affiliation":"LTCI , Télécom Paris , Institut Polytechnique de Paris , Palaiseau , France"},{"name":"Antoine Cornuéjols","slug":"antoine-cornuejols","given":"Antoine","family":"Cornuéjols","affiliation":"UMR MIA-518 , AgroParisTech -INRA , Paris , France"}],"abstract":"Analogies are 4-ary relations of the form \"A is to B as C is to D\". When A, B and C are fixed, we call analogical equation the problem of finding the correct D. A direct applicative domain is Natural Language Processing, in which it has been shown successful on word inflections, such as conjugation or declension. If most approaches rely on the axioms of proportional analogy to solve these equations, these axioms are known to have limitations, in particular in the nature of the considered flections. In this paper, we propose an alternative approach, based on the assumption that optimal word inflections are transformations of minimal complexity. We propose a rough estimation of complexity for word analogies and an algorithm to find the optimal transformations. We illustrate our method on a large-scale benchmark dataset and compare with state-of-the-art approaches to demonstrate the interest of using complexity to solve analogies on words.","doi":"10.24963/ijcai.2020/256","url":"https://ijcai.org/proceedings/2020/256","pdf":"https://ijcai.org/proceedings/2020/0256.pdf","markdown":"https://ijcai.org/proceedings/2020/256.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/256","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Knowledge Representation and Reasoning","track":"Main track","number":256,"pages":{"first":1848,"last":1854},"keywords":["Knowledge Representation and Reasoning: Case-based Reasoning","Natural Language Processing: Phonology, Morphology, and word segmentation","Natural Language Processing: Natural Language Processing"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/25183/file_25183.m3u8","length_sec":293,"provider":"hls"}],"references":[{"position":1,"raw":"[Bayoudh et al., 2010] Meriam Bayoudh, Henri Prade, and Gilles Richard. A kolmogorov complexity view of anal- ogy: From logical modeling to experimentations. In SGAI Conf. Springer, 2010.","title":"A kolmogorov complexity view of analogy: From logical modeling to experimentations","authors":"Bayoudh","year":"2010","venue":"SGAI Conf","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Chater, 1999] Nick Chater. The search for simplicity: A fundamental cognitive principle? The Quarterly Journal of Experimental Psychology: Section A, 52(2), 1999.","title":"The search for simplicity: A fundamental cognitive principle?","authors":"Nick Chater","year":"1999","venue":"The Quarterly Journal of Experimental Psychology: Section A","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Cornuéjols and Ales-Bianchetti, 1998] Antoine Cornuéjols and Jacques Ales-Bianchetti. Analogy and Induction : which (missing) link? In Workshop \"Advances in Analogy Research : Integration of Theory and Data from Cognitive, Computational and Neural Sciences\", 1998.","title":"Analogy and Induction : which (missing) link? In Workshop","authors":"Ales-Bianchetti ; Jacques Ales-Bianchetti Cornuéjols","year":"1998","venue":"Advances in Analogy Research : Integration of Theory and Data from Cognitive, Computational and Neural Sciences","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Cotterell et al., 2018] Ryan Cotterell, Christo Kirov, John Sylak-Glassman, Géraldine Walther, Ekaterina Vylomova, Arya D McCarthy, Katharina Kann, Sebastian Mielke, Garrett Nicolai, Miikka Silfverberg, et al. The conll- sigmorphon 2018 shared task: Universal morphological reinflection. In CoNLL Shared Task, 2018.","title":"The conllsigmorphon 2018 shared task: Universal morphological reinflection","authors":"Ryan Cotterell, Christo Kirov, John Sylak-Glassman, Géraldine Walther, Ekaterina Vylomova, D Arya, Katharina Mccarthy, Sebastian Kann, Garrett Mielke, Miikka Nicolai, Silfverberg","year":"2018","venue":"CoNLL Shared Task","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[de Saussure et al., 1916] F. de Saussure, C. Bally, A. Sechehaye, and A. Riedlinger. Cours de linguis- tique générale. Payot, 1916.","title":"Cours de linguistique générale","authors":"F De Saussure, C Bally, A Sechehaye, A Riedlinger","year":"1916","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Dedina and Nusbaum, 1991] Michael J Dedina and Howard C Nusbaum. Pronounce: a program for pro- nunciation by analogy. Computer speech & language, 5(1):55-64, 1991.","title":"Pronounce: a program for pronunciation by analogy","authors":"Nusbaum ; Dedina, J Michael, Howard C Dedina, Nusbaum","year":"1991","venue":"Computer speech & language","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Drozd et al., 2016] Aleksandr Drozd, Anna Gladkova, and Satoshi Matsuoka. Word embeddings, analogies, and ma- chine learning: Beyond king-man+ woman= queen. In COLING, 2016.","title":"Word embeddings, analogies, and machine learning: Beyond king-man+ woman= queen","authors":"Aleksandr Drozd, Anna Gladkova, Satoshi Matsuoka","year":"2016","venue":"COLING","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Fam and Lepage, 2018] Rashel Fam and Yves Lepage. Tools for the production of analogical grids and a resource of n-gram analogical grids in 11 languages. In LREC, 2018.","title":"Rashel Fam and Yves Lepage. Tools for the production of analogical grids and a resource of n-gram analogical grids in 11 languages","authors":"Lepage Fam","year":"2018","venue":"LREC","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Gentner and Forbus, 2011] Dedre Gentner and Kenneth D Forbus. Computational models of analogy. Wiley inter- disciplinary reviews: cognitive science, 2(3), 2011.","title":"Computational models of analogy","authors":"Forbus Gentner, Dedre Gentner, Kenneth D Forbus","year":"2011","venue":"Wiley interdisciplinary reviews: cognitive science","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Grave et al., 2018] Edouard Grave, Piotr Bojanowski, Prakhar Gupta, Armand Joulin, and Tomas Mikolov. Learning word vectors for 157 languages. In LREC, 2018.","title":"Learning word vectors for 157 languages","authors":"Edouard Grave, Piotr Bojanowski, Prakhar Gupta, Armand Joulin, Tomas Mikolov","year":"2018","venue":"LREC","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Hofstadter and Mitchell, 1995] Douglas Hofstadter and Melanie Mitchell. Fluid concepts and creative analogies. chapter The Copycat Project: A Model of Mental Fluidity and Analogy-making. 1995.","title":"Fluid concepts and creative analogies. chapter The Copycat Project: A Model of Mental Fluidity and Analogy-making","authors":"Mitchell ; Hofstadter, Douglas Hofstadter, Melanie Mitchell","year":"1995","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Hofstadter, 1984] Douglas Hofstadter. The Copycat Project: An Experiment in Nondeterminism and Creative Analo- gies. AI Memo 755, Artificial Intelligence Laboratory, Massachusetts Institute of Technology, 1984.","title":"The Copycat Project: An Experiment in Nondeterminism and Creative Analogies","authors":"Douglas Hofstadter","year":"1984","venue":"AI Memo","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Kirby and Hurford, 2002] Simon Kirby and James R Hur- ford. The emergence of linguistic structure: An overview of the iterated learning model. In Simulating the evolution of language. Springer, 2002.","title":"The emergence of linguistic structure: An overview of the iterated learning model","authors":"Simon Kirby, James R Hurford","year":"2002","venue":"Simulating the evolution of language","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Langlais et al., 2009] Philippe Langlais, Franc ¸ois Yvon, and Pierre Zweigenbaum. Improvements in analogical learning: application to translating multi-terms of the med- ical domain. In EACL, 2009.","title":"Improvements in analogical learning: application to translating multi-terms of the medical domain","authors":"Philippe Langlais, Franc ¸ois Yvon, Pierre Zweigenbaum","year":"2009","venue":"EACL","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Langlais, 2013] Phillippe Langlais. Mapping source to tar- get strings without alignment by analogical learning: A case study with transliteration. In ACL, volume 2, 2013.","title":"Mapping source to target strings without alignment by analogical learning: A case study with transliteration","authors":"Phillippe Langlais","year":"2013","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Lepage and Denoual, 2005] Yves Lepage and Etienne De- noual. Purest ever example-based machine translation: Detailed presentation and assessment. Machine Transla- tion, 19(3-4), 2005.","title":"Purest ever example-based machine translation: Detailed presentation and assessment","authors":"Denoual Lepage, Yves Lepage, Etienne Denoual","year":"2005","venue":"Machine Translation","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Lepage and Lieber, 2018] Yves Lepage and Jean Lieber. Case-based translation: First steps from a knowledge-light approach based on analogy to a knowledge-intensive one. In ICCBR. Springer, 2018.","title":"Case-based translation: First steps from a knowledge-light approach based on analogy to a knowledge-intensive one","authors":"Lieber Lepage, Yves Lepage, Jean Lieber","year":"2018","venue":"ICCBR","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Lepage and Shin-Ichi, 1996] Yves Lepage and Ando Shin- Ichi. Saussurian analogy: a theoretical account and its ap- plication. In COLING, 1996.","title":"Saussurian analogy: a theoretical account and its application","authors":"Shin-Ichi ; Lepage, Yves Lepage, Ando Shin-Ichi","year":"1996","venue":"COLING","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Lepage, 1998] Yves Lepage. Solving analogies on words: an algorithm. In COLING-ACL, volume I, 1998.","title":"Solving analogies on words: an algorithm","authors":"Yves Lepage, Lepage","year":"1998","venue":"COLING-ACL","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Lepage, 2004] Yves Lepage. Analogy and formal lan- guages. Electronic notes in theoretical computer science, 53, 2004.","title":"Analogy and formal languages","authors":"Yves Lepage, Lepage","year":"2004","venue":"Electronic notes in theoretical computer science","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Lepage, 2017] Yves Lepage. Character-position arithmetic for analogy questions between word forms. In ICCBR (Workshops), 2017.","title":"Character-position arithmetic for analogy questions between word forms","authors":"Yves Lepage, Lepage","year":"2017","venue":"ICCBR (Workshops)","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Li and Vitányi, 2013] Ming Li and Paul Vitányi. An intro- duction to Kolmogorov complexity and its applications. Springer Science & Business Media, 2013.","title":"An introduction to Kolmogorov complexity and its applications","authors":"Ming Li, Paul Vitányi","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Marchand and Damper, 2000] Yannick Marchand and Robert I Damper. A multistrategy approach to improving pronunciation by analogy. Computational Linguistics, 26(2), 2000.","title":"A multistrategy approach to improving pronunciation by analogy","authors":"Yannick Marchand, Robert I Damper","year":"2000","venue":"Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Miclet et al., 2008] Laurent Miclet, Sabri Bayoudh, and Ar- naud Delhay. Analogical dissimilarity: definition, algo- rithms and two experiments in machine learning. J. Artif. Intell. Res., 32, 2008.","title":"Analogical dissimilarity: definition, algorithms and two experiments in machine learning","authors":"Laurent Miclet, Sabri Bayoudh, Arnaud Delhay","year":"2008","venue":"J. Artif. Intell. Res","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Mikolov et al., 2013] Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. Distributed rep- resentations of words and phrases and their composition- ality. In NIPS, 2013.","title":"Distributed representations of words and phrases and their compositionality","authors":"Mikolov","year":"2013","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Murena et al., 2017] Pierre-Alexandre Murena, Jean-Louis Dessalles, and Antoine Cornuéjols. A complexity based approach for solving hofstadter's analogies. In ICCBR (Workshops), 2017.","title":"A complexity based approach for solving hofstadter's analogies","authors":"Murena","year":"2017","venue":"ICCBR (Workshops","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Prade and Richard, 2014] Henri Prade and Gilles Richard. Computational Approaches to Analogical Reasoning: Current Trends, volume 548. Springer, 2014.","title":"Computational Approaches to Analogical Reasoning: Current Trends","authors":"Richard ; Prade, Henri Prade, Gilles Richard","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Rogers et al., 2017] Anna Rogers, Aleksandr Drozd, and Bofang Li. The (too many) problems of analogical rea- soning with word vectors. In *SEM, 2017.","title":"The (too many) problems of analogical reasoning with word vectors","authors":"Anna Rogers, Aleksandr Drozd, Bofang Li","year":"2017","venue":"SEM","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Rumelhart and Abrahamson, 1973] David E Rumelhart and Adele A Abrahamson. A model for analogical reasoning. Cognitive Psychology, 5(1), 1973.","title":"A model for analogical reasoning","authors":"E David, Adele A Rumelhart, Abrahamson","year":"1973","venue":"Cognitive Psychology","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Yvon, 2003] Franc ¸ois Yvon. Finite-state transducers solv- ing analogies on words. Rapport GET/ENST&LTCI, 2003.","title":"Franc ¸ois Yvon. Finite-state transducers solving analogies on words","authors":"Yvon","year":"2003","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}