{"type":"ScholarlyArticle","title":"Hierarchical Matching Network for Heterogeneous Entity Resolution","authors":[{"name":"Cheng Fu","slug":"cheng-fu","given":"Cheng","family":"Fu","affiliation":"Chinese Information Processing Laboratory , Institute of Software , Chinese Academy of Sciences; University of Chinese Academy of Sciences"},{"name":"Xianpei Han","slug":"xianpei-han","given":"Xianpei","family":"Han","affiliation":"Chinese Information Processing Laboratory , Institute of Software , Chinese Academy of Sciences; State Key Laboratory of Computer Science , Institute of Software , Chinese Academy of Sciences"},{"name":"Jiaming He","slug":"jiaming-he","given":"Jiaming","family":"He","affiliation":"Brandeis University"},{"name":"Le Sun","slug":"le-sun","given":"Le","family":"Sun","affiliation":"Chinese Information Processing Laboratory , Institute of Software , Chinese Academy of Sciences; State Key Laboratory of Computer Science , Institute of Software , Chinese Academy of Sciences"}],"abstract":"Entity resolution (ER) aims to identify data records referring to the same real-world entity. Most existing ER approaches rely on the assumption that the entity records to be resolved are homogeneous, i.e., their attributes are aligned. Unfortunately, entities in real-world datasets are often heterogeneous, usually coming from different sources and being represented using different attributes. Furthermore, the entities’ attribute values may be redundant, noisy, missing, misplaced, or misspelled—we refer to it as the dirty data problem. To resolve the above problems, this paper proposes an end-to-end hierarchical matching network (HierMatcher) for entity resolution, which can jointly match entities in three levels—token, attribute, and entity. At the token level, a cross-attribute token alignment and comparison layer is designed to adaptively compare heterogeneous entities. At the attribute level, an attribute-aware attention mechanism is proposed to denoise dirty attribute values. Finally, the entity level matching layer effectively aggregates all matching evidence for the final ER decisions. Experimental results show that our method significantly outperforms previous ER methods on homogeneous, heterogeneous and dirty datasets.","doi":"10.24963/ijcai.2020/507","url":"https://ijcai.org/proceedings/2020/507","pdf":"https://ijcai.org/proceedings/2020/0507.pdf","markdown":"https://ijcai.org/proceedings/2020/507.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/507","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Natural Language Processing","track":"Main track","number":507,"pages":{"first":3665,"last":3671},"keywords":["Data Mining: Classification, Semi-Supervised Learning","Natural Language Processing: Coreference Resolution","Natural Language Processing: Information Extraction"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/25365/file_25365.m3u8","length_sec":289,"provider":"hls"}],"references":[{"position":1,"raw":"[Ailon et al., 2008] Nir Ailon, Moses Charikar, and Alantha Newman. Aggregating inconsistent information: ranking and clustering. Journal of the ACM, 55(5):23, 2008.","title":"Aggregating inconsistent information: ranking and clustering","authors":"Ailon","year":"2008","venue":"Journal of the ACM","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Benjelloun et al., 2009] Omar Benjelloun, Hector Garcia- Molina, David Menestrina, Qi Su, Steven Euijong Whang, and Jennifer Widom. Swoosh: a generic approach to entity resolution. The VLDB Journal, 18(1):255-276, 2009.","title":"Swoosh: a generic approach to entity resolution","authors":"Omar Benjelloun, Hector Garcia-Molina, David Menestrina, Qi Su, Steven Euijong Whang, Jennifer Widom","year":"2009","venue":"The VLDB Journal","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bhattacharya and Getoor, 2007] Indrajit Bhattacharya and Lise Getoor. Collective entity resolution in relational data. Journal of the TKDD, 1(1):5, 2007.","title":"Collective entity resolution in relational data","authors":"Getoor Bhattacharya, Indrajit Bhattacharya, Lise Getoor","year":"2007","venue":"Journal of the TKDD","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bilenko and Mooney, 2003] Mikhail Bilenko and Ray- mond J Mooney. Adaptive duplicate detection using learn- able string similarity measures. In Proceedings of the ACM SIGKDD, pages 39-48. ACM, 2003.","title":"Mikhail Bilenko and Raymond J Mooney. Adaptive duplicate detection using learnable string similarity measures","authors":"Mooney Bilenko","year":"2003","venue":"Proceedings of the ACM SIGKDD","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Bilke and Naumann, 2005] Alexander Bilke and Felix Nau- mann. Schema matching using duplicates. In Proceedings of the ICDE, pages 69-80. IEEE, 2005.","title":"Schema matching using duplicates","authors":"Alexander Bilke, Felix Naumann","year":"2005","venue":"Proceedings of the ICDE","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Bojanowski et al., 2017] Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. Enriching word vec- tors with subword information. TACL, 5:135-146, 2017.","title":"Enriching word vectors with subword information","authors":"Piotr Bojanowski, Edouard Grave, Armand Joulin, Tomas Mikolov","year":"2017","venue":"TACL","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Chaudhuri et al., 2007] Surajit Chaudhuri, Bee-Chung Chen, Venkatesh Ganti, and Raghav Kaushik. Example- driven design of efficient record matching queries. In PVLDB, pages 327-338. VLDB Endowment, 2007.","title":"Exampledriven design of efficient record matching queries","authors":"Surajit Chaudhuri, Bee-Chung Chen, Venkatesh Ganti, Raghav Kaushik","year":"2007","venue":"PVLDB","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Cho et al., 2014] Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. Learning phrase representations using rnn encoder-decoder for statistical machine translation. In Proceedings of EMNLP, pages 1724-1734, 2014.","title":"Learning phrase representations using rnn encoder-decoder for statistical machine translation","authors":"Cho","year":"2014","venue":"Proceedings of EMNLP","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Christen, 2011] Peter Christen. A survey of indexing tech- niques for scalable record linkage and deduplication. Jour- nal of the TKDE, 24(9):1537-1555, 2011.","title":"A survey of indexing techniques for scalable record linkage and deduplication","authors":"Christen Peter","year":"2011","venue":"Journal of the TKDE","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Doan and Halevy, 2005] AnHai Doan and Alon Y Halevy. Semantic integration research in the database community: A brief survey. AI magazine, 26(1):83-83, 2005.","title":"Semantic integration research in the database community: A brief survey","authors":"Halevy ; ] Anhai Doan, Alon Y Doan, Halevy","year":"2005","venue":"AI magazine","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Ebraheem et al., 2018] Muhammad Ebraheem, Saravanan Thirumuruganathan, Shafiq Joty, Mourad Ouzzani, and Nan Tang. Distributed representations of tuples for entity resolution. PVLDB, 11(11):1454-1467, 2018.","title":"Distributed representations of tuples for entity resolution","authors":"Ebraheem","year":"2018","venue":"PVLDB","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Fellegi and Sunter, 1969] Ivan P Fellegi and Alan B Sunter. A theory for record linkage. Journal of the American Sta- tistical Association, 64(328):1183-1210, 1969.","title":"A theory for record linkage","authors":"P Ivan, Alan B Fellegi, Sunter","year":"1969","venue":"Journal of the American Statistical Association","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Fu et al., 2019] Cheng Fu, Xianpei Han, Le Sun, Bo Chen, Wei Zhang, Suhui Wu, and Hao Kong. End-to-end multi- perspective matching for entity resolution. In Proceedings of the IJCAI, pages 4961-4967. AAAI Press, 2019.","title":"End-to-end multiperspective matching for entity resolution","authors":"Cheng Fu, Xianpei Han, Le Sun, Bo Chen, Wei Zhang, Suhui Wu, Hao Kong","year":"2019","venue":"Proceedings of the IJCAI","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Hernández and Stolfo, 1995] Mauricio A Hernández and Salvatore J Stolfo. The merge/purge problem for large databases. In ACM Sigmod Record, volume 24, pages 127- 138. ACM, 1995.","title":"The merge/purge problem for large databases","authors":"Mauricio A Hernández, Salvatore J Stolfo","year":"1995","venue":"ACM Sigmod Record","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Kenig and Gal, 2013] Batya Kenig and Avigdor Gal. Mfi- blocks: An effective blocking algorithm for entity resolu- tion. Information Systems, 38(6):908-926, 2013.","title":"Mfiblocks: An effective blocking algorithm for entity resolution","authors":"Gal Kenig, Batya Kenig, Avigdor Gal","year":"2013","venue":"Information Systems","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Konda et al., 2016] Pradap Konda, Sanjib Das, Paul Sugan- than GC, AnHai Doan, Adel Ardalan, Jeffrey R Ballard, Han Li, Fatemah Panahi, Haojun Zhang, Jeff Naughton, et al. Magellan: Toward building entity matching manage- ment systems. PVLDB, 9(12):1197-1208, 2016.","title":"Magellan: Toward building entity matching management systems","authors":"Konda","year":"2016","venue":"PVLDB","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Kong et al., 2016] Chao Kong, Ming Gao, Chen Xu, Wein- ing Qian, and Aoying Zhou. Entity matching across mul- tiple heterogeneous data sources. In Proceedings of the DASFAA, pages 133-146. Springer, 2016.","title":"Entity matching across multiple heterogeneous data sources","authors":"Chao Kong, Ming Gao, Chen Xu, Weining Qian, Aoying Zhou","year":"2016","venue":"Proceedings of the DASFAA","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Koudas et al., 2006] Nick Koudas, Sunita Sarawagi, and Divesh Srivastava. Record linkage: similarity measures and algorithms. In Proceedings of the ACM SIGMOD, pages 802-803. ACM, 2006.","title":"Record linkage: similarity measures and algorithms","authors":"Nick Koudas, Sunita Sarawagi, Divesh Srivastava","year":"2006","venue":"Proceedings of the ACM SIGMOD","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Lin et al., 2019] Yiming Lin, Hongzhi Wang, Jianzhong Li, and Hong Gao. Efficient entity resolution on heteroge- neous records. Journal of the TKDE, 2019.","title":"Efficient entity resolution on heterogeneous records","authors":"Yiming Lin, Hongzhi Wang, Jianzhong Li, Hong Gao","year":"2019","venue":"Journal of the TKDE","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Mudgal et al., 2018] Sidharth Mudgal, Han Li, Theodoros Rekatsinas, AnHai Doan, Youngchoon Park, Ganesh Krishnan, Rohit Deep, Esteban Arcaute, and Vijay Raghavendra. Deep learning for entity matching: A de- sign space exploration. In Proceedings of the ICDM, pages 19-34. ACM, 2018.","title":"Deep learning for entity matching: A design space exploration","authors":"Sidharth Mudgal, Han Li, Theodoros Rekatsinas, Anhai Doan, Youngchoon Park, Ganesh Krishnan, Rohit Deep, Esteban Arcaute, Vijay Raghavendra","year":"2018","venue":"Proceedings of the ICDM","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Newcombe et al., 1959] Howard B Newcombe, James M Kennedy, SJ Axford, and Allison P James. Automatic link- age of vital records. Science, 130(3381):954-959, 1959.","title":"Automatic linkage of vital records","authors":"James M Howard B Newcombe, S J Kennedy, Allison P Axford, James","year":"1959","venue":"Science","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Nie et al., 2019] Hao Nie, Xianpei Han, Ben He, Le Sun, Bo Chen, Wei Zhang, Suhui Wu, and Hao Kong. Deep sequence-to-sequence entity matching for heterogeneous entity resolution. In Proceedings of CIKM, pages 629- 638, 2019.","title":"Deep sequence-to-sequence entity matching for heterogeneous entity resolution","authors":"Xianpei Hao Nie, Ben Han, Le He, Bo Sun, Wei Chen, Suhui Zhang, Hao Wu, Kong","year":"2019","venue":"Proceedings of CIKM","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Papadakis et al., 2016] George Papadakis, Jonathan Svirsky, Avigdor Gal, and Themis Palpanas. Comparative analysis of approximate blocking techniques for entity resolution. PVLDB, 9(9):684-695, 2016.","title":"Comparative analysis of approximate blocking techniques for entity resolution","authors":"George Papadakis, Jonathan Svirsky, Avigdor Gal, Themis Palpanas","year":"2016","venue":"PVLDB","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Rahm and Bernstein, 2001] Erhard Rahm and Philip A Bernstein. A survey of approaches to automatic schema matching. the VLDB Journal, 10(4):334-350, 2001.","title":"A survey of approaches to automatic schema matching","authors":"Bernstein Rahm, Erhard Rahm, Philip A Bernstein","year":"2001","venue":"the VLDB Journal","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Sarawagi and Bhamidipaty, 2002] Sunita Sarawagi and Anuradha Bhamidipaty. Interactive deduplication using active learning. In Proceedings of the ACM SIGKDD, pages 269-278. ACM, 2002.","title":"Interactive deduplication using active learning","authors":"Sunita Sarawagi, Anuradha Bhamidipaty","year":"2002","venue":"Proceedings of the ACM SIGKDD","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Sehgal et al., 2006] Vivek Sehgal, Lise Getoor, and Peter D Viechnicki. Entity resolution in geospatial data integra- tion. In Proceedings of ACM-GIS, pages 83-90, 2006.","title":"Entity resolution in geospatial data integration","authors":"Vivek Sehgal, Lise Getoor, Peter D Viechnicki","year":"2006","venue":"Proceedings of ACM-GIS","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Singh et al., 2017] Rohit Singh, Venkata Vamsikrishna Meduri, Ahmed Elmagarmid, Samuel Madden, Paolo Papotti, Jorge-Arnulfo Quiané-Ruiz, Armando Solar- Lezama, and Nan Tang. Synthesizing entity matching rules by examples. PVLDB, 11(2):189-202, 2017.","title":"Synthesizing entity matching rules by examples","authors":"Rohit Singh, Venkata Vamsikrishna Meduri, Ahmed Elmagarmid, Samuel Madden, Paolo Papotti, Jorge-Arnulfo Quiané-Ruiz, Armando Solar-Lezama, Nan Tang","year":"2017","venue":"PVLDB","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Singla and Domingos, 2006] Parag Singla and Pedro Domingos. Entity resolution with markov logic. In Proceedings of the ICDM, pages 572-582. IEEE, 2006.","title":"Entity resolution with markov logic","authors":"Parag Singla, Pedro Domingos","year":"2006","venue":"Proceedings of the ICDM","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Srivastava et al., 2015] Rupesh Kumar Srivastava, Klaus Greff, and Jürgen Schmidhuber. Highway networks. arXiv preprint arXiv:1505.00387, 2015.","title":"Highway networks","authors":"Rupesh Kumar Srivastava, Klaus Greff, Jürgen Schmidhuber","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Wang et al., 2011] Jiannan Wang, Guoliang Li, Jeffrey Xu Yu, and Jianhua Feng. Entity matching: How similar is similar. PVLDB, 4(10):622-633, 2011.","title":"Entity matching: How similar is similar","authors":"Wang","year":"2011","venue":"PVLDB","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Yang et al., 2016] Zichao Yang, Diyi Yang, Chris Dyer, Xi- aodong He, Alex Smola, and Eduard Hovy. Hierarchical attention networks for document classification. In Pro- ceedings of the NAACL-HLT, pages 1480-1489, 2016.","title":"Hierarchical attention networks for document classification","authors":"Yang","year":"2016","venue":"Proceedings of the NAACL-HLT","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}