{"type":"ScholarlyArticle","title":"Ontology Reasoning with Deep Neural Networks (Extended Abstract)","authors":[{"name":"Patrick Hohenecker","slug":"patrick-hohenecker","given":"Patrick","family":"Hohenecker","affiliation":"Department of Computer Science , University of Oxford , UK; Serein AI , London , UK"},{"name":"Thomas Lukasiewicz","slug":"thomas-lukasiewicz","given":"Thomas","family":"Lukasiewicz","affiliation":"Department of Computer Science , University of Oxford , UK; Serein AI , London , UK"}],"abstract":"The ability to conduct logical reasoning is a fundamental aspect of intelligent human behavior, and thus an important problem along the way to human-level artificial intelligence. Traditionally, logic-based symbolic methods from the field of knowledge representation and reasoning have been used to equip agents with capabilities that resemble human logical reasoning qualities. More recently, however, there has been an increasing interest in using machine learning rather than logic-based symbolic formalisms to tackle these tasks. In this paper, we employ  state-of-the-art  methods for training  deep neural networks to devise a novel model that is able to learn how to effectively perform logical reasoning in the form of basic ontology reasoning.","doi":"10.24963/ijcai.2020/707","url":"https://ijcai.org/proceedings/2020/707","pdf":"https://ijcai.org/proceedings/2020/0707.pdf","markdown":"https://ijcai.org/proceedings/2020/707.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/707","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Journal track","track":"Journal track","number":707,"pages":{"first":5060,"last":5064},"keywords":["Machine Learning: Neuro-Symbolic Methods","Knowledge Representation and Reasoning: Description Logics and Ontologies","Machine Learning: Deep Learning"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/25405/file_25405.m3u8","length_sec":284,"provider":"hls"}],"references":[{"position":1,"raw":"[Bengio, 2009] Yoshua Bengio. Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2(1):1-127, 2009.","title":"Learning deep architectures for AI","authors":"Yoshua Bengio","year":"2009","venue":"Foundations and Trends in Machine Learning","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bizer et al., 2009] Christian Bizer, Jens Lehmann, Georgi Kobilarov, Sören Auer, Christian Becker, Richard Cyga- niak, and Sebastian Hellmann. DBpedia -a crystalliza- tion point for the web of data. Journal of Web Semantics, 7(3):154-165, 2009.","title":"DBpedia -a crystallization point for the web of data","authors":"Bizer","year":"2009","venue":"Journal of Web Semantics","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bouchard et al., 2015] Guillaume Bouchard, Sameer Singh, and Theo Trouillon. On approximate reasoning capabil- ities of low-rank vector spaces. In Proceedings of the 2015 AAAI Spring Symposium on Knowledge Represen- tation and Reasoning: Integrating Symbolic and Neural Approaches, pages 6-9, 2015.","title":"On approximate reasoning capabilities of low-rank vector spaces","authors":"Guillaume Bouchard, Sameer Singh, Theo Trouillon","year":"2015","venue":"Proceedings of the 2015 AAAI Spring Symposium on Knowledge Representation and Reasoning: Integrating Symbolic and Neural Approaches","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Cai et al., 2017] Cheng-Hao Cai, Dengfeng Ke, Yanyan Xu, and Kaile Su. Symbolic manipulation based on deep neu- ral networks and its application to axiom discovery. In Proceedings of the 2017 International Joint Conference on Neural Networks, pages 2136-2143, 2017.","title":"Symbolic manipulation based on deep neural networks and its application to axiom discovery","authors":"Cheng-Hao Cai, Dengfeng Ke, Yanyan Xu, Kaile Su","year":"2017","venue":"Proceedings of the 2017 International Joint Conference on Neural Networks","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cingillioglu and Russo, 2018] Nuri Cingillioglu and Alessandra Russo. DeepLogic: End-to-end logical reasoning. arXiv:1805.07433, 2018.","title":"Nuri Cingillioglu and Alessandra Russo. DeepLogic: End-to-end logical reasoning","authors":"Russo Cingillioglu","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Dai et al., 2018] Wang-Zhou Dai, Qiu-Ling Xu, Yang Yu, and Zhi-Hua Zhou. Tunneling neural perception and logic reasoning through abductive learning. arXiv:1802.01173, 2018.","title":"Tunneling neural perception and logic reasoning through abductive learning","authors":"Wang-Zhou Dai, Qiu-Ling Xu, Yang Yu, Zhi-Hua Zhou","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Ebrahimi et al., 2018] Monireh Ebrahimi, Md Kamruzza- man Sarker, Federico Bianchi, Ning Xie, Derek Doran, and Pascal Hitzler. Reasoning over RDF knowledge bases using deep learning. arXiv:1811.04132, 2018.","title":"Reasoning over RDF knowledge bases using deep learning","authors":"Ebrahimi","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Evans et al., 2018] Richard Evans, David Saxton, David Amos, Pushmeet Kohli, and Edward Grefenstette. Can neural networks understand logical entailment? In Inter- national Conference on Learning Representations, 2018.","title":"Can neural networks understand logical entailment?","authors":"Richard Evans, David Saxton, David Amos, Pushmeet Kohli, Edward Grefenstette","year":"2018","venue":"International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Hohenecker and Lukasiewicz, 2020] Patrick Hohenecker and Thomas Lukasiewicz. Ontology reasoning with deep neural networks. Journal of Artificial Intelligence Research, 68, 2020.","title":"Ontology reasoning with deep neural networks","authors":"Lukasiewicz Hohenecker, Patrick Hohenecker, Thomas Lukasiewicz","year":"2020","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kok and Domingos, 2007] Stanley Kok and Pedro Domin- gos. Statistical predicate invention. In Proceedings of the 24th International Conference on Machine Learning, pages 433-440, 2007.","title":"Statistical predicate invention","authors":"Domingos ; Kok, Pedro Kok, Domingos","year":"2007","venue":"Proceedings of the 24th International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Lembo et al., 2010] Domenico Lembo, Maurizio Lenzerini, Riccardo Rosati, Marco Ruzzi, and Domenico Fabio Savo. Inconsistency-tolerant semantics for description logics. In Proceedings of the 4th International Conference on Web Reasoning and Rule Systems, pages 103-117, 2010.","title":"Inconsistency-tolerant semantics for description logics","authors":"Domenico Lembo, Maurizio Lenzerini, Riccardo Rosati, Marco Ruzzi, Domenico Fabio Savo","year":"2010","venue":"Proceedings of the 4th International Conference on Web Reasoning and Rule Systems","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Makni and Hendler, 2018] Bassem Makni and James Hendler. Deep learning for noise-tolerant RDFS reason- ing. Semantic Web, 10(5):823-862, 2018.","title":"Bassem Makni and James Hendler. Deep learning for noise-tolerant RDFS reasoning","authors":"Hendler Makni","year":"2018","venue":"Semantic Web","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Manhaeve et al., 2018] Robin Manhaeve, Sebastijan Du- mančić, Angelika Kimmig, Thomas Demeester, and Luc De Raedt. DeepProbLog: Neural probabilistic logic pro- gramming. arXiv:1805.10872, 2018.","title":"Robin Manhaeve, Sebastijan Dumančić","authors":"Manhaeve","year":"2018","venue":"DeepProbLog: Neural probabilistic logic programming","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[McCray, 2003] Alex T. McCray. An upper-level ontology for the biomedical domain. Comparative and Functional Genomics, 4:80-84, 2003.","title":"An upper-level ontology for the biomedical domain","authors":"Alex T Mccray","year":"2003","venue":"Comparative and Functional Genomics","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"Cornelis A. Middelburg. A survey of paraconsistent logics. arXiv:1103.4324, 2011.","title":"A survey of paraconsistent logics","authors":"A Cornelis, Middelburg","year":"2011","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Mikolov et al., 2013] Tomas Mikolov, Greg Corrado, Kai Chen, and Jeffrey Dean. Efficient estimation of word rep- resentations in vector space. In International Conference on Learning Representations, 2013.","title":"Efficient estimation of word representations in vector space","authors":"Mikolov","year":"2013","venue":"International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Nenov et al., 2015] Yavor Nenov, Robert Piro, Boris Motik, Ian Horrocks, Zhe Wu, and Jay Banerjee. RDFox: A highly-scalable RDF store. In Proceedings of the 14th In- ternational Semantic Web Conference, pages 3-20, 2015.","title":"RDFox: A highly-scalable RDF store","authors":"Yavor Nenov, Robert Piro, Boris Motik, Ian Horrocks, Zhe Wu, Jay Banerjee","year":"2015","venue":"Proceedings of the 14th International Semantic Web Conference","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Nickel et al., 2016] Maximilian Nickel, Lorenzo Rosasco, and Tomaso Poggio. Holographic embeddings of knowl- edge graphs. In Proceedings of the 30th AAAI Conference on Artificial Intelligence, pages 1955-1961, 2016.","title":"Holographic embeddings of knowledge graphs","authors":"Maximilian Nickel, Lorenzo Rosasco, Tomaso Poggio","year":"2016","venue":"Proceedings of the 30th AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Pollack, 1990] Jordan B. Pollack. Recursive distributed rep- resentations. Artificial Intelligence, 46(1/2):77-105, 1990.","title":"Recursive distributed representations","authors":"Jordan B Pollack","year":"1990","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Rocktäschel and Riedel, 2017] Tim Rocktäschel and Sebas- tian Riedel. End-to-end differentiable proving. In Ad- vances in Neural Information Processing Systems 30, pages 3788-3800, 2017.","title":"Tim Rocktäschel and Sebastian Riedel. End-to-end differentiable proving","authors":"Riedel Rocktäschel","year":"2017","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Serafini and d'Avila Garcez, 2016] Luciano Serafini and Artur d'Avila Garcez. Logic Tensor Networks: Deep learning and logical reasoning from data and knowledge. arXiv:1606.04422, 2016.","title":"Logic Tensor Networks: Deep learning and logical reasoning from data and knowledge","authors":"D'avila Serafini, Luciano Garcez, Artur D'avila Serafini, Garcez","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Sukhbaatar et al., 2015] Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, and Rob Fergus. End-to-end memory networks. In Advances in Neural Information Processing Systems 28, pages 2440-2448, 2015.","title":"End-to-end memory networks","authors":"Sukhbaatar","year":"2015","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Wang et al., 2017] Quan Wang, Zhendong Mao, Bin Wang, and Li Guo. Knowledge graph embedding: A survey of ap- proaches and applications. IEEE Transactions on Knowl- edge and Data Engineering, 29(12):2724-2743, 2017.","title":"Knowledge graph embedding: A survey of approaches and applications","authors":"Quan Wang, Zhendong Mao, Bin Wang, Li Guo","year":"2017","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Weston et al., 2015] Jason Weston, Antoine Bordes, Sumit Chopra, and Tomas Mikolov. Towards AI-complete question answering: A set of prerequisite toy tasks. arXiv:1502.05698, 2015.","title":"Towards AI-complete question answering: A set of prerequisite toy tasks","authors":"Jason Weston, Antoine Bordes, Sumit Chopra, Tomas Mikolov","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}