Proceedings

A Foundation Model for Zero-Shot Logical Rule Induction

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 3999-4007.

https://doi.org/10.24963/ijcai.2026/445

Abstract

Inductive Logic Programming (ILP) learns interpretable logical rules from data. Existing methods are transductive: their learned parameters are bound to specific predicates and require retraining for each new task. We introduce Neural Rule Inducer (NRI), a pretrained model for zero-shot rule induction. Rather than encoding literal identities, NRI represents literals using domain-agnostic statistical properties such as class-conditional rates, entropy, and co-occurrence, which generalize across variable identities and counts without retraining. The model consists of a statistical encoder and a parallel slot-based decoder. Parallel decoding preserves the permutation invariance of logical disjunction; an autoregressive decoder would instead impose an arbitrary clause order. Product T-norm relaxation makes rule execution differentiable, allowing end-to-end training on prediction accuracy alone. We evaluate NRI on rule recovery, robustness to label noise and spurious correlations, and zero-shot transfer to real-world benchmarks, and we believe this work opens up the possibility of foundation models for symbolic reasoning. Code and the reference checkpoint are available at https://github.com/phuayj/neural-rule-inducer. An extended version with full appendices is available at https://arxiv.org/abs/2605.04916.

  1. [Asuncion et al., 2007] Arthur Asuncion, David Newman, et al. Uci machine learning repository, 2007.
  2. [Bommasani, 2021] Rishi Bommasani. On the opportu- nities and risks of foundation models. arXiv preprint arXiv:2108.07258, 2021.
  3. [Cortes and Vapnik, 1995] Corinna Cortes and Vladimir Vapnik. Support-vector networks. Machine learning, 20(3):273-297, 1995.
  4. [Cropper and Morel, 2021] Andrew Cropper and Rolf Morel. Learning programs by learning from failures. Machine Learning, 110(4):801-856, 2021.
  5. [Evans and Grefenstette, 2018] Richard Evans and Edward Grefenstette. Learning explanatory rules from noisy data. Journal of Artificial Intelligence Research, 61:1-64, 2018.
  6. [Fedus et al., 2022] William Fedus, Barret Zoph, and Noam Shazeer. Switch transformers: Scaling to trillion param- eter models with simple and efficient sparsity. Journal of Machine Learning Research, 23(120):1-39, 2022.
  7. [Gao et al., 2024] Kun Gao, Katsumi Inoue, Yongzhi Cao, and Hanpin Wang. A differentiable first-order rule learner for inductive logic programming. Artificial Intelligence, 331:104108, 2024.
  8. [Hollmann et al., 2023] Noah Hollmann, Samuel Müller, Katharina Eggensperger, and Frank Hutter. Tabpfn: A transformer that solves small tabular classification prob- lems in a second. In International Conference on Learning Representations 2023, 2023.
  9. [Inoue et al., 2014] Katsumi Inoue, Tony Ribeiro, and Chi- aki Sakama. Learning from interpretation transition. Ma- chine Learning, 94(1):51-79, 2014.
  10. [Johnson et al., 2025] Blair Johnson, Clayton Kerce, and Faramarz Fekri. Glidr: Graph-like inductive logic pro- gramming with differentiable reasoning. arXiv preprint arXiv:2508.06716, 2025.
  11. [Klement et al., 2013] Erich Peter Klement, Radko Mesiar, and Endre Pap. Triangular norms, volume 8. Springer Science & Business Media, 2013.
  12. [Manhaeve et al., 2018] Robin Manhaeve, Sebastijan Du- mancic, Angelika Kimmig, Thomas Demeester, and Luc De Raedt. Deepproblog: Neural probabilistic logic pro- gramming. Advances in Neural Information Processing Systems, 31, 2018.
  13. [Muggleton and De Raedt, 1994] Stephen Muggleton and Luc De Raedt. Inductive logic programming: Theory and methods. The Journal of Logic Programming, 19:629- 679, 1994.
  14. [Muggleton, 1995] Stephen Muggleton. Inverse entailment and progol. New generation computing, 13(3):245-286, 1995.
  15. [Olausson et al., 2023] Theo Olausson, Alex Gu, Ben Lip- kin, Cedegao Zhang, Armando Solar-Lezama, Joshua Tenenbaum, and Roger Levy. Linc: A neurosymbolic ap- proach for logical reasoning by combining language mod- els with first-order logic provers. In Proceedings of the 2023 Conference on Empirical Methods in Natural Lan- guage Processing, pages 5153-5176, 2023.
  16. [Peng et al., 2025] Yifei Peng, Yaoli Liu, Enbo Xia, Yu Jin, Wang-Zhou Dai, Zhong Ren, Yao-Xiang Ding, and Kun Zhou. Abductive logical rule induction by bridging in- ductive logic programming and multimodal large language models. arXiv preprint arXiv:2509.21874, 2025.
  17. [Perez et al., 2018] Ethan Perez, Florian Strub, Harm de Vries, Vincent Dumoulin, and Aaron Courville. Film: Visual reasoning with a general conditioning layer. In AAAI Conference on Artificial Intelligence, pages 3942- 3951, 2018.
  18. [Phua and Inoue, 2024] Yin Jun Phua and Katsumi Inoue. Variable assignment invariant neural networks for learning logic programs. In International Conference on Neural- Symbolic Learning and Reasoning (NeSy). Springer, 2024.
  19. [Quinlan, 1990] J. Ross Quinlan. Learning logical defini- tions from relations. volume 5, pages 239-266. Springer, 1990.
  20. [Ren et al., 2025] ZZ Ren, Zhihong Shao, Junxiao Song, Huajian Xin, Haocheng Wang, Wanjia Zhao, Liyue Zhang, Zhe Fu, Qihao Zhu, Dejian Yang, et al. Deepseek-prover- v2: Advancing formal mathematical reasoning via re- inforcement learning for subgoal decomposition. arXiv preprint arXiv:2504.21801, 2025.
  21. [Rocktäschel and Riedel, 2017] Tim Rocktäschel and Sebas- tian Riedel. End-to-end differentiable proving. volume 30, 2017.
  22. [Sadeghian et al., 2019] Ali Sadeghian, Mohammadreza Ar- mandpour, Patrick Ding, and Daisy Zhe Wang. Drum: End-to-end differentiable rule mining on knowledge graphs. Advances in neural information processing sys- tems, 32, 2019.
  23. [Serafini and Garcez, 2016] Luciano Serafini and Ar- tur d'Avila Garcez. Logic tensor networks: Deep learning and logical reasoning from data and knowledge. 2016.
  24. [Srinivasan, 2001] Ashwin Srinivasan. The aleph manual. 2001.
  25. [Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. volume 30, 2017.
  26. [Wang and Gupta, 2022] Huaduo Wang and Gopal Gupta. FOLD-R++: A scalable toolset for automated inductive learning of default theories from mixed data. In Functional and Logic Programming -16th International Symposium, FLOPS 2022, Kyoto, Japan, May 10-12, 2022, Proceed- ings, Lecture Notes in Computer Science, pages 224-242.
  27. [Yang et al., 2017] Fan Yang, Zhilin Yang, and William W Cohen. Differentiable learning of logical rules for knowl- edge base reasoning. Advances in neural information pro- cessing systems, 30, 2017.
  28. [Yang et al., 2020] Zhun Yang, Adam Ishay, and Joohyung Lee. Neurasp: Embracing neural networks into answer set programming. In 29th International Joint Conference on Artificial Intelligence (IJCAI 2020), 2020. IJCAI

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards