Proceedings

Injecting Qualitative Spatial Reasoning into World Models via Logic Tensor Networks

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 4016-4025.

https://doi.org/10.24963/ijcai.2026/447

© 2026 International Joint Conferences on Artificial Intelligence

Abstract

World models (WM) learn predictive representations from high-dimensional sensory input. However, their internal knowledge is implicit and often inadequate for systematic reasoning about object structure. Qualitative Spatial Reasoning (QSR) models provide explicit human-readable object descriptions under transformations. This paper shows that these two forms of modeling can be combined by injecting a QSR model into a WM to improve the WM reasoning abilities. Using a cube rotation setting inspired by the cube comparison test used in mental rotation tasks as a case study, we use a QSR model that captures the geometric relationships and transformation rules describing how features move across faces under discrete rotations. We translate this QSR model into differentiable constraints using Logic Tensor Networks (LTNs) to guide gradient based learning. These constraints are injected into the WM loss function to regularize its latent dynamics to satisfy the spatial constraints of rotation. The results show that under an extreme data scarce regime (10%), baseline model's performance collapses to near zero, whereas our approach achieves above 90% better performance relative to baseline. Our method consistently maintains high scores across all data regimes (~80%), for both in-distribution and out-of-distribution observations. This paper proposes a novel framework to infuse QSR knowledge inside WM to make learned latent dynamics logical. Code is available at: https:// github.com/ajayrao80/LtnDreamer/

  1. [Amador and Gierasimczuk, 2025] Ivo Amador and Nina Gierasimczuk. Symdqn: Symbolic knowledge and rea- soning in neural network-based reinforcement learning. In
  2. Leilani H. Gilpin, Eleonora Giunchiglia, Pascal Hitzler, and Emile van Krieken, editors, Proceedings of The 19th International Conference on Neurosymbolic Learning and Reasoning, volume 284 of Proceedings of Machine Learn- ing Research, pages 70-85. PMLR, 08-10 Sep 2025.
  3. [Badreddine and Spranger, 2019] Samy Badreddine and Michael Spranger. Injecting prior knowledge for transfer learning into reinforcement learning algorithms using logic tensor networks. ArXiv, abs/1906.06576, 2019.
  4. [Badreddine et al., 2022] Samy Badreddine, Artur d'Avila Garcez, Luciano Serafini, and Michael Spranger. Logic tensor networks. Artificial Intelligence, 303:103649, 2022.
  5. [Balloch et al., 2023] Jonathan C. Balloch, Zhiyu Lin, Robert William Wright, Xiangyu Peng, Mustafa Hussain, Aarun Srinivas, Julia Kim, and Mark O. Riedl. Neuro- symbolic world models for adapting to open world novelty. ArXiv, abs/2301.06294, 2023.
  6. [Bianchi and Hitzler, 2019] Federico Bianchi and Pascal Hitzler. On the capabilities of logic tensor networks for deductive reasoning. In AAAI Spring Symposium on Com- bining Machine Learning with Knowledge Engineering (AAAI-MAKE 2019), Stanford University, Palo Alto, Cali- fornia, USA, March 25-27 2019.
  7. [Chen et al., 2025] Shiqi Chen, Tongyao Zhu, Ruochen Zhou, Jinghan Zhang, Siyang Gao, Juan Carlos Niebles, Mor Geva, Junxian He, Jiajun Wu, and Manling Li. Why is spatial reasoning hard for VLMs? An attention mechanism perspective on focus areas. In Aarti Singh, Maryam Fazel, Daniel Hsu, Simon Lacoste-Julien, Felix Berkenkamp, Tegan Maharaj, Kiri Wagstaff, and Jerry Zhu, editors, Proc. 42nd Int. Conf. on Machine Learning, volume 267 of Proc. of Machine Learning Research, pages 9910-9932. PMLR, 13-19 Jul 2025.
  8. [Cohen et al., 2017] Gregory Cohen, Saeed Afshar, Jonathan Tapson, and André van Schaik. Emnist: an extension of mnist to handwritten letters, 2017.
  9. [Cohn and Renz, 2007] A. G. Cohn and J. Renz. Qualitative Spatial Reasoning, Handbook of Knowledge Representa- tion. Elsevier, Wiley-ISTE, London, 2007.
  10. [De Santis et al., 2026] Francesco De Santis, Gabriele Ciravegna, Philippe Bich, Danilo Giordano, and Tania Cerquitelli. V-CEM: Bridging Performance and Interven- ability in Concept-Based Models. In Riccardo Guidotti, Ute Schmid, and Luca Longo, editors, Explainable Artificial Intelligence, pages 48-67, Cham, 2026. Springer Nature Switzerland.
  11. [Donadello et al., 2017] Ivan Donadello, Luciano Serafini, and Artur d'Avila Garcez. Logic tensor networks for se- mantic image interpretation. In Proc. 26th Int. Joint Conf. Artificial Intelligence, IJCAI-17, pages 1596-1602, 2017. IJCAI
  12. [Espinosa Zarlenga et al., 2022] Mateo Espinosa Zarlenga, Pietro Barbiero, Gabriele Ciravegna, Giuseppe Marra, Francesco Giannini, Michelangelo Diligenti, Zohreh Shams, Frederic Precioso, Stefano Melacci, Adrian Weller, Pietro Lió, and Mateja Jamnik. Concept Embed- ding Models: Beyond the Accuracy-Explainability Trade- Off. Advances in Neural Information Processing Systems, 35:21400-21413, December 2022.
  13. [Esser et al., 2020] Patrick Esser, Robin Rombach, and Bjorn Ommer. A disentangling invertible interpretation network for explaining latent representations. In Proc. 2020 IEEE Conf. Comput. Vision and Pattern Recognition, pages 9220-9229, Seattle, WA, USA, June 2020. IEEE.
  14. [Falomir and Costa, 2025] Zoe Falomir and Vicent Costa. Comparing qualitative object descriptors using a visual similarity measure. In Vicenc ¸Torra, Yasuo Narukawa, and Josep Domingo-Ferrer, editors, Modeling Decisions for Artificial Intelligence -22nd Int. Conf., MDAI 2025, València, Spain, September 15-18, 2025, Proceedings, volume 15957 of Lecture Notes in Computer Science, pages 303-314. Springer, 2025.
  15. [Falomir, 2015] Zoe Falomir. A Qualitative Model for Rea- soning about 3D Objects using Depth and Different Per- spectives. In T. Lechowski, P. Walega, and M. Zawidzki, editors, Proc. of 2015 Workshop on Logics for Qualitative Modelling and Reasoning (LQMR@FedCSIS 2015), Lódz, Poland,, volume 7 of Annals of Computer Science and In- formation Systems, pages 3-11, 2015.
  16. [Falomir, 2025] Zoe Falomir. A qualitative model to reason about object rotations (QOR) applied to solve the cube comparison test (CCT). ArXiv arXiv.2601.08382, 2025.
  17. [Ha and Schmidhuber, 2018] David Ha and Jürgen Schmid- huber. Recurrent world models facilitate policy evolution. In Proc. 32nd Int. Conf. Neural Information Processing Systems, NIPS'18, page 2455-2467, Red Hook, NY, USA, 2018.
  18. Curran Associates Inc. [Hafner et al., 2019a] Danijar Hafner, Timothy Lillicrap, Jimmy Ba, and Mohammad Norouzi. Dream to control: Learning behaviors by latent imagination. arXiv preprint arXiv:1912.01603, 2019.
  19. [Hafner et al., 2019b] Danijar Hafner, Timothy Lillicrap, Ian Fischer, Ruben Villegas, David Ha, Honglak Lee, and James Davidson. Learning latent dynamics for planning from pixels. In Int. Conf. machine learning, pages 2555- 2565. PMLR, 2019.
  20. [Hafner et al., 2020] Danijar Hafner, Timothy Lillicrap, Mo- hammad Norouzi, and Jimmy Ba. Mastering Atari with Discrete World Models. arXiv preprint arXiv:2010.02193, 2020.
  21. [Hafner et al., 2025] Danijar Hafner, Jurgis Pasukonis, Jimmy Ba, and Timothy Lillicrap. Mastering diverse control tasks through world models. Nature, pages 1-7, 2025.
  22. [He et al., 2017] K. He, G. Gkioxari, P. Dollár, and R. Gir- shick. Mask R-CNN. In Proc. 2017 IEEE Int. Conf. Com- put. Vision, pages 2980-2988, October 2017.
  23. [Jacobson and Xue, 2025] Maxwell J. Jacobson and Yexiang Xue. Integrating symbolic reasoning into neural genera- tive models for design generation. Artificial Intelligence, 339:104257, 2025.
  24. [Kamath et al., 2023] Amita Kamath, Jack Hessel, and Kai- Wei Chang. What's "up" with vision-language models? investigating their struggle with spatial reasoning. ArXiv, abs/2310.19785, 2023.
  25. [Kim and Mnih, 2018] Hyunjik Kim and Andriy Mnih. Dis- entangling by factorising. In Proc. 2018 Int. Conf. Ma- chine Learning, pages 2649-2658. PMLR, July 2018.
  26. [Koh et al., 2020] Pang Wei Koh, Thao Nguyen, Yew Siang Tang, Stephen Mussmann, Emma Pierson, Been Kim, and Percy Liang. Concept bottleneck models. In Proc. 2020 Int. Conf. Machine Learning, pages 5338-5348. PMLR, November 2020.
  27. [Lambert et al., 2022] Nathan Lambert, Kristofer S. J. Pis- ter, and Roberto Calandra. Investigating compounding prediction errors in learned dynamics models. ArXiv, abs/2203.09637, 2022.
  28. [LeCun et al., 2010] Yann LeCun, Corinna Cortes, and CJ Burges. Mnist handwritten digit database. ATT Labs [Online]. Available: http://yann.lecun.com/exdb/mnist, 2, 2010. Link
  29. [Lee et al., 2025] Jae Hee Lee, Georgii Mikriukov, Gesina Schwalbe, Stefan Wermter, and Diedrich Wolter. Concept- Based Explanations in Computer Vision: Where Are We and Where Could We Go? In Alessio Del Bue, Cristian Canton, Jordi Pont-Tuset, and Tatiana Tommasi, editors, Computer Vision -ECCV 2024 Workshops, pages 266- 287, Cham, 2025. Springer Nature Switzerland.
  30. [Li et al., 2025] Xinyi Li, Zaishuo Xia, Weyl Lu, Chenjie Hao, and Yubei Chen. Smallworlds: Assessing dynamics understanding of world models in isolated environments, 2025.
  31. [Liang et al., 2025] Yichao Liang, Nishanth Kumar, Hao Tang, Adrian Weller, Joshua B. Tenenbaum, Tom Sil- ver, João F. Henriques, and Kevin Ellis. Visualpredica- tor: Learning abstract world models with neuro-symbolic predicates for robot planning, 2025.
  32. [Ligozat, 2011] G. Ligozat. Qualitative Spatial and Tempo- ral Reasoning. MIT Press, Wiley-ISTE, London, 2011.
  33. [Liu et al., 2022] Xiao Liu, Pedro Sanchez, Spyridon Ther- mos, Alison Q. O'Neil, and Sotirios A. Tsaftaris. Learning disentangled representations in the imaging domain. Med- ical Image Analysis, 80:102516, August 2022.
  34. [Manigrasso et al., 2023] Francesco Manigrasso, Lia Morra, and Fabrizio Lamberti. Fuzzy logic visual network (flvn): A neuro-symbolic approach for visual features matching, 2023.
  35. [Novák et al., 1999] Vilém Novák, Irina Perfilieva, and J. Mockor. Mathematical Principles of Fuzzy Logic. The Springer Int. Series in Engineering and Computer Science. Springer US, January 1999.
  36. [Oikarinen et al., 2022] Tuomas Oikarinen, Subhro Das, Lam M. Nguyen, and Tsui-Wei Weng. Label-free Concept Bottleneck Models. In The Eleventh Int. Conf. Learning Representations, September 2022.
  37. [Roychowdhury et al., 2018] Soumali Roychowdhury, Michelangelo Diligenti, and Marco Gori. Image classifi- cation using deep learning and prior knowledge. In AAAI Workshops, pages 336-343, 2018.
  38. [Sehgal et al., 2023] Atharva Sehgal, Arya Grayeli, Jen- nifer J. Sun, and Swarat Chaudhuri. Neurosymbolic grounding for compositional world models. ArXiv, abs/2310.12690, 2023.
  39. [Serafini and d'Avila Garcez, 2016] Luciano Serafini and Artur d'Avila Garcez. Logic tensor networks: Deep learn- ing and logical reasoning from data and knowledge, 2016.
  40. [Shindo et al., 2025] Hikaru Shindo, Viktor Pfanschilling, Devendra Singh Dhami, and Kristian Kersting. Learning differentiable logic programs for abstract visual reasoning, 2025.
  41. [Stogiannidis et al., 2025] Ilias Stogiannidis, Steven Mc- Donagh, and Sotirios A. Tsaftaris. Mind the gap: Bench- marking spatial reasoning in vision-language models, 2025.
  42. [van Steenkiste et al., 2019] Sjoerd van Steenkiste, Francesco Locatello, Jürgen Schmidhuber, and Olivier Bachem. Are Disentangled Representations Helpful for Abstract Visual Reasoning? In Advances in Neural Information Processing Systems, volume 32.
  43. Curran Associates, Inc., 2019.
  44. [Xu et al., 2024] Weidi Xu, Jingwei Wang, Lele Xie, Jian- shan He, Hongting Zhou, Taifeng Wang, Xiaopei Wan, Jingdong Chen, Chao Qu, and Wei Chu. Logicmp: A neuro-symbolic approach for encoding first-order logic constraints. In B. Kim, Y. Yue, S. Chaudhuri, K. Fragki- adaki, M. Khan, and Y. Sun, editors, Int. Conf. Represen- tation Learning, volume 2024, pages 4181-4209, 2024.
  45. [Yang et al., 2023] Zhun Yang, Joohyung Lee, and Chiyoun Park. Injecting logical constraints into neural networks via straight-through estimators, 2023.
  46. [Yuksekgonul et al., 2022] Mert Yuksekgonul, Maggie Wang, and James Zou. Post-hoc Concept Bottleneck Models. In ICLR 2022 Workshop on PAIR2Struct: Privacy, Accountability, Interpretability, Robustness, Reasoning on Structured Data, March 2022.
  47. [Zhang et al., 2021] Lunjun Zhang, Ge Yang, and Bradly C Stadie. World model as a graph: Learning latent land- marks for planning. In Int. Conf. Machine Learning, pages 12611-12620. PMLR, 2021.
  48. [Zhao et al., 2021] Meihua Zhao, Gang Xiong, MengChu Zhou, Zhen Shen, and Fei-Yue Wang. 3D-RVP: A method for 3D object reconstruction from a single depth view us- ing voxel and point. Neurocomputing, 430:94-103, 2021.
  49. [Zhu et al., 2023] Deyao Zhu, Li Erran Li, and Mohamed El- hoseiny. Value memory graph: A graph-structured world model for offline reinforcement learning, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards