Proceedings

A Unified Spectral-Spatial Framework for GNNs: Balancing Over-Smoothing and Over-Squashing

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 2969-2978.

https://doi.org/10.24963/ijcai.2026/330

Abstract

Over-smoothing (OSM) and over-squashing (OSQ) are two fundamental phenomena that limit the performance of Graph Neural Networks (GNNs), yet a unified spectral-spatial understanding of these phenomena remains underexplored. In this paper, we adopt polynomial spectral filters as an analytical tool to establish a unified spectral-spatial framework for graph convolution and systematically characterize the effect of the polynomial order k on information propagation in GNNs. Within this framework, we reveal an intrinsic trade-off induced by the polynomial order. Specifically, higher-order filters enhance spectral expressiveness and alleviate OSM caused by the dominant low-frequency components. However, they also expand the spatial receptive field, thereby intensifying information compression and increasing the risk of OSQ. Based on this analysis, we provide a principled guideline for selecting the polynomial order and propose a Quadratic Spectral Graph Convolution Network (QS-GCN) for graph classification. Experiments demonstrate the effectiveness and robustness of the proposed method.

  1. [Alon and Yahav, 2021] Uri Alon and Eran Yahav. On the Bottleneck of Graph Neural Networks and its Practical Im- plications. In Proceedings of ICLR, 2021.
  2. [Bai et al., 2014] Lu Bai, Luca Rossi, Horst Bunke, and Ed- win R. Hancock. Attributed Graph Kernels Using the Jensen-Tsallis q-Differences. In Proceedings of ECML- PKDD, pages 99-114, 2014.
  3. [Bai et al., 2024] Lu Bai, Lixin Cui, Ming Li, Yue Wang, and Edwin Hancock. QBMK: Quantum-based Matching Ker- nels for Un-attributed Graphs. In Proceedings of ICML, pages 2364-2374, 2024.
  4. [Bai et al., 2025] Lu Bai, Lixin Cui, Ming Li, Peng Ren, Yue Wang, Lichi Zhang, Philip S. Yu, and Edwin R. Han- cock. AEGK: Aligned Entropic Graph Kernels Through Continuous-Time Quantum Walks. IEEE Trans. Knowl. Data Eng., pages 1064-1078, 2025.
  5. [Balcilar et al., 2021] Muhammet Balcilar, Guillaume Ren- ton, Pierre Héroux, Benoit Gaüzère, Sébastien Adam, and Paul Honeine. Analyzing the Expressive Power of Graph Neural Networks in a Spectral Perspective. In Proceedings of ICLR, 2021.
  6. [Barbero et al., 2024] Federico Barbero, Ameya Velingker, Amin Saberi, Michael M. Bronstein, and Francesco Di Giovanni. Locality-Aware Graph Rewiring in GNNs. In Proceedings of ICLR, 2024.
  7. [Black et al., 2023] Mitchell Black, Zhengchao Wan, Amir Nayyeri, and Yusu Wang. Understanding Oversquashing in GNNs through the Lens of Effective Resistance. In Pro- ceedings of ICML, pages 2528-2547, 2023.
  8. [Borgwardt and Kriegel, 2005] K.M. Borgwardt and H.P. Kriegel. Shortest-Path Kernels on Graphs. In Proceedings of ICDM, pages 74-81, 2005.
  9. [Bruna et al., 2013] Joan Bruna, Wojciech Zaremba, Arthur Szlam, and Yann LeCun. Spectral Networks and Lo- cally Connected Networks on Graphs. arXiv preprint arXiv:1312.6203, 2013.
  10. [Chen et al., 2020a] Deli Chen, Yankai Lin, Wei Li, Peng Li, Jie Zhou, and Xu Sun. Measuring and Relieving the Over- Smoothing Problem for Graph Neural Networks from the Topological View. In Proceedings of AAAI, pages 3438- 3445, 2020.
  11. [Chen et al., 2020b] Ming Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding, and Yaliang Li. Simple and Deep Graph Convolutional Networks. In Proceedings of ICML, pages 1725-1735, 2020.
  12. [Chung, 1997] Fan R. K. Chung. Spectral Graph Theory, volume 92. Amer. Math. Soc., 1997.
  13. [Cosmo et al., 2025] Luca Cosmo, Giorgia Minello, Alessandro Bicciato, Michael M. Bronstein, Emanuele Rodolà, Luca Rossi, and Andrea Torsello. Graph Kernel Neural Networks. IEEE Trans. Neural Netw. Learn. Syst., pages 6257-6270, 2025.
  14. [Dai et al., 2023] Shi Dai, Andi Han, Lequan Lin, Yi Guo, and Junbin Gao. Exposition on Over-Squashing Problem on GNNs: Current Methods, Benchmarks and Challenges. arXiv preprint arXiv:2311.07073, 2023.
  15. [Defferrard et al., 2016] Michaël Defferrard, Xavier Bres- son, and Pierre Vandergheynst. Convolutional Neural Net- works on Graphs with Fast Localized Spectral Filtering. In Proceedings of NeurIPS, pages 3844-3852, 2016.
  16. [Errica et al., 2020] Federico Errica, Marco Podda, Davide Bacciu, and Alessio Micheli. A Fair Comparison of Graph Neural Networks for Graph Classification. In Proceedings of ICLR, 2020.
  17. [Finkelshtein et al., 2024] Ben Finkelshtein, Xingyue Huang, Michael Bronstein, and İsmail İlkan Ceylan. Cooperative Graph Neural Networks. In Proceedings of ICML, 2024.
  18. [Gartner et al., 2003] Thomas Gartner, Peter A. Flach, and Stefan Wrobel. On Graph Kernels: Hardness Results and Efficient Alternatives. In Proceedings of COLT, pages 129-143, 2003.
  19. [Hamilton et al., 2017] William L. Hamilton, Rex Ying, and Jure Leskovec. Inductive Representation Learning on Large Graphs. In Proceedings of NeurIPS, pages 1025- 1035, 2017.
  20. [Huang et al., 2023] Jincheng Huang, Lun Du, Xu Chen, Qiang Fu, Shi Han, and Dongmei Zhang. Robust Mid- Pass Filtering Graph Convolutional networks. In Proceed- ings of WWW, pages 328-338, 2023.
  21. [Jamadandi et al., 2024] Adarsh Jamadandi, Celia Rubio- Madrigal, and Rebekka Burkholz. Spectral Graph Prun- ing Against Over-Squashing and Over-Smoothing. In Pro- ceedings of NeurIPS, 2024.
  22. [Karhadkar et al., 2023] Kedar Karhadkar, Pradeep Kr. Banerjee, and Guido Montúfar. FoSR: First-Order Spec- tral Rewiring for Addressing Oversquashing in GNNs. In Proceedings of ICLR, 2023.
  23. [Kipf and Welling, 2017] Thomas N. Kipf and Max Welling. Semi-Supervised Classification with Graph Convolutional Networks. In Proceedings of ICLR, 2017.
  24. [Li et al., 2018] Qimai Li, Zhichao Han, and Xiao-Ming Wu. Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning. In Proceedings of AAAI, 2018.
  25. [Li et al., 2023] Guohao Li, Matthias Müller, Guocheng Qian, Itzel C. Delgadillo, Abdulellah Abualshour, Ali Tha- bet, and Bernard Ghanem. DeepGCNs: Making GCNs Go as Deep as CNNs. IEEE Trans. Pattern Anal. Mach. Intell., pages 6923-6939, 2023.
  26. [Min et al., 2021] Shengjie Min, Zhan Gao, Jing Peng, Liang Wang, Ke Qin, and Bo Fang. STGSN -a Spatial- Temporal Graph Neural Network framework for Time- Evolving Social Networks. Knowl.-Based Syst., 2021.
  27. [Nguyen et al., 2023] Kha Dang Nguyen, Tan Minh Nguyen, Nhat Ho, Khuong N. Nguyen, Hieu Nong, and Vinh Phu Nguyen. Revisiting Over-smoothing and Over-squashing using Ollivier-Ricci Curvature. In Proceedings of ICML, 2023.
  28. [Nikolentzos and Vazirgiannis, 2023] Giannis Nikolent- zos and Michalis Vazirgiannis. Geometric Random Walk Graph Neural Networks via Implicit Layers. In Proceedings of AISTATS, 2023.
  29. [NT and Maehara, 2019] Hoang NT and Takanori Maehara. Revisiting Graph Neural Networks: All We Have is Low- Pass Filters. arXiv preprint arXiv:1905.09550, 2019.
  30. [Rong et al., 2020] Yu Rong, Wenbing Huang, Tingyang Xu, and Junzhou Huang. DropEdge: Towards Deep Graph Convolutional Networks on Node Classification. In Pro- ceedings of ICLR, 2020.
  31. [Rusch et al., 2022a] T. Konstantin Rusch, Ben Chamber- lain, James Rowbottom, Siddhartha Mishra, and Michael Bronstein. Graph-Coupled Oscillator Networks. In Pro- ceedings of ICML, pages 18888-18909, 2022.
  32. [Rusch et al., 2022b] T. Konstantin Rusch, Benjamin Paul Chamberlain, Michael W. Mahoney, Michael M. Bron- stein, and Siddhartha Mishra. Gradient Gating for Deep Multi-Rate Learning on Graphs. In Proceedings of ICLR, 2022.
  33. [Rusch et al., 2023] T. Konstantin Rusch, Michael M. Bron- stein, and Siddhartha Mishra. A Survey on Over- smoothing in Graph Neural Networks. arXiv preprint arXiv:2303.10993, 2023.
  34. [Schneckenreiter et al., 2024] Lisa Schneckenreiter, Richard Freinschlag, Florian Sestak, Johannes Brandstetter, Günter Klambauer, and Andreas Mayr. GNN-VPA: A Variance- Preserving Aggregation Strategy for Graph Neural Net- works. In Proceedings of ICLR Tiny Papers Track, 2024.
  35. [Shervashidze et al., 2011] Nino Shervashidze, Pascal Schweitzer, Erik Jan van Leeuwen, Kurt Mehlhorn, and Karsten M. Borgwardt. Weisfeiler-Lehman Graph Kernels. J. Mach. Learn. Res., pages 2539-2561, 2011.
  36. [Simonovsky and Komodakis, 2017] Martin Simonovsky and Nikos Komodakis. Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs. In Proceedings of CVPR, pages 29-38, 2017.
  37. [Singh, 2025] Akansha Singh. Over-Squashing in Graph Neural Networks: A Comprehensive Survey. Neurocom- puting, 2025.
  38. [Topping et al., 2022] Jake Topping, Francesco Di Gio- vanni, Benjamin Paul Chamberlain, Xiaowen Dong, and Michael M. Bronstein. Understanding Over-Squashing and Bottlenecks on Graphs via Curvature. In Proceedings of ICLR, 2022.
  39. [Wang and Zhang, 2022] Xiyuan Wang and Muhan Zhang. How Powerful are Spectral Graph Neural Networks. In Proceedings of ICML, pages 23341-23362, 2022.
  40. [Wang et al., 2023] Yu Wang, Yuying Zhao, Yi Zhang, and Tyler Derr. Collaboration-Aware Graph Convolutional Networks for Recommendation Systems. In Proceedings of WWW, pages 91-101, 2023.
  41. [Wilson et al., 2025] J. J. Wilson, Maya Bechler-Speicher, and Petar Veličković. Cayley Graph Propagation. In Pro- ceedings of LoG, 2025.
  42. [Xu et al., 2019] Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. How Powerful are Graph Neural Net- works? In Proceedings of ICLR, 2019.
  43. [Xu et al., 2021] Lixiang Xu, Lu Bai, Xiaoyi Jiang, Ming Tan, Daoqiang Zhang, and Bin Luo. Deep Rényi Entropy Graph Kernel. Pattern Recognit., 2021.
  44. [Yan et al., 2023] Yujun Yan, Gao Li, and Danai Koutra. Size Generalizability of Graph Neural Networks on Bio- logical Data: Insights and Practices from the Spectral Per- spective. arXiv preprint arXiv:2305.15611, 2023.
  45. [Ying et al., 2018] Rex Ying, Jiaxuan You, Christopher Mor- ris, Xiang Ren, William L. Hamilton, and Jure Leskovec. Hierarchical Graph Representation Learning with Dif- ferentiable Pooling. In Proceedings of NeurIPS, page 4805-4815, 2018.
  46. [Zhang et al., 2019] Muhan Zhang, Zhicheng Cui, Marion Neumann, and Yixin Chen. An End-to-end Deep Learn- ing Architecture for Graph Classification. In Proceedings of AAAI, pages 4438-4445, 2019.
  47. [Zhao and Akoglu, 2019] Lingxiao Zhao and Leman Akoglu. PairNorm: Tackling Oversmoothing in GNNs. arXiv preprint arXiv:1909.12223, 2019.
  48. [Zhu and Koniusz, 2021] Hao Zhu and Piotr Koniusz. Sim- ple Spectral Graph Convolution. In Proceedings of ICLR, 2021.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards