A Unified Spectral-Spatial Framework for GNNs: Balancing Over-Smoothing and Over-Squashing
Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 2969-2978.
https://doi.org/10.24963/ijcai.2026/330
Keywords
- Data Mining: Mining graphs
Abstract
Over-smoothing (OSM) and over-squashing (OSQ) are two fundamental phenomena that limit the performance of Graph Neural Networks (GNNs), yet a unified spectral-spatial understanding of these phenomena remains underexplored. In this paper, we adopt polynomial spectral filters as an analytical tool to establish a unified spectral-spatial framework for graph convolution and systematically characterize the effect of the polynomial order k on information propagation in GNNs. Within this framework, we reveal an intrinsic trade-off induced by the polynomial order. Specifically, higher-order filters enhance spectral expressiveness and alleviate OSM caused by the dominant low-frequency components. However, they also expand the spatial receptive field, thereby intensifying information compression and increasing the risk of OSQ. Based on this analysis, we provide a principled guideline for selecting the polynomial order and propose a Quadratic Spectral Graph Convolution Network (QS-GCN) for graph classification. Experiments demonstrate the effectiveness and robustness of the proposed method.
- [Alon and Yahav, 2021] Uri Alon and Eran Yahav. On the Bottleneck of Graph Neural Networks and its Practical Im- plications. In Proceedings of ICLR, 2021.
- [Bai et al., 2014] Lu Bai, Luca Rossi, Horst Bunke, and Ed- win R. Hancock. Attributed Graph Kernels Using the Jensen-Tsallis q-Differences. In Proceedings of ECML- PKDD, pages 99-114, 2014.
- [Bai et al., 2024] Lu Bai, Lixin Cui, Ming Li, Yue Wang, and Edwin Hancock. QBMK: Quantum-based Matching Ker- nels for Un-attributed Graphs. In Proceedings of ICML, pages 2364-2374, 2024.
- [Bai et al., 2025] Lu Bai, Lixin Cui, Ming Li, Peng Ren, Yue Wang, Lichi Zhang, Philip S. Yu, and Edwin R. Han- cock. AEGK: Aligned Entropic Graph Kernels Through Continuous-Time Quantum Walks. IEEE Trans. Knowl. Data Eng., pages 1064-1078, 2025.
- [Balcilar et al., 2021] Muhammet Balcilar, Guillaume Ren- ton, Pierre Héroux, Benoit Gaüzère, Sébastien Adam, and Paul Honeine. Analyzing the Expressive Power of Graph Neural Networks in a Spectral Perspective. In Proceedings of ICLR, 2021.
- [Barbero et al., 2024] Federico Barbero, Ameya Velingker, Amin Saberi, Michael M. Bronstein, and Francesco Di Giovanni. Locality-Aware Graph Rewiring in GNNs. In Proceedings of ICLR, 2024.
- [Black et al., 2023] Mitchell Black, Zhengchao Wan, Amir Nayyeri, and Yusu Wang. Understanding Oversquashing in GNNs through the Lens of Effective Resistance. In Pro- ceedings of ICML, pages 2528-2547, 2023.
- [Borgwardt and Kriegel, 2005] K.M. Borgwardt and H.P. Kriegel. Shortest-Path Kernels on Graphs. In Proceedings of ICDM, pages 74-81, 2005.
- [Bruna et al., 2013] Joan Bruna, Wojciech Zaremba, Arthur Szlam, and Yann LeCun. Spectral Networks and Lo- cally Connected Networks on Graphs. arXiv preprint arXiv:1312.6203, 2013.
- [Chen et al., 2020a] Deli Chen, Yankai Lin, Wei Li, Peng Li, Jie Zhou, and Xu Sun. Measuring and Relieving the Over- Smoothing Problem for Graph Neural Networks from the Topological View. In Proceedings of AAAI, pages 3438- 3445, 2020.
- [Chen et al., 2020b] Ming Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding, and Yaliang Li. Simple and Deep Graph Convolutional Networks. In Proceedings of ICML, pages 1725-1735, 2020.
- [Chung, 1997] Fan R. K. Chung. Spectral Graph Theory, volume 92. Amer. Math. Soc., 1997.
- [Cosmo et al., 2025] Luca Cosmo, Giorgia Minello, Alessandro Bicciato, Michael M. Bronstein, Emanuele Rodolà, Luca Rossi, and Andrea Torsello. Graph Kernel Neural Networks. IEEE Trans. Neural Netw. Learn. Syst., pages 6257-6270, 2025.
- [Dai et al., 2023] Shi Dai, Andi Han, Lequan Lin, Yi Guo, and Junbin Gao. Exposition on Over-Squashing Problem on GNNs: Current Methods, Benchmarks and Challenges. arXiv preprint arXiv:2311.07073, 2023.
- [Defferrard et al., 2016] Michaël Defferrard, Xavier Bres- son, and Pierre Vandergheynst. Convolutional Neural Net- works on Graphs with Fast Localized Spectral Filtering. In Proceedings of NeurIPS, pages 3844-3852, 2016.
- [Errica et al., 2020] Federico Errica, Marco Podda, Davide Bacciu, and Alessio Micheli. A Fair Comparison of Graph Neural Networks for Graph Classification. In Proceedings of ICLR, 2020.
- [Finkelshtein et al., 2024] Ben Finkelshtein, Xingyue Huang, Michael Bronstein, and İsmail İlkan Ceylan. Cooperative Graph Neural Networks. In Proceedings of ICML, 2024.
- [Gartner et al., 2003] Thomas Gartner, Peter A. Flach, and Stefan Wrobel. On Graph Kernels: Hardness Results and Efficient Alternatives. In Proceedings of COLT, pages 129-143, 2003.
- [Hamilton et al., 2017] William L. Hamilton, Rex Ying, and Jure Leskovec. Inductive Representation Learning on Large Graphs. In Proceedings of NeurIPS, pages 1025- 1035, 2017.
- [Huang et al., 2023] Jincheng Huang, Lun Du, Xu Chen, Qiang Fu, Shi Han, and Dongmei Zhang. Robust Mid- Pass Filtering Graph Convolutional networks. In Proceed- ings of WWW, pages 328-338, 2023.
- [Jamadandi et al., 2024] Adarsh Jamadandi, Celia Rubio- Madrigal, and Rebekka Burkholz. Spectral Graph Prun- ing Against Over-Squashing and Over-Smoothing. In Pro- ceedings of NeurIPS, 2024.
- [Karhadkar et al., 2023] Kedar Karhadkar, Pradeep Kr. Banerjee, and Guido Montúfar. FoSR: First-Order Spec- tral Rewiring for Addressing Oversquashing in GNNs. In Proceedings of ICLR, 2023.
- [Kipf and Welling, 2017] Thomas N. Kipf and Max Welling. Semi-Supervised Classification with Graph Convolutional Networks. In Proceedings of ICLR, 2017.
- [Li et al., 2018] Qimai Li, Zhichao Han, and Xiao-Ming Wu. Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning. In Proceedings of AAAI, 2018.
- [Li et al., 2023] Guohao Li, Matthias Müller, Guocheng Qian, Itzel C. Delgadillo, Abdulellah Abualshour, Ali Tha- bet, and Bernard Ghanem. DeepGCNs: Making GCNs Go as Deep as CNNs. IEEE Trans. Pattern Anal. Mach. Intell., pages 6923-6939, 2023.
- [Min et al., 2021] Shengjie Min, Zhan Gao, Jing Peng, Liang Wang, Ke Qin, and Bo Fang. STGSN -a Spatial- Temporal Graph Neural Network framework for Time- Evolving Social Networks. Knowl.-Based Syst., 2021.
- [Nguyen et al., 2023] Kha Dang Nguyen, Tan Minh Nguyen, Nhat Ho, Khuong N. Nguyen, Hieu Nong, and Vinh Phu Nguyen. Revisiting Over-smoothing and Over-squashing using Ollivier-Ricci Curvature. In Proceedings of ICML, 2023.
- [Nikolentzos and Vazirgiannis, 2023] Giannis Nikolent- zos and Michalis Vazirgiannis. Geometric Random Walk Graph Neural Networks via Implicit Layers. In Proceedings of AISTATS, 2023.
- [NT and Maehara, 2019] Hoang NT and Takanori Maehara. Revisiting Graph Neural Networks: All We Have is Low- Pass Filters. arXiv preprint arXiv:1905.09550, 2019.
- [Rong et al., 2020] Yu Rong, Wenbing Huang, Tingyang Xu, and Junzhou Huang. DropEdge: Towards Deep Graph Convolutional Networks on Node Classification. In Pro- ceedings of ICLR, 2020.
- [Rusch et al., 2022a] T. Konstantin Rusch, Ben Chamber- lain, James Rowbottom, Siddhartha Mishra, and Michael Bronstein. Graph-Coupled Oscillator Networks. In Pro- ceedings of ICML, pages 18888-18909, 2022.
- [Rusch et al., 2022b] T. Konstantin Rusch, Benjamin Paul Chamberlain, Michael W. Mahoney, Michael M. Bron- stein, and Siddhartha Mishra. Gradient Gating for Deep Multi-Rate Learning on Graphs. In Proceedings of ICLR, 2022.
- [Rusch et al., 2023] T. Konstantin Rusch, Michael M. Bron- stein, and Siddhartha Mishra. A Survey on Over- smoothing in Graph Neural Networks. arXiv preprint arXiv:2303.10993, 2023.
- [Schneckenreiter et al., 2024] Lisa Schneckenreiter, Richard Freinschlag, Florian Sestak, Johannes Brandstetter, Günter Klambauer, and Andreas Mayr. GNN-VPA: A Variance- Preserving Aggregation Strategy for Graph Neural Net- works. In Proceedings of ICLR Tiny Papers Track, 2024.
- [Shervashidze et al., 2011] Nino Shervashidze, Pascal Schweitzer, Erik Jan van Leeuwen, Kurt Mehlhorn, and Karsten M. Borgwardt. Weisfeiler-Lehman Graph Kernels. J. Mach. Learn. Res., pages 2539-2561, 2011.
- [Simonovsky and Komodakis, 2017] Martin Simonovsky and Nikos Komodakis. Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs. In Proceedings of CVPR, pages 29-38, 2017.
- [Singh, 2025] Akansha Singh. Over-Squashing in Graph Neural Networks: A Comprehensive Survey. Neurocom- puting, 2025.
- [Topping et al., 2022] Jake Topping, Francesco Di Gio- vanni, Benjamin Paul Chamberlain, Xiaowen Dong, and Michael M. Bronstein. Understanding Over-Squashing and Bottlenecks on Graphs via Curvature. In Proceedings of ICLR, 2022.
- [Wang and Zhang, 2022] Xiyuan Wang and Muhan Zhang. How Powerful are Spectral Graph Neural Networks. In Proceedings of ICML, pages 23341-23362, 2022.
- [Wang et al., 2023] Yu Wang, Yuying Zhao, Yi Zhang, and Tyler Derr. Collaboration-Aware Graph Convolutional Networks for Recommendation Systems. In Proceedings of WWW, pages 91-101, 2023.
- [Wilson et al., 2025] J. J. Wilson, Maya Bechler-Speicher, and Petar Veličković. Cayley Graph Propagation. In Pro- ceedings of LoG, 2025.
- [Xu et al., 2019] Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. How Powerful are Graph Neural Net- works? In Proceedings of ICLR, 2019.
- [Xu et al., 2021] Lixiang Xu, Lu Bai, Xiaoyi Jiang, Ming Tan, Daoqiang Zhang, and Bin Luo. Deep Rényi Entropy Graph Kernel. Pattern Recognit., 2021.
- [Yan et al., 2023] Yujun Yan, Gao Li, and Danai Koutra. Size Generalizability of Graph Neural Networks on Bio- logical Data: Insights and Practices from the Spectral Per- spective. arXiv preprint arXiv:2305.15611, 2023.
- [Ying et al., 2018] Rex Ying, Jiaxuan You, Christopher Mor- ris, Xiang Ren, William L. Hamilton, and Jure Leskovec. Hierarchical Graph Representation Learning with Dif- ferentiable Pooling. In Proceedings of NeurIPS, page 4805-4815, 2018.
- [Zhang et al., 2019] Muhan Zhang, Zhicheng Cui, Marion Neumann, and Yixin Chen. An End-to-end Deep Learn- ing Architecture for Graph Classification. In Proceedings of AAAI, pages 4438-4445, 2019.
- [Zhao and Akoglu, 2019] Lingxiao Zhao and Leman Akoglu. PairNorm: Tackling Oversmoothing in GNNs. arXiv preprint arXiv:1909.12223, 2019.
- [Zhu and Koniusz, 2021] Hao Zhu and Piotr Koniusz. Sim- ple Spectral Graph Convolution. In Proceedings of ICLR, 2021.
References were extracted automatically from the PDF and may contain errors.
Full text extracted automatically from the PDF; figures, tables and equations may differ. The PDF is the version of record.
1 Introduction
Graph-structured data has gained increasing attention in the field of machine learning and has been widely applied in various real-world domains, including bioinformatics [Yan et al., 2023], social networks [Min et al., 2021], and recommendation systems [Wang et al., 2023]. However, most classical deep learning methods are originally designed for gridstructured data such as images or sequences, which cannot directly accommodate the irregular graph data from the nonEuclidean space. To address this limitation, Graph Neural Networks (GNNs) have emerged as powerful frameworks for learning on graphs, achieving notable success in tasks such as node classification, graph classification, and link prediction.
∗Corresponding Author: Lu Bai
Most existing GNNs generally follow two dominant perspectives including spectral filtering and spatial message passing. Spectral methods are grounded in the eigendecomposition of the graph Laplacian and the graph Fourier transform, where the graph convolution is formulated as the spectral filtering operation. Although this formulation provides a solid theoretical foundation, it typically incurs high computational costs due to the eigendecomposition [Bruna et al., 2013]. To alleviate this issue, various spectral variants based on polynomial approximations or simplified filters have been proposed, such as the ChebNet [Defferrard et al., 2016], vanilla Graph Convolutional Network (GCN) [Kipf and Welling, 2017], and JacobiConv [Wang and Zhang, 2022]. Among them, the first-order approximation adopted by the vanilla GCN enables spectral filtering to be efficiently implemented in the spatial domain, where a node updates its representation by aggregating the representations of its neighbors. This process facilitates the propagation of information across nodes, offering improved interpretability. This mechanism has further driven the rapid development of spatial GNNs, such as the GraphSAGE [Hamilton et al., 2017], GIN [Xu et al., 2019], and DGCNN [Zhang et al., 2019].
Despite these advances in modeling flexibility and computational efficiency, GNNs still suffer from two fundamental challenges in practice, namely over-smoothing (OSM) [Rusch et al., 2023; Li et al., 2018; NT and Maehara, 2019; Chen et al., 2020a] and over-squashing (OSQ) [Dai et al., 2023; Singh, 2025]. As the network depth or propagation distance increases, node representations tend to become increasingly homogeneous. This homogenization degrades the discriminability of the node representations and is commonly referred to as OSM. Meanwhile, OSQ arises from the rapid expansion of the receptive field, where the information from a large number of distant nodes must be compressed into fixeddimensional embeddings, leading to severe information loss and creating an information bottleneck.
However, most existing studies treat OSM and OSQ as separate phenomena, and only a limited number of works have begun to explore the trade-off between them. For instance, FoSR [Karhadkar et al., 2023] and ProxyDelete [Jamadandi et al., 2024] investigate spectral reconnection strategies from the perspectives of the spectral gap and the Cheeger constant, aiming to improve graph structures and alleviate excessive smoothing and compression during the information propagation. From a geometric viewpoint, BORF [Nguyen et al., 2023] analyzes the relationship between edges with the positive and negative curvature as well as the OSM/OSQ phenomena, and proposes a curvature-driven graph reconnection method that can mitigate both issues to some extent. Nevertheless, these approaches largely rely on a single analytical perspective, focusing either on spectral properties or geometric characteristics. Consequently, they do not capture the interplay between spectral and spatial factors that jointly influence OSM and OSQ. A unified framework that systematically characterizes this interplay from both spectral and spatial perspectives is essential to understand the intrinsic trade-off, explain feature homogenization and information compression in deep GNNs, and guide the design of architectures that balance these phenomena effectively.
Motivated by the aforementioned observations, we revisit classical polynomial spectral filters and establish a unified spectral-spatial framework for graph convolution, aiming to systematically investigate the trade-off between OSM and OSQ in a principled manner. The main contributions of this paper are summarized as follows.
First, we establish a unified spectral-spatial analysis framework based on the polynomial spectral filters, which explicitly and rigorously characterizes the intrinsic relationship between the polynomial order k, spectral frequency selectivity, and the spatial aggregation range.
Second, within the proposed framework, we provide a systematic theoretical analysis of how the polynomial order k influences the OSM and OSQ issues in GNNs. We show that the increasing polynomial order k can enhance the spectral expressiveness and alleviate OSM caused by dominant lowfrequency components, but also simultaneously expands the spatial receptive field and further exacerbates the information compression, thereby increasing the risk of OSQ.
Third, motivated by the above analysis, we argue that a moderate polynomial order is critical for achieving a better balance between OSM and OSQ. Following this principle, we propose a new Quadratic Spectral Graph Convolution Network (QS-GCN) for graph classification, comprising a Quadratic Spectral Graph Convolution (QS-Conv) and an alignment-based readout module. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of the proposed QS-GCN.
This paper is organized as follows. Section 2 reviews the OSM and OSQ problems. Section 3 presents a unified theoretical framework, and Section 4 analyzes OSM and OSQ through this framework. Section 5 introduces the proposed trade-off strategy QS-GCN. Section 6 reports the experimental evaluation. Section 7 concludes this paper.
2 RelatedWorks
2.1 The Over-Smoothing (OSM) Problem
The OSM problem is a fundamental challenge in GNNs, where repeated message passing causes node representations to become increasingly indistinguishable, ultimately degrading the performance on both node-level and graph-level tasks. Several studies have investigated its underlying mechanisms from different perspectives. For example, [Li et al., 2018] model GCN layers as Laplacian smoothing processes and demonstrate that deeper networks result in indistinguishable node embeddings. From a spectral perspective, [NT and Maehara, 2019] and [Balcilar et al., 2021] interpret GCNs as low-pass filters that suppress high-frequency signals. Although such filtering can effectively reduce noise, the excessive smoothing inevitably blurs discriminative information. To address the OSM problem, various solutions have been proposed, including PairNorm [Zhao and Akoglu, 2019], DropEdge [Rong et al., 2020], GCNII [Chen et al., 2020b], GraphCON [Rusch et al., 2022a], G2 [Rusch et al., 2022b], and Res-GCN [Li et al., 2023].
2.2 The Over-Squashing (OSQ) Problem
The OSQ issue is another challenge for GNNs [Dai et al., 2023; Singh, 2025]. It refers to the phenomenon where the information from a large number of nodes within an expanding receptive field is excessively compressed into fixeddimensional node vectors, resulting in ineffective message propagation from distant nodes. Recently, several approaches have been proposed to alleviate OSQ. For instance, FA [Alon and Yahav, 2021] connects all nodes of the final layer to reduce the compression. SDRF [Topping et al., 2022] improves the message flow by modifying negatively curved edges. FoSR [Karhadkar et al., 2023] alleviates OSQ by optimizing the spectral gap. GTR [Black et al., 2023] rewires edges to reduce the effective resistance between nodes.
3 AUnified Spectral-Spatial Framework
This section establishes a unified spectral-spatial framework for graph convolution based on polynomial spectral filters. By explicitly connecting spectral filtering behavior with spatial neighborhood aggregation, the framework provides a principled foundation for analyzing the intrinsic trade-off between OSM and OSQ arising in GNNs.
Let G = (V, E) be an undirected graph with n nodes, represented by an adjacency matrix A ∈ {0, 1}n×n and a node feature matrix X ∈ Rn×f . To incorporate self-information into the message propagation, self-loops are added, yielding ˜ A = A+ I. Let ˜D denote the degree matrix, whose diagonal entries are given by ˜Dii = ∑j ˜ Aij. The symmetrically normalized adjacency matrix is ˆ A = ˜D- 12 ˜ A ˜D- 12 . Accordingly, the normalized graph Laplacian is ˆL = I - ˆ A. Since ˆL is symmetric and positive semi-definite, it admits the eigendecomposition ˆL = U diag(λ)U ⊤, where U ∈ Rn×n is the matrix of eigenvectors, and λ = (λ1, . . . , λn) denotes the corresponding eigenvalues.
A general spectral graph convolution is defined as
where σ(·) is a nonlinear activation function, W is a learnable weight matrix, and g(λ) denotes the element-wise evaluation of the spectral response function g(λ) on the eigenvalue vector λ, i.e., g(λ) = (g(λ1), g(λ2), . . . , g(λn)). In this paper, we focus on the k-th order polynomial spectral filter
where {αt}kt=0 are polynomial coefficients. Substituting gk(λ) into Eq. (1), we have
This derivation shows that polynomial spectral filtering is equivalent to a linear combination of powers of the normalized graph Laplacian applied to node features.
From the spatial perspective, aggregating the information from k-hop neighborhoods can be written as
Since the normalized Laplacian satisfies ˆL = I- ˆ A, the above polynomial spectral convolution is equivalent to
Applying the binomial expansion to each term, we have
Substituting this expansion into the convolution and rearranging the sums, we have
Defining
we can rewrite the above convolution compactly as
This derivation demonstrates that a k-th order polynomial spectral filter is spatially equivalent to a weighted aggregation over neighborhoods up to k hops. Thus, the polynomial order k governs both the spectral expressiveness and the spatial receptive field of the convolution.
4 Theoretical Analysis of OSMand OSQ
The unified spectral-spatial framework indicates that increasing polynomial order k allows the convolution to aggregate more information over larger neighborhoods while realizing richer spectral responses. This dual perspective provides a solid theoretical foundation for analyzing the information propagation in GNNs in relation to OSM and OSQ. Based on this foundation, we systematically investigate the impact of the polynomial order k on the OSM and OSQ issues.
4.1 Analyzing OSMwith Polynomial Order k
Generally, first-order spectral filters often yield simple monotonic frequency responses under common parameterizations, whereas higher-order polynomial filters enhance spectral expressiveness, mitigating the low-pass bias responsible for OSM. Based on this observation, we first provide a formal definition of OSM and then present a rigorous analysis to characterize its relationship with the polynomial order k.
Definition 1 (OSM). Let h(l) p ∈ Rf ′ denote the representation of node p at layer l. The OSM phenomenon occurs when the network depth increases, and all node representations tend to converge to the same vector, i.e.,
In this case, node representations discard their discriminative power and become indistinguishable.
Theorem 1. Increasing the polynomial order k of a spectral graph filter can help mitigate OSM under the following mild assumptions: (i) the normalized graph Laplacian ˆL has a finite spectrum; and (ii) there exists at least one discriminative spectral component whose contribution induces a nonzero node-wise separation.
Proof. OSM fundamentally arises from the selective suppression of discriminative spectral components by graph convolutional filtering, and stacking layers further amplifies this effect. To reveal the underlying mechanism, we analyze a single spectral filtering operation and investigate how the polynomial order k affects the preservation of discriminative information. For analytical simplicity, we omit the nonlinear activation function and the feature transformation matrix W, and consider a single-channel input signal x ∈ Rn . Let ˆx = U ⊤x. Then Eq. (1) reduces to
where u(i) is the i-th eigenvector of ˆL. Let S ⊆ {1, . . . , n} denote the set of discriminative spectral components, and define the ideal target response ri as below
For any pair of nodes p, q ∈ V , define M and E as
so that
By the non-degeneracy assumption, there exists at least one pair of nodes p, q such that Mp,q ̸= 0. Define ∆p,q := |Mp,q| > 0. For the error term, let δk = max1≤i≤n |gk(λi)- ri|. Since the eigenvectors are normalized, we have |u(i) p - u(i) q | ≤ 2 for any i. Therefore,
Since the spectrum of ˆL contains only finitely many eigenvalues, polynomial interpolation on the discrete spectral set guarantees that there exists a polynomial filter gk of sufficiently large order k such that δk ≤ ε for any ε > 0. So
In particular, once k is large enough such that 2ε√n∥x∥2 < ∆p,q, we obtain |hp -hq| > 0. This result indicates that sufficiently high-order polynomial spectral filters preserve discriminative spectral components and prevent node representations from collapsing to identical embeddings after graph convolution. Therefore, increasing the polynomial order k helps mitigate OSM.
4.2 Analyzing OSQwith Polynomial Order k
Within the unified spectral-spatial framework, the polynomial order k determines the number of node hops whose features are aggregated during graph convolution. As k increases, the convolution aggregates information from more distant neighbors, thereby expanding the spatial receptive field of each node. However, under fixed-dimensional node embeddings, this expansion can intensify information compression and lead to OSQ. In this part, we first provide a formal definition of OSQ and then analyze how the polynomial order affects it.
Definition 2 (OSQ). Let hp ∈ Rf ′ be the representation of node p after graph convolution, measuring the sensitivity of hp to the input feature of node q by the node-wise Jacobian
OSQ occurs when Jp←q is close to zero for a non-negligible fraction of node pairs (p, q) ∈ V × V , indicating that information from node q is excessively compressed and thus fails to meaningfully influence the representation of node p.
Theorem 2. Increasing the polynomial order k enlarges the spatial receptive field and can exacerbate the OSQ issue.
Proof. To isolate the intrinsic compression mechanism of OSQ, we omit the nonlinear activation and analyze a single graph convolution layer. For theoretical clarity, we consider a connected non-bipartite c-regular graph, which is commonly used in prior theoretical studies on OSQ [Nguyen et al., 2023; Karhadkar et al., 2023; Dai et al., 2023]. After adding selfloops, the augmented graph becomes (c + 1)-regular, so ˜D = (c + 1)I and ˆ A = ˜D-1/2 ˜ A ˜D-1/2 = ˜D-1 ˜ A = P, where P is the random-walk transition matrix on the augmented graph. From the spatial form in Eq. (9), we have
For any pair of nodes (p, q), let dist(p, q) = d be the shortestpath distance. Since [ ˆ As ]pq = 0 for all s < d, we obtain
By the classical spectral mixing theorem for random walks [Chung, 1997], there exist constants C0 > 0 and ρ ∈ (0, 1) such that
The stationary term 1/n is identical for all node pairs and is therefore non-discriminative. Further assume that the polynomial coefficients are bounded, i.e., |βs| ≤ B for all s = 0, . . . , k. Substituting the above bound into Eq. (20) yields
where C ′ = ∥W∥2BC0 1-ρ . This shows that, after removing the stationary averaging component, the node-specific sensitivity decays exponentially with the shortest-path distance d.
We now examine the spatial effect induced by increasing k. As k increases, progressively farther distance shells are incorporated into the receptive field. In a connected nonbipartite c-regular graph, the number of nodes in the distanced shell grows on the order of cd , whereas the above bound shows that the discriminative sensitivity of these nodes decays exponentially with d. Therefore, although higher-order convolution introduces exponentially more distant nodes, the node-specific information carried by each newly added node becomes exponentially weaker. As a result, increasing k rapidly enlarges the set of low-sensitivity node pairs, making many Jacobian entries Jp←q nearly negligible. In other words, the expansion of the receptive field does not yield a proportional gain in effective information; instead, it compresses an increasing number of weak signals into the same fixed-dimensional representation hp, thereby intensifying information mixing and aggravating the OSQ issue.
4.3 Trade-Off Insights between OSMand OSQ
To illustrate the impact of the polynomial order k on node representations, Figure 1 provides a schematic example. Here, k = 1, 2, 3 are used to represent low, medium, and high polynomial orders. The upper row depicts the spectral responses of polynomial filters at different orders. As k increases, the filter exhibits greater spectral expressiveness, which helps mitigate OSM, consistent with Theorem 1. The lower row shows the corresponding spatial receptive fields. Higher-order polynomials enlarge the receptive field, allowing information aggregation from more distant neighbors and potentially aggravating OSQ, as established by Theorem 2.

This analysis reveals the dual role of k in governing OSM and OSQ. Specifically, a small k limits spectral expressiveness, causing node representations to become overly similar and leading to OSM. In contrast, an excessively large k overly expands the receptive field, forcing weak long-range signals to be compressed into fixed-dimensional representations and thereby aggravating OSQ. Therefore, a moderate polynomial order enables a better balance between spectral discriminability and spatial locality, effectively alleviating both phenomena. In summary, selecting an appropriate k is crucial for balancing spectral filtering and spatial neighborhood aggregation. To validate this trade-off, we present experiments on the effect of polynomial order in Section 6.1.
5 The Proposed QS-GCNModel
In this section, we propose a Quadratic Spectral Graph Convolutional Network (QS-GCN) to balance OSM and OSQ, thereby enhancing the discriminative power of graph representations. Motivated by the theoretical analysis in Section 4.3 and later empirically validated in Section 6.1, we set the polynomial order to k = 2 in the proposed model. This choice balances spectral expressiveness and spatial locality, mitigating OSM while avoiding excessive OSQ. Specifically, QS-GCN consists of two main components: the Quadratic Spectral Graph Convolution (QS-Conv) and the Alignmentbased Readout Module. The former provides node-level feature extraction with an interpretable trade-off between spectral expressiveness and spatial locality. The latter aligns node features into a fixed cluster order and maps the aligned representation to the final graph-level output via a shared MultiLayer Perceptron (MLP).
5.1 The Quadratic Spectral Graph Convolution
The QS-Conv performs convolution on graph signals using a quadratic spectral polynomial. This design provides a flexible frequency response, which helps alleviate OSM, while restricting the convolutional scope to at most two hops and thus preventing excessive expansion of the receptive field. The operation is defined as
| k | MUTAG | PTCMR | PROTEINS | IMDB-B |
| 0 | 86.81 | 60.25 | 74.66 | 72.79 |
| 1 | 85.58 | 60.55 | 74.57 | 71.30 |
| 2 | 90.91 | 63.42 | 75.15 | 73.46 |
| 3 | 82.89 | 61.92 | 74.03 | 73.26 |
| 4 | 85.34 | 57.65 | 73.49 | 72.94 |
| 5 | 84.21 | 54.28 | 72.32 | 70.29 |
where (α0, α1, α2) are learnable coefficients for the quadratic spectral terms.
5.2 The Alignment-based Readout Module
Although OSM and OSQ are typically discussed at the node level, they also directly affect graph-level tasks. Traditional readout functions, such as sum, mean, or max, are permutation-invariant but do not explicitly preserve structural correspondence across graphs. To address this issue, we propose an alignment-based readout module that reduces indiscriminate aggregation, preserves local structural distinctions, and produces order-consistent graph representations.
Specifically, let H ∈ Rn×d denote the node feature matrix after the last graph convolution layer. We softly assign nodes to s clusters using a shared assignment function parameterized by WS ∈ Rd×s , which produces an assignment probability matrix S ∈ Rn×s as
where softmax is applied row-wise so that each row of S forms a valid probability distribution over clusters. Using S, we align the node feature matrix H into fixed-order cluster representations as
Since ˜H is order-consistent across graph samples, we flatten it into a vector of dimension sd and feed it into an MLP to assign different importance weights to each cluster, producing the final graph-level representation as
6 Experiments
In this section, we first explore the impact of the polynomial order k on graph classification performance to validate the theoretical analysis presented earlier. We then compare the effectiveness of our QS-GCN with representative graph kernels and GNNs on benchmark datasets.
6.1 Impact of Polynomial Order k
We investigate the effect of the polynomial order k on graph classification performance within the QS-GCN framework, where k is varied from 0 to 5. Experiments are conducted on representative graph classification datasets from the TUDataset. For each dataset, the model hyperparameters are kept fixed across different values of k. The detailed hyperparameter settings are provided in Section 6.2. We report the average results over 10-fold cross-validation.
| MUTAG | PTC MR | PROTEINS | DD | IMDB-B | IMDB-M | REDB | |
|---|---|---|---|---|---|---|---|
| Max #Nodes | 28 | 64 | 620 | 5748 | 136 | 89 | 3782 |
| Mean #Nodes | 17.93 | 14.29 | 39.06 | 284.3 | 19.77 | 13 | 429.63 |
| #Graphs | 188 | 344 | 1113 | 1178 | 1000 | 1500 | 2000 |
| #Classes | 2 | 2 | 2 | 2 | 2 | 3 | 2 |
| Domain | Bio | Bio | Bio | Bio | SN | SN | SN |
| Method | MUTAG | PTC MR | PROTEINS | DD | IMDB-B | IMDB-M | REDB |
|---|---|---|---|---|---|---|---|
| QS-GCN (Ours) | 90.91±0.61 | 63.42±1.42 | 75.15±0.21 | 77.33±0.29 | 73.46±1.40 | 48.78±0.64 | 88.76±0.20 |
| RWGK (2003) | 80.77±0.72 | 55.91±0.37 | 74.20±0.40 | 71.70±0.47 | 67.94±0.77 | 46.72±0.30 | 72.73±0.39 |
| SPGK (2005) | 83.38±0.31 | 56.55±0.53 | 75.10±0.50 | 78.45±0.26 | 71.26±1.04 | 51.33±0.57 | 84.20±0.70 |
| WLSK (2011) | 82.88±0.57 | 56.05±0.51 | 73.52±0.43 | 79.78±0.36 | 71.88±0.77 | 49.50±0.49 | 76.56±0.30 |
| JTQK (2014) | 85.50±0.55 | 57.39±0.46 | 72.86±0.41 | 79.49±0.32 | 72.45±0.81 | 50.33±0.49 | 77.60±0.35 |
| EDBMK (2021) | 86.35 | 56.75 | - | 78.19 | - | - | - |
| QBMK (2024) | 88.55±0.43 | 59.38±0.36 | - | 77.60±0.47 | - | - | - |
| AEGK (2025) | 89.11±0.40 | 59.38±0.36 | 75.11±0.28 | 76.32±0.46 | - | - | 88.86±0.12 |
| Dataset | k = 0 | k = 1 | k = 2 | k = 3 | k = 4 | k = 5 |
|---|---|---|---|---|---|---|
| Cora | 61.68 | 81.19 | 82.62 | 81.67 | 41.69 | 41.29 |
| OGB-MolHIV | 77.87 | 79.08 | 79.76 | 78.44 | 77.32 | 77.74 |
As shown in Table 1, the polynomial order k has a substantial impact on classification performance. Across all datasets, k = 2 generally achieves the best results, in agreement with the trade-off analysis in Section 4.3. When k is too small, the graph filter has limited frequency selectivity and tends to bias toward low-frequency components, resulting in overly smooth node representations and degraded discriminability. In contrast, larger k increases spectral flexibility but simultaneously enlarges the spatial receptive field, compressing weak long-range signals into fixed-dimensional representations and aggravating OSQ. Overall, the quadratic setting achieves an effective balance between spectral discrimination and spatial locality, thereby mitigating both OSM and OSQ.
To further validate the generalizability of our method, we additionally evaluate it on the node classification dataset Cora and the large-scale molecular graph classification benchmark OGB-MolHIV (∼41k graphs), following the standard evaluation protocol used in GCN-based studies. We report classification accuracy (%) on Cora and ROC-AUC on OGBMolHIV. The results in Table 4 exhibit the same trend as our theoretical analysis and the observations on the TUDataset.
6.2 Performance Evaluation of QS-GCN
We further evaluate the overall performance of the proposed QS-GCN model, considering classification accuracy and the ability to mitigate the OSM and OSQ problems. Specifically, experiments are conducted on multiple benchmark graph classification datasets covering two major application domains: bioinformatics (Bio) and social networks (SN). Detailed statistics of the datasets are summarized in Table 2. All experiments are implemented using PyTorch and PyTorch Geometric and are executed on a single NVIDIA GeForce RTX 3090 GPU with 24GB of VRAM.
We initialize the polynomial spectral filters as band-pass filters whose peak frequency response is located in the midfrequency region (λ ≈ 1). Specifically, for k = 2, the coefficients are designed to produce a unimodal spectral response, given by g(λ) = -λ2+2λ. For higher-order polynomials, the coefficients are extended into a smoothly varying oscillatory pattern. The number of convolutional layers is set between 2 and 4, the node embedding dimension is fixed as 64, and the number of clusters in the readout stage is set to 8. We adopt the ReLU activation function and optimize the models using Adam. The learning rate is selected from {0.001, 0.005}, the weight decay from {10-5 , 10-4 , 10-3 }, and the batch size is set to 64. Depending on the dataset, the number of training epochs ranges from 100 to 1000. To ensure statistical robustness, we perform 10 independent repetitions of 10-fold cross-validation and report the mean classification accuracy and the standard error. Code is available on GitHub. 1
Comparison on Graph Classification Performance. We compare QS-GCN with a range of representative graph kernel methods and GNNs. The graph kernels include RWGK [Gartner et al., 2003], SPGK [Borgwardt and Kriegel, 2005], WLSK [Shervashidze et al., 2011], JTQK [Bai et al., 2014] (with q = 2), EDBMK [Xu et al., 2021], QBMK [Bai et al., 2024], and AEGK [Bai et al., 2025]. The GNNs include DGCNN [Zhang et al., 2019], DiffPool [Ying et al., 2018], ECC [Simonovsky and Komodakis, 2017], GIN [Xu et al., 2019], GraphSAGE [Hamilton et al., 2017], S2GCN [Zhu and Koniusz, 2021], JacobiConv [Wang and Zhang, 2022], MidGCN [Huang et al., 2023], GWRNN [Nikolentzos and Vazirgiannis, 2023], Co-GNN [Finkelshtein et al., 2024], LASER [Barbero et al., 2024], GNN-VPA [Schneckenreiter et al., 2024], CGP [Wilson et al., 2025], GKNN-WL, and GKNN-GL [Cosmo et al., 2025]. For DGCNN, DiffPool, ECC, GIN, and GraphSAGE, we adopt the results from [Errica et al., 2020] or evaluate them under the same experimental settings for datasets not originally reported. For S2GCN [Zhu and Koniusz, 2021], JacobiConv [Wang and Zhang, 2022], and MidGCN [Huang et al., 2023], we reimplement the models under the same experimental settings for fair comparison. For the remaining methods, we report results as presented in their original publications.
1 https://github.com/Xiaoqin0421/QS-GCN
| Method | MUTAG | PTC MR | PROTEINS | DD | IMDB-B | IMDB-M | REDB |
|---|---|---|---|---|---|---|---|
| QS-GCN (Ours) | 90.91±0.61 | 63.42±1.42 | 75.15±0.21 | 77.33±0.29 | 73.46±1.40 | 48.78±0.64 | 88.76±0.20 |
| DGCNN (2019) | 84.0±6.7 | 58.3±7.0 | 72.9±3.5 | 76.6±4.3 | 69.2±3.0 | 45.6±3.4 | 87.8±2.5 |
| DiffPool (2018) | 79.8±7.1 | 60.8±7.0 | 73.7±3.5 | 75.0±3.5 | 68.4±3.3 | 45.6±3.4 | 89.4±1.6 |
| ECC (2017) | 75.4±6.2 | 55.7±3.3 | 72.3±3.4 | 72.69±4.1 | 67.7±2.8 | 43.5±3.1 | - |
| GIN (2019) | 84.7±6.7 | 58.8±5.5 | 73.3±4.0 | 75.3±2.9 | 71.2±3.9 | 48.5±3.3 | 89.9±1.9 |
| GraphSAGE (2017) | 83.6±9.6 | 60.1±4.7 | 73.0±4.5 | 72.9±2.0 | 68.8±4.5 | 47.6±3.5 | 84.3±1.9 |
| S2GCN (2021) | 75.29 | 59.76 | 69.97 | 64.43 | 67.78 | 46.81 | 70.80 |
| JacobiConv (2022) | 85.52 | 58.61 | 63.30 | 68.46 | 67.10 | 39.39 | 67.45 |
| MidGCN (2023) | 81.92 | 59.95 | 70.67 | 69.06 | 66.60 | 46.57 | 74.10 |
| GWRNN (2023) | 83.4±5.6 | - | 74.9±3.5 | 75.6±4.6 | 72.8±4.2 | 49.0±2.9 | 90.0±1.8 |
| Co-GNN (2024) | - | - | 73.1±2.3 | - | 70.8±3.3 | 48.5±4.0 | 88.6±2.2 |
| LASER (2024) | 82.20 | - | 74.39 | - | 64.33 | - | 85.46 |
| GNN-VPA (2024) | 76.10 | 61.30 | 73.90 | - | 71.70 | 46.70 | 85.50 |
| CGP (2025) | 83.75 | - | 73.04 | - | 56.20 | - | 67.05 |
| GKNN-WL (2025) | 85.73±2.70 | 58.29±2.54 | 74.94±1.10 | - | 69.70±2.20 | 47.87±1.78 | - |
| GKNN-GL (2025) | 85.24±2.28 | 60.13±1.94 | 75.36±1.12 | - | 69.90±1.44 | 45.67±1.22 | - |
Table 3 and 5 report the classification accuracy and standard error on each dataset. Overall, QS-GCN achieves the best or highly competitive performance on most benchmarks, demonstrating its effectiveness for graph classification. This advantage mainly stems from two aspects. First, the QSConv employs a learnable quadratic spectral polynomial filter that captures information across different frequency bands, enhancing spectral expressiveness, while the limited 2-hop propagation helps alleviate OSQ. Second, the alignmentbased readout module performs structured cluster alignment and aggregation, effectively integrating local node features with global graph structure to improve discriminative capability. To provide spatial interpretability, Figure 2 illustrates the attention weights assigned by a 3-layer QS-GCN to multi-hop neighbors of a central node on a sample graph from the MUTAG dataset. The results show that the proposed QS-GCN can dynamically adjust the importance of multi-hop information across layers.
Analysis of Over-Smoothing (OSM). To quantify the diversity of graph representations, we adopt the Average Cosine Distance (AD) as the evaluation metric. Given a graph-level representation matrix H ∈ RN×d , the AD value is defined as
where Hi and Hj denote the embeddings of the i-th and jth graphs. A higher AD value indicates greater representation diversity and thus reduced OSM. To examine robustness to network depth, we compare QS-GCN with GCN, GIN, and GraphSAGE on four representative datasets, varying the number of layers over {2, 4, 8, 16, 32, 64}. Both classification accuracy and AD are reported in Figures 3. As depth increases, QS-GCN exhibits significantly less performance degradation and consistently maintains higher AD values, whereas the baselines suffer sharp AD drops, indicating severe OSM. These results show that QS-GCN effectively alleviates OSM and remains robust under increased depth.

| Method | MUTAG | PROTEINS | IMDB B | REDB |
|---|---|---|---|---|
| QS-GCN | 90.91±0.61 | 75.15±0.21 | 73.46±1.40 | 88.76±0.20 |
| FA | 83.45±1.74 | 72.30±0.67 | 71.48±0.88 | 90.22±0.48 |
| SDRF | 82.70±1.78 | 70.92±0.79 | 70.21±0.81 | 86.83±0.52 |
| FoSR | 86.15±1.49 | 75.25±0.86 | 71.96±0.69 | 90.94±0.47 |
| GTR | 86.10±1.76 | 75.78±0.76 | 71.49±0.93 | 90.41±0.41 |
Analysis of Over-Squashing (OSQ). We evaluate the effectiveness of QS-GCN in mitigating the over-squashing problem by comparing our method with several GNNs specifically designed to address OSQ, including FA [Alon and Yahav, 2021], SDRF [Topping et al., 2022], FoSR [Karhadkar et al., 2023], and GTR [Black et al., 2023], and report the results as presented in their original papers. As summarized in Table 6, QS-GCN achieves competitive performance among these methods, suggesting its effectiveness in alleviating OSQ while preserving strong predictive capability.

| k | Readout | MUTAG | PTC MR | PROTEINS | IMDB-B |
|---|---|---|---|---|---|
| 1 | Align | 85.58 | 60.55 | 74.57 | 71.30 |
| 1 | Avg | 83.15 | 59.17 | 73.13 | 69.40 |
| 2 | Align | 89.33 | 63.42 | 75.15 | 73.46 |
| 2 | Avg | 86.63 | 55.81 | 71.78 | 71.80 |
| 3 | Align | 82.89 | 61.92 | 74.21 | 73.26 |
| 3 | Avg | 82.15 | 60.94 | 70.25 | 70.60 |
Ablation Study on Alignment-based Readout. To further isolate the contribution of the alignment-based readout module, we replace it with a standard average readout and evaluate both variants on MUTAG, PTC MR, PROTEINS, and IMDB-B under different polynomial orders. The results are reported in Table 7. A consistent trend is observed across all datasets: regardless of the readout strategy, the performance first improves and then declines as k increases, with the best results consistently achieved at k = 2. This suggests that the spectral design governed by the quadratic polynomial plays the dominant role in balancing OSM and OSQ. Moreover, under the same polynomial order, the alignment-based readout consistently outperforms average readout, indicating its effectiveness in further enhancing graph-level representation learning through more discriminative structural preservation.
Computational Complexity. Finally, we analyze the computational complexity of QS-GCN. Let n denote the number of nodes, m the number of edges, d the feature dimension, s the number of clusters, l the number of layers, and k the polynomial order. Under a recursive propagation-based implementation, the QS-Conv requires O(kmdl) complexity. The readout module aligns node representations into s clusters followed by MLP aggregation, with complexity O(nds). Therefore, the overall complexity of QS-GCN is O(kmdl + nds), which scales approximately linearly with k when other hyperparameters are fixed. To validate this analysis, we further measure runtime per epoch and GPU memory usage under different polynomial orders on the MUTAG dataset. As summarized in Table 8, the empirical results confirm the predicted scaling behavior, showing that increasing k introduces only moderate computational overhead.
| k | 0 | 1 | 2 | 3 | 4 | 5 |
|---|---|---|---|---|---|---|
| Memory (MB) | 362 | 368 | 370 | 372 | 373 | 374 |
| Runtime (ms) | 5.2 | 9.8 | 11.4 | 14.3 | 16.9 | 18.2 |
7 Conclusion
This work investigates the phenomena of OSM and OSQ in GNNs from a unified spectral-spatial perspective. We first develop a unified spectral-spatial framework for analyzing polynomial graph convolution, providing a principled understanding of how the polynomial order k jointly affects spectral filtering and spatial information propagation. Based on this framework, we reveal an intrinsic trade-off induced by k, where higher-order filters enhance spectral expressiveness and help alleviate OSM, while simultaneously expanding the receptive field and exacerbating information compression, thereby intensifying OSQ. Motivated by this insight, we propose the QS-GCN, which achieves an effective balance between these two phenomena. Extensive experiments validate both our theoretical analysis and the effectiveness of the proposed model. Future work will explore more principled and generalizable metrics for quantifying OSQ, as well as adaptive, data-dependent selection of the polynomial order k to further improve the balance between OSM and OSQ.
Acknowledgements
This work is supported by National Natural Science Foundation of China (No. 62576371, 62576198, and 62536006), and the Open Project Foundation of Key Laboratory of Computation Intelligence and Chinese Information Processing of Ministry of Education and Key Laboratory of Data Intelligence and Cognitive Computing of Shanxi Province.
@inproceedings{ijcai2026p330,
title = {A Unified Spectral-Spatial Framework for GNNs: Balancing Over-Smoothing and Over-Squashing},
author = {Qin, Xinya and Bai, Lu and Cui, Lixin and Li, Ming and Du, Hangyuan and Li, Jing},
booktitle = {Proceedings of the Thirty-Fifth International Joint Conference on
Artificial Intelligence, {IJCAI-26}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Diego Calvanese},
pages = {2969--2978},
year = {2026},
month = {8},
note = {Main Track},
doi = {10.24963/ijcai.2026/330},
url = {https://doi.org/10.24963/ijcai.2026/330},
}
TY - CPAPER TI - A Unified Spectral-Spatial Framework for GNNs: Balancing Over-Smoothing and Over-Squashing AU - Qin, Xinya AU - Bai, Lu AU - Cui, Lixin AU - Li, Ming AU - Du, Hangyuan AU - Li, Jing T2 - Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-26 PB - International Joint Conferences on Artificial Intelligence Organization PY - 2026 SP - 2969 EP - 2978 DO - 10.24963/ijcai.2026/330 UR - https://doi.org/10.24963/ijcai.2026/330 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: