DASFL: Dynamic Adaptive Split Federated Learning for Heterogeneous Clients
Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 4483-4491.
https://doi.org/10.24963/ijcai.2026/499
© 2026 International Joint Conferences on Artificial Intelligence
Keywords
- Machine Learning: Federated learning
Abstract
Split Federated Learning (SFL) has emerged as a pivotal paradigm for privacy-preserving distributed training on resource-constrained edge devices by partitioning neural networks between clients and a server. A critical design choice in SFL is the split layer, which determines the computation distribution and the semantic level of smashed data, directly impacting communication overhead, training latency, and model accuracy.
Existing SFL methods largely ignore the time-varying nature of edge resources, relying on static resource profiles that lead to suboptimal efficiency and compromise model convergence.
In this paper, we propose Dynamic Adaptive Split Federated Learning (DASFL), a unified framework that jointly addresses dynamic resource heterogeneity and non-IID data distributions.
We employ a resource-aware dynamic split layer selection strategy that enables each client to minimize per-round latency by adapting to instantaneous local conditions. We also design an adaptive masked aggregation that robustly synchronizes client updates under split-induced structural heterogeneity.
Extensive experiments on multiple benchmark models and datasets, conducted under heterogeneous, time-varying resource conditions and non-IID data distributions, demonstrate that DASFL achieves a superior accuracy-efficiency trade-off and faster convergence compared to state-of-the-art SFL baselines.
- [Arafeh et al., 2025] Mohamad Arafeh, Mohamad Wazzeh, Hani Sami, Hakima Ould-Slimane, Chamseddine Talhi, Azzam Mourad, and Hadi Otrok. Efficient privacy- preserving ml for iot: Cluster-based split federated learn- ing scheme for non-iid data. Journal of Network and Com- puter Applications, 236:104105, 2025.
- [Chopra et al., 2021] Ayush Chopra, Surya Kant Sahu, Ab- hishek Singh, Abhinav Java, Praneeth Vepakomma, Vivek Sharma, and Ramesh Raskar. Adasplit: Adaptive trade- offs for resource-constrained distributed deep learning. arXiv preprint arXiv:2112.01637, 2021.
- [Dachille et al., 2025] Justin Dachille, Chao Huang, and Xin Liu. The impact of cut layer selection in split federated learning. arXiv preprint arXiv:2412.15536, 2025.
- [Fan et al., 2025] Wenhao Fan, Penghui Chen, Xiongfei Chun, and Yuan'an Liu. Madrl-based model partition- ing, aggregation control, and resource allocation for cloud- edge-device collaborative split federated learning. IEEE Transactions on Mobile Computing, 24(6):5324-5341, 2025.
- [Gecer and Garbinato, 2024] Melike Gecer and Benoit Garbinato. Federated learning for mobility applications. ACM Computing Surveys, 56(5):1-28, 2024.
- [Gupta and Raskar, 2018] Otkrist Gupta and Ramesh Raskar. Distributed learning of deep neural network over multiple agents. Journal of Network and Computer Applications, 116:1-8, 2018.
- [Han et al., 2024] Pengchao Han, Chao Huang, Geng Tian, Ming Tang, and Xin Liu. Convergence analysis of split federated learning on heterogeneous data. Advances in Neural Information Processing Systems, 37:103476- 103544, 2024.
- [He et al., 2016] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770-778, 2016.
- [Hsu et al., 2019] Tzu-Ming Harry Hsu, Hang Qi, and Matthew Brown. Measuring the effects of non-identical data distribution for federated visual classification. arXiv preprint arXiv:1909.06335, 2019.
- [Hu et al., 2025] Zhanyi Hu, Tianchen Zhou, Bingzhe Wu, Cen Chen, and Yanhao Wang. A review and experimen- tal evaluation on split learning. Future Internet, 17(2):87, 2025.
- [Jamil et al., 2022] Sonain Jamil, MuhibUr Rahman, and Fawad. A comprehensive survey of digital twins and fed- erated learning for industrial internet of things (iiot), inter- net of vehicles (iov) and internet of drones (iod). Applied System Innovation, 5(3):56, 2022.
- [Joshi et al., 2022] Praveen Joshi, Chandra Thapa, Seyit Camtepe, Mohammed Hasanuzzaman, Ted Scully, and Haithem Afli. Performance and information leakage in splitfed learning and multi-head split learning in health- care data and beyond. Methods and Protocols, 5(4):60, 2022.
- [Kairouz et al., 2021] Peter Kairouz, H. Brendan McMahan, Brendan Avent, et al. Advances and open problems in federated learning. Foundations and Trends® in Machine Learning, 14(1-2):1-210, 2021.
- [Khan et al., 2023] Latif U Khan, Mohsen Guizani, Ala Al- Fuqaha, Choong Seon Hong, Dusit Niyato, and Zhu Han. A joint communication and learning framework for hier- archical split federated learning. IEEE Internet of Things Journal, 11(1):268-282, 2023.
- [Krizhevsky et al., 2009] Alex Krizhevsky, Geoffrey Hinton, et al. Learning multiple layers of features from tiny im- ages. 2009.
- [LeCun et al., 1998] Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. Gradient-based learning ap- plied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
- [Li et al., 2020] Tian Li, Anit Kumar Sahu, Ameet Tal- walkar, and Virginia Smith. Federated learning: Chal- lenges, methods, and future directions. IEEE signal pro- cessing magazine, 37(3):50-60, 2020.
- [Li et al., 2021] Ang Li, Jingwei Sun, Xiao Zeng, Mi Zhang, Hai Li, and Yiran Chen. Fedmask: Joint computation and communication-efficient personalized federated learn- ing via heterogeneous masking. In Proceedings of the 19th ACM conference on embedded networked sensor systems, pages 42-55, 2021.
- [Lin et al., 2018] Yujun Lin, Song Han, Huizi Mao, Yu Wang, and William J. Dally. Deep gradient com- pression: Reducing the communication bandwidth for dis- tributed training. In International Conference on Learning Representations (ICLR), 2018.
- [Lin et al., 2024a] Zheng Lin, Guanqiao Qu, Xianhao Chen, and Kaibin Huang. Split learning in 6g edge networks. IEEE Wireless Communications, 31(4):170-176, 2024.
- [Lin et al., 2024b] Zheng Lin, Guangyu Zhu, Yiqin Deng, Xianhao Chen, Yue Gao, Kaibin Huang, and Yuguang Fang. Efficient parallel split learning over resource- constrained wireless edge networks. IEEE Transactions on Mobile Computing, 23(10):9224-9239, 2024.
- [Lin et al., 2025a] Zheng Lin, Guanqiao Qu, Wei Wei, Xi- anhao Chen, and Kin K Leung. Adaptsfl: Adaptive split federated learning in resource-constrained edge networks. IEEE Transactions on Networking, 2025.
- [Lin et al., 2025b] Zheng Lin, Wei Wei, Zhe Chen, Chan- Tong Lam, Xianhao Chen, Yue Gao, and Jun Luo. Hi- erarchical split federated learning: Convergence analysis and system optimization. IEEE Transactions on Mobile Computing, 2025.
- [Liu et al., 2024] Hou-I Liu, Marco Galindo, Hongxia Xie, Lai-Kuan Wong, Hong-Han Shuai, Yung-Hui Li, and Wen- Huang Cheng. Lightweight deep learning for resource- constrained environments: A survey. ACM Computing Surveys, 56(10):1-42, 2024.
- [Ma et al., 2023] Jing Ma, Lv Xixiang, Yong Yu, and Stephan Sigg. Ppsfl: Privacy-preserving split federated learning via functional encryption. Authorea Preprints, 2023.
- [McMahan et al., 2017] Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Ar- cas. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, pages 1273-1282. PMLR, 2017.
- [Oh et al., 2025] Yongjeong Oh, Jaeho Lee, Christopher G Brinton, and Yo-Seb Jeon. Communication-efficient split learning via adaptive feature-wise compression. IEEE Transactions on Neural Networks and Learning Systems, 2025.
- [Shen et al., 2023] Jinglong Shen, Nan Cheng, Xiucheng Wang, Feng Lyu, Wenchao Xu, Zhi Liu, Khalid Al- dubaikhy, and Xuemin Shen. Ringsfl: An adaptive split federated learning towards taming client heterogeneity. IEEE Transactions on Mobile Computing, 23(5):5462- 5478, 2023.
- [Thapa et al., 2022] Chandra Thapa, Pathum Chamikara Mahawaga Arachchige, Seyit Camtepe, and Lichao Sun. Splitfed: When federated learning meets split learning. In Proceedings of the AAAI conference on artificial intelligence, volume 36, pages 8485-8493, 2022.
- [Uzzaman, 2025] Arfan Uzzaman. Federated learning- driven real-time disease surveillance for smart hospitals using multi-source heterogeneous healthcare data. ASRC Procedia: Global Perspectives in Science and Scholar- ship, 1(01):1390-1423, 2025.
- [Vepakomma et al., 2018] Praneeth Vepakomma, Otkrist Gupta, Tristan Swedish, and Ramesh Raskar. Split learn- ing for health: Distributed deep learning without sharing raw patient data. arXiv preprint arXiv:1812.00564, 2018.
- [Wu et al., 2023] Wen Wu, Mushu Li, Kaige Qu, Conghao Zhou, Xuemin Shen, Weihua Zhuang, Xu Li, and Weisen Shi. Split learning over wireless networks: Parallel de- sign and resource management. IEEE Journal on Selected Areas in Communications, 41(4):1051-1066, 2023.
- [Xiao et al., 2017] Han Xiao, Kashif Rasul, and Roland Vollgraf. Fashion-mnist: a novel image dataset for bench- marking machine learning algorithms. arXiv preprint arXiv:1708.07747, 2017.
- [Zhang et al., 2023] Zongshun Zhang, Andrea Pinto, Valeria Turina, Flavio Esposito, and Ibrahim Matta. Privacy and efficiency of communications in federated split learning. IEEE Transactions on Big Data, 9(5):1380-1391, 2023.
- [Zhang et al., 2024] Mingjin Zhang, Jiannong Cao, Yuvraj Sahni, Xiangchun Chen, and Shan Jiang. Resource- efficient parallel split learning in heterogeneous edge com- puting. In 2024 International Conference on Computing, Networking and Communications (ICNC), pages 794-798. IEEE Computer Society, 2024.
- [Zhu et al., 2021] Hangyu Zhu, Jinjin Xu, Shiqing Liu, and Yaochu Jin. Federated learning on non-iid data: A survey. Neurocomputing, 465:371-390, 2021.
- [Zhu et al., 2024] Guangyu Zhu, Yiqin Deng, Xianhao Chen, Haixia Zhang, Yuguang Fang, and Tan F Wong. Esfl: Efficient split federated learning over resource- constrained heterogeneous wireless devices. IEEE Inter- net of Things Journal, 11(16):27153-27166, 2024.
References were extracted automatically from the PDF and may contain errors.
Full text extracted automatically from the PDF; figures, tables and equations may differ. The PDF is the version of record.
1 Introduction
With the rapid deployment of deep neural networks on edge intelligence applications, collaborative model training under strict privacy and resource constraints has become a fundamental challenge [Kairouz et al., 2021; Liu et al., 2024]. In practice, data are generated and retained on geographically distributed edge devices with highly heterogeneous and time-varying computation capabilities and communication bandwidths, such as in mobile perception [Gecer and Garbinato, 2024], smart surveillance [Uzzaman, 2025], and Internet of Vehicles (IoV) [Jamil et al., 2022]. Federated learning (FL) [McMahan et al., 2017; Li et al., 2020] enables privacy-preserving collaborative training by keeping raw data on device. However, FL requires all clients to repeatedly train the full model, which becomes increasingly impractical as modern deep networks grow in depth and complexity. Under heterogeneous and time-varying system conditions, computation-limited clients frequently become stragglers, severely degrading training efficiency. Split learning (SL) [Gupta and Raskar, 2018; Vepakomma et al., 2018; Lin et al., 2024a] alleviates this issue by partitioning a model across the client-server boundary, allowing clients to offload deep computation to the server. Despite reduced client-side computation, SL typically relies on sequential client updates, limiting scalability in multi-client settings.
∗Corresponding author
Split federated learning (SFL) [Thapa et al., 2022] combines the advantages of FL and SL by enabling parallel multiclient training while offloading part of the model computation to the server. A critical design choice in SFL is the selection of the split layer [Wu et al., 2023; Hu et al., 2025], which governs both the distribution of computation and the representation level of exchanged smashed data (i.e., intermediate activations). Shallow splits incur high communication overhead due to large low-level feature maps [Dachille et al., 2025], whereas deeper splits reduce communication cost at the expense of increased client-side computation, directly affecting end-to-end training latency and system efficiency. Beyond efficiency, split layer selection also shapes learning behavior by exposing the server to different representation spaces [Joshi et al., 2022], leading to distinct optimization trajectories and generalization properties. Importantly, system heterogeneity is often coupled with data heterogeneity, as devices with different resource profiles typically collect data from diverse and skewed distributions. Under such non-IID settings, split layer choices induce distinct inductive biases and convergence behaviors [Arafeh et al., 2025], making learning performance highly sensitive to how computation is partitioned.
Despite these impacts, existing SFL methods predominantly rely on static split configurations. Uniform split strategies implicitly assume homogeneous client capabilities [Thapa et al., 2022; Chopra et al., 2021], while heterogeneous but fixed splits [Zhang et al., 2024; Zhu et al., 2024; Shen et al., 2023] fail to adapt to time-varying computation and communication conditions. As a result, static split decisions lead to inefficient and suboptimal training in dynamic edge environments, motivating dynamic split layer selection as a natural solution for improving system efficiency. However, dynamic split selection introduces a largely overlooked challenge: structural heterogeneity. As clients adopt different split layers over time, they update different subsets of model parameters, causing local updates to become misaligned in the parameter space. This breaks the assumptions of conventional federated aggregation methods and can severely harm learning stability and accuracy, especially under non-IID data distributions [Zhu et al., 2021].
These observations reveal two tightly coupled challenges in dynamic SFL: (i) how to adapt split decisions to heterogeneous and time-varying resources to improve training efficiency, and (ii) how to robustly aggregate structurally heterogeneous updates under non-IID data to preserve model accuracy and convergence.
To address these challenges, we propose Dynamic Adaptive Split Federated Learning (DASFL), a unified framework for efficient SFL under dynamic resource heterogeneity and non-IID data distributions. For Challenge (i), we propose a resource-aware dynamic split layer selection strategy, which enables each client to adaptively select its split layer at every communication round based on instantaneous computation and communication conditions. This strategy minimizes per-round training latency and mitigates straggler effects. For Challenge (ii), We propose an adaptive masked federated aggregation mechanism that robustly aggregates client updates, mitigating aggregation interference caused by non-IID data and heterogeneous local models. Extensive experiments on multiple models and datasets demonstrate that DASFL consistently outperforms SFL baselines in both accuracy and end-to-end training latency.
Our main contributions are summarized as follows:
- We propose a resource-aware dynamic split layer selection strategy that enables clients to adapt split decisions to heterogeneous and time-varying computation and bandwidth resources, significantly improving training efficiency in SFL.
- We design an adaptive mask-based aggregation mechanism that supports robust aggregation under non-IID data distributions and split-induced structural heterogeneity, by selectively aggregating informative clientside updates while suppressing misaligned parameters.
- We develop a unified DASFL framework that tightly couples dynamic system-aware split adaptation with learning-aware aggregation, achieving stable convergence and superior accuracy-efficiency trade-offs under realistic edge heterogeneity.
2 RelatedWork
Existing SFL approaches primarily aim to improve scalability, communication efficiency, and privacy preservation, while typically adopting a fixed split layer across all clients and communication rounds. SplitFed [Thapa et al., 2022] extends classical SL by incorporating federated averaging for both client-side and server-side sub-models, enabling parallel training while maintaining global model consistency. Subsequent efforts improve SFL from several directions, including efficient parallelization and gradient reduction [Lin et al., 2024b], privacy-preserving activation sharing [Ma et al., 2023], communication compression [Oh et al., 2025], and hierarchical edge-assisted training [Khan et al., 2023; Fan et al., 2025]. communication-privacy trade-off in [Zhang et al., 2023]. Despite these advances, most existing SFL methods rely on static split configurations and implicitly assume homogeneous system resources, limiting their applicability in dynamic and resource-constrained environments.
Heterogeneity is a fundamental challenge in SFL, encompassing both system heterogeneity due to diverse device capabilities and statistical heterogeneity arising from non-IID data distributions [Kairouz et al., 2021]. From a theoretical perspective, the convergence behavior of SFL under heterogeneous data distributions has been formally analyzed in [Han et al., 2024; Lin et al., 2025b], providing important insights into the stability of SFL optimization. To address system heterogeneity in SFL, AdaptSFL [Lin et al., 2025a] allows clients with different capabilities to adopt different split layers, while EdgeSplit [Zhang et al., 2024] and ESFL [Zhu et al., 2024] optimize model partitioning and resource allocation through joint optimization formulations. From the aggregation perspective, sparse or selective update mechanisms have been explored to reduce communication and suppress noisy updates, such as Deep Gradient Compression [Lin et al., 2018] and FedMask [Li et al., 2021].While most existing approaches consider client heterogeneity, they typically assume static resource conditions and aligned model structures, overlooking the non-stationary nature of computation and communication resources in practical edge environments.
3 Methodology
We propose Dynamic Adaptive Split Federated Learning (DASFL), a unified framework that enables efficient and robust SFL under dynamic system heterogeneity and non-IID data distributions. DASFL consists of three tightly coupled components: (1) Resource-aware dynamic split layer selection, where each client adaptively chooses its split layer at every round based on instantaneous computation and communication resources; (2) Split learning under structurally heterogeneous local models, where clients and the main server collaboratively train different subsets of model parameters according to the selected split layers; and (3) Adaptive masked federated aggregation, tightly integrated with the split learning process, where informative client-side updates are selectively aggregated on the federated server. The overall training procedure is summarized in Figure 1 and Algorithm 1.
3.1 ProblemDefinition
We consider split federated learning (SFL) with heterogeneous clients K = {1, . . . ,K} under non-IID data. Client k owns a private dataset Dk and never shares raw data. We adopt a dual-server architecture with a Main Server (MS) executing SL on the server-side sub-model, and a Federated Server (FS) aggregating masked client-side updates. Given a candidate split layer l ∈ L, the model is partitioned into f (l) c (·; θc) and f (l) s (·; θs). At round t, client k selects ltk ∈ L, inducing structural heterogeneity where clients update different parameter subsets. We aim to optimize θ = {θc, θs} by minimizing the aggregated empirical risk:

Dynamic split ltk affects which layers participate in SFL and aggregation at each round, but not the objective itself.
3.2 Resource-aware Dynamic Split Layer Selection
Dynamic system heterogeneity makes a fixed split point suboptimal: a shallow split reduces client computation but increases smashed-data traffic, while a deep split does the opposite. To adapt to time-varying resources, DASFL performs per-round, per-client split-point selection. Specifically, each client estimates the round latency of every candidate split layer by combining (i) client-side training compute time determined by the partitioned sub-model and its instantaneous compute capability, and (ii) communication time including smashed-data exchange with the MS and masked-update with the FS. The client then selects the split layer that minimizes the estimated latency in Eq. (6), enabling decentralized adaptation without extra coordination.
Resource State Model. Each client k has maximum compute capacity C max k and uplink budget Bmax k . At round t, its effective compute is
where ρcpu k,t ∈ [0, 1] is CPU utilization, and available uplink bandwidth is bk,t ≤ Bmax k .
Computation Time Estimation. Let MACFP c (l) be the MACs for one forward pass of f (l) c . We approximate persample training cost as
with γ ≈ 2. Let nk be the number of samples processed per round by client k (e.g., nk = E·batch size). Then
We omit MS computation time, assuming it is stable and dominated by edge-side latency.
Communication Time Estimation. In SFL, communication includes SL smashed-data exchange between client and MS and masked-update upload and client-model broadcast between client and FS.
For split layer l, SL requires bidirectional transfer of smashed data and gradients, modeled as 2Sizeact(l) per round. FS-side aggregation traffic is denoted by Sizeparam(l), representing the actual per-round upload+download volume (dense zero-masked tensor or sparse index-value pairs with index overhead). Using the uplink-dominant approximation with effective bandwidth bk,t, we estimate
Dynamic Split Layer Selection. By jointly considering computation and communication costs, client k selects its split layer at round t by minimizing the estimated latency:
where β1 and β2 are weighting coefficients that balance computation and communication overheads. This lightweight decision rule enables each client to adapt its split layer to heterogeneous and time-varying resource conditions without introducing additional learning or coordination overhead. We set β1 = β2 = 1 by default.
3.3 Split Learning Training and Adaptive Masked Federated Aggregation
We describe the training and aggregation procedure of DASFL under dynamically selected split layers, which naturally induce structurally heterogeneous local models across clients.
Algorithm 1 DASFL Under One Federated Round
Input: Client set K; candidate split layer set L; initial clientside and server-side parameters θt-1 c , θt-1 s
Output: Updated θtc , θts
- 1: for all clients k ∈ K in parallel do
- 2: Sense instantaneous resources and select split layer ltk using Eq. (6)
- 3: Client→MS (SL FP): perform client-side FP up to layer ltk and compute smashed data atk
- 4: Transmit atk to the MS
- 5: end for
- 6: for all received atk from clients k ∈ K do
- 7: MS-side SL: perform server-side FP and BP
- 8: MS→Client (SL BP): return ∇atk to client k
- 9: end for
- 10: for all clients k ∈ K in parallel do
- 11: Complete BP on the client-side sub-model and update local client-side parameters
- 12: Compute local client-side update ∆θtk (w.r.t. θt-1 c )
- 13: Generate maskmtk using Eqs. (7)-(8)
- 14: Obtain masked update ˜ ∆θtk using Eq. (9)
- 15: Client→FS: upload ˜ ∆θtk
- 16: end for
- 17: FS aggregation: update client-side global parameters θtc using Eq. (10)
- 18: MS aggregation: synchronize server-side parameters θts on the MS (FedAvg over shared server-side layers)
- 19: FS→Clients: broadcast updated client-side parameters θtc to all clients
Split Learning under Structurally Heterogeneous Local Models. At communication round t, client k selects a split layer ltk and performs SL collaboratively with the MS, which hosts the server-side sub-model. Specifically, client k executes FP on its local sub-model up to layer ltk to compute the smashed data atk = f (ltk ) c (x; θc), and transmits them to the MS. Upon receiving atk , the MS completes the remaining forward propagation using the server-side sub-model, computes the training loss ˆ y = f (ltk ) s (atk ; θs), and performs backward propagation. The gradient ∇atk with respect to the smashed data is then returned to client k. Client k completes backpropagation through its client-side sub-model and updates the corresponding local parameters. Since different clients may select different split layers at each round, only a subset of the global model parameters is updated by each client, resulting in structurally heterogeneous local models.
Adaptive Masked Local Updates. To address non-IID data distributions and structural heterogeneity induced by dynamic split layers, each client generates adaptive masked local updates before federated aggregation. At round t, client k computes its local update ∆θtc,k = θtc,k - θt-1 c . Let Ltk denote the set of effective layers updated by client k and Nℓ the number of parameters in layer ℓ ∈ Ltk . Given a base keep ratio α, we allocate the update budget evenly across effective layers to avoid large layers dominating the retained updates and to ensure that each effective layer contributes to aggregation. The per-layer budget is
Accordingly, smaller layers have higher effective keep ratios, while larger layers are more aggressively subsampled. This design prioritizes balanced cross-layer participation rather than proportional per-layer retention. To avoid extreme imbalance, the layer-specific keep ratio rℓ = Kℓ/Nℓ is clipped to [rmin, rmax]. For each layer, a quantile-based threshold εtℓ is determined such that approximately a fraction rℓ of parameters is retained. The resulting binary mask is constructed as
and the masked local update is given by
Eq. (9) is the only operation that applies masking to the update values, i.e., unselected entries are set to zero (or omitted under sparse transmission).
Masked Federated Aggregation. After local training and adaptive masking, clients upload their masked client-side updates ˜ ∆θtc,k to the federated server (FS) for global aggregation. Since different clients may update different subsets of parameters due to dynamic split layers, the FS performs coordinate-wise normalized aggregation: each parameter is averaged only over clients that actually updated it in the current round. Recall that ˜ ∆θtc,k,i = mtk,i∆θtc,k,i ; thus mtk,i in the denominator only counts effective contributors for coordinate i. Concretely, the FS updates each client-side parameter θtc,i by
where wk is proportional to the local dataset size of client k, and ε is a small constant for numerical stability. Note that mtk,i in the denominator does not apply a second masking to the update. Instead, it identifies the set of effective contributors for coordinate i in round t so that the update is normalized by the total weight of clients that participated in updating that coordinate. Client-side parameters not updated by any client (i.e., ∑Kk=1 mtk,i = 0) remain unchanged.
When sparse upload is adopted, the binary mask mtk need not be transmitted explicitly. Client k uploads index-value pairs for the retained coordinates
S tk = {i : mtk,i = 1}. The FS reconstructs ∑k mtk,iwk in Eq. (10) by accumulating weights over received indices, making the aggregation exactly consistent with the sparsified communication protocol.
3.4 Convergence Analysis
We further provide a convergence analysis (Appendix A) showing that DASFL admits a standard stationarity guarantee under smoothness, with additional error terms that depend on the masking ratio and the update coverage under dynamic split.
4 Experiments
4.1 Experiment Settings
Models and Datasets. We evaluate DASFL on three representative models and datasets: LeNet [LeCun et al., 1998] on Fashion-MNIST [Xiao et al., 2017], ResNet-18 on CIFAR-10, and ResNet-50 on CIFAR-100 [He et al., 2016; Krizhevsky et al., 2009]. These configurations cover lightweight to deep architectures and varying task complexity.
Baselines. We compare DASFL with representative methods from federated learning, split learning, and heterogeneity-aware split federated learning. (1) FL [McMahan et al., 2017]: standard federated learning with full-model local training and FedAvg aggregation. (2) SL [Gupta and Raskar, 2018]: split learning with a fixed split layer and sequential client updates. (3) SFL [Thapa et al., 2022]: parallel split learning with federated aggregation. For SL and SFL, we evaluate a shallow split (l = s) that minimizes client-side computation, and a middle split (l = m) that balances computation and communication costs. We further compare with heterogeneous SFL methods. (4) EdgeSplit [Zhang et al., 2024], (5) ESFL [Zhu et al., 2024], and (6) AdaptSFL [Lin et al., 2025a].
Metrics. We report average test accuracy to evaluate learning performance and round latency to measure system efficiency. The per-round completion time is defined as the makespan T round = maxk∈Kt (T comp k,t +T comm k,t ). In addition, we report the average per-client computation and communication times Tcomp = 1 T ∑Tt=1 1 |Kt | ∑k∈Kt T comp k,t and Tcomm = 1 T ∑Tt=1 1 |Kt | ∑k∈Kt T comm k,t . These averages characterize typical client costs and are not intended to sum to T round .
Data Heterogeneity. We evaluate both IID and non-IID data distributions across clients. Non-IID partitions are generated using a Dirichlet distribution [Hsu et al., 2019], with α = 0.5 and α = 0.1 representing moderate and severe data heterogeneity, respectively.
System Heterogeneity. We emulate heterogeneous and time-varying edge environments by modeling client-side computation and uplink bandwidth variability. Clients exhibit diverse compute and network capabilities, and their resource availability fluctuates over training rounds to reflect realistic background workloads and wireless dynamics. We consider heterogeneous clients with diverse computation and communication capabilities. Specifically, clients are grouped into three computation tiers (low, medium, and high) and two network conditions (poor and good), capturing practical deviceand network-level heterogeneity. Detailed resource models are provided in Appendix B.
Split Layer Configuration. We fix the candidate split layer set L across all methods to ensure fair comparison. For ResNet-18, candidate split layers are defined at the outputs of the four main residual stages: L = {conv2 x, conv3 x, conv4 x, conv5 x}, which correspond to increasing client-side model depths and progressively higher-level feature representations. This design provides a representative spectrum of computationcommunication trade-offs. For static SL and SFL baselines, we consider two commonly used configurations: a shallow split (l=s) at conv2 x, which minimizes client-side computation, and a middle split (l=m) at conv4 x, which balances computation and communication costs. The candidate split layer configurations for other models (LeNet and ResNet-50), together with their corresponding computation cost (MACs) and activation size profiling results, are provided in Appendix B. All split point profiles are obtained offline and used as lookup tables during training.
Parameter Settings. We consider a federated setting with 20 clients and a participation rate of 0.5 per round. Each selected client performs one local epoch before aggregation. Standard optimizers and learning rates are used for different models. Full hyperparameter settings and profiling details are provided in Appendix B.
4.2 Performance Analysis
Accuracy under Data Heterogeneity. Table 1 reports the final test accuracy under IID and non-IID data distributions. Overall, DASFL consistently outperforms all baselines across all model-dataset pairs. The performance gap becomes more pronounced as data heterogeneity increases. Under highly non-IID settings (Dirichlet α = 0.1), DASFL achieves up to 5.2-16.4 percentage points higher accuracy than staticsplit SFL and AdaptSFL, demonstrating strong robustness to severe data skew. In contrast, methods with fixed split configurations suffer from degraded convergence, as a single split layer cannot simultaneously accommodate heterogeneous clients and evolving system conditions.

Training Efficiency and Latency. Table 2 summarizes the training latency in terms of computation, communication, and per-round latency. Conventional FL incurs prohibitively high computation cost for deep models, while SL and static-split SFL exhibit strong sensitivity to the chosen split layer. Shallow splits amplify communication overhead, whereas deeper splits increase client-side computation and straggler effects. By dynamically adapting split layers to instantaneous resource conditions, DASFL achieves the lowest or near-lowest per-round latency in most settings, and is particularly advantageous for deeper models where FL becomes computeprohibitive, reducing round latency by up to 19.1-30.9% compared with static SFL baselines.
| Model-Dataset | LeNet-FMNIST | ResNet18-CIFAR10 | ResNet50-CIFAR100 | ||||||
|---|---|---|---|---|---|---|---|---|---|
| Dirichlet α | 10 | 0.5 | 0.1 | 10 | 0.5 | 0.1 | 10 | 0.5 | 0.1 |
| FL | 89.88±0.21 | 87.59±0.57 | 85.26±0.84 | 83.34±0.49 | 81.17±0.40 | 61.24±1.01 | 76.49±0.34 | 73.39±1.09 | 66.62±0.91 |
| SL(l=s) | 90.63±1.60 | 86.01±0.81 | 85.52±0.78 | 83.05±0.44 | 70.32±1.07 | 54.06±0.39 | 65.63±0.71 | 63.82±0.68 | 61.08±1.34 |
| SL(l=m) | 90.66±1.72 | 87.12±0.66 | 85.59±0.90 | 83.83±0.30 | 80.87±0.88 | 53.01±0.71 | 74.77±0.80 | 72.90±0.92 | 65.10±1.15 |
| SFL(l=s) | 88.89±0.83 | 80.74±1.55 | 75.70±1.04 | 77.90±0.62 | 77.72±0.94 | 58.02±1.20 | 76.14±0.54 | 73.03±1.69 | 56.09±1.41 |
| SFL(l=m) | 89.86±0.78 | 84.97±1.35 | 80.86±1.10 | 84.81±0.76 | 80.65±0.21 | 61.73±0.82 | 76.97±0.72 | 73.45±1.36 | 57.27±1.18 |
| EdgeSplit | 89.30±1.04 | 85.56±1.20 | 76.86±1.17 | 84.69±0.54 | 78.58±1.22 | 61.56±1.53 | 77.43±1.29 | 72.48±1.97 | 59.21±1.36 |
| ESFL | 87.67±1.34 | 84.88±1.12 | 77.98±1.45 | 83.47±0.94 | 80.62±1.63 | 56.78±1.77 | 75.81±1.71 | 71.63±1.92 | 58.30±1.69 |
| AdaptSFL | 89.44±1.32 | 87.97±1.41 | 70.28±1.32 | 84.18±0.56 | 81.28±1.76 | 50.48±1.72 | 77.98±1.79 | 74.04±1.39 | 53.25±1.87 |
| DASFL | 91.27±0.77 | 89.80±1.29 | 87.68±1.53 | 85.75±0.58 | 82.56±1.56 | 66.96±1.64 | 78.61±1.90 | 76.18±2.03 | 69.98±1.86 |
| Model-Dataset | LeNet-FMNIST | ResNet18-CIFAR10 | ResNet50-CIFAR100 | ||||||
|---|---|---|---|---|---|---|---|---|---|
| Latency(s) | Tcomp | Tcomm | T round | Tcomp | Tcomm | T round | Tcomp | Tcomm | T round |
| FL | 4.58 | 0.47 | 17.84 | 419.95 | 123.28 | 1744.74 | 1336.22 | 269.74 | 5376.28 |
| SL(l=s) | 0.53 | 53.43 | 275.60 | 162.86 | 219.50 | 1921.74 | 187.33 | 880.06 | 5428.39 |
| SL(l=m) | 1.11 | 15.86 | 86.71 | 232.29 | 120.63 | 1796.75 | 262.26 | 502.21 | 3889.30 |
| SFL(l=s) | 0.55 | 24.57 | 68.32 | 167.98 | 223.17 | 1040.79 | 190.89 | 894.79 | 3026.13 |
| SFL(l=m) | 1.14 | 16.19 | 51.43 | 236.70 | 122.65 | 1067.93 | 267.24 | 510.62 | 2062.73 |
| EdgeSplit | 1.20 | 10.91 | 37.08 | 233.33 | 107.84 | 1003.74 | 286.22 | 428.55 | 1913.91 |
| ESFL | 1.22 | 9.80 | 30.50 | 220.96 | 103.40 | 968.38 | 295.12 | 390.79 | 1838.96 |
| AdaptSFL | 1.19 | 10.38 | 26.21 | 219.12 | 106.27 | 913.05 | 281.17 | 421.36 | 1809.24 |
| DASFL | 0.70 | 12.06 | 21.74 | 210.13 | 89.83 | 738.24 | 330.42 | 365.91 | 1585.69 |
Dynamic Split Layer Behavior. Figure 2 shows that DASFL converges not to a fixed split layer, but to a resourceconditioned adaptation pattern. Figure 2(a) shows that split choices form structured regions in the CPU-bandwidth space: deeper splits are selected under favorable resource conditions, while shallower splits are preferred when computation or communication becomes constrained. Thus, similar resource conditions tend to induce similar split decisions. Figure 2(b) shows that no single split persistently dominates over rounds. The observed variation therefore reflects structured adaptation to heterogeneous and time-varying resources, rather than unstructured oscillation.
4.3 Ablation Study
We conduct ablation studies on ResNet-18 to analyze the individual contributions of adaptive masked aggregation and resource-aware dynamic split layer selection. The results are summarized in Table 3.
Impact of adaptive masked aggregation. We first fix the dynamic split layer selection mechanism and replace the proposed adaptive masked aggregation with three alternative aggregation strategies, denoted as DASFL-a. Full uploads both client-side and server-side sub-model parameters to the federated server, where a complete model is reconstructed and aggregated. Com aggregates only the common client-side parameters shared across all clients. Layer-wise performs layerlevel aggregation on client-side sub-models.
As shown in Table 3, all three variants result in inferior accuracy-latency trade-offs compared to DASFL, particularly under non-IID data distributions. The Full variant suffers from excessive communication overhead, leading to the largest per-round latency. In contrast, Comand Layer-wise reduce communication cost but fail to properly aggregate structurally heterogeneous updates, which significantly degrades accuracy under α = 0.5 and α = 0.1. These results show that conventional aggregation schemes are inadequate when dynamic split selection induces structural heterogeneity, highlighting the necessity of adaptive masked aggregation.
Impact of dynamic split layer selection. We next retain the adaptive masked aggregation mechanism and ablate the split layer selection strategy, denoted as DASFL-d. Uni enforces a unified split layer across all clients and rounds, while Random randomly selects a split layer at each round without considering system resources. Both variants underperform the full DASFL model. Specifically, Uni lacks the flexibility to accommodate heterogeneous and time-varying computation and communication resources, leading to suboptimal accuracy and latency. Random introduces uncoordinated split decisions, which destabilize training and yield inferior accuracy-efficiency trade-offs. In contrast, DASFL consistently achieves higher accuracy with lower per-round latency, demonstrating that resource-aware dynamic split layer selection is essential for robust and efficient SFL.
| Method | Variant | Test Accuracy | T round | ||
|---|---|---|---|---|---|
| α=10 | α=0.5 | α=0.1 | |||
| DASFL-a | Full | 85.86±0.65 | 82.79±0.83 | 65.76±1.46 | 2154.50 |
| Com | 84.59±0.60 | 76.08±0.87 | 55.17±1.26 | 713.10 | |
| Layer-wise | 84.78±0.92 | 79.23±1.09 | 59.44±1.27 | 816.88 | |
| DASFL-d | Uni | 84.38±0.97 | 81.20±1.18 | 61.98±2.13 | 1074.48 |
| Random | 85.21±0.93 | 81.67±1.37 | 62.11±2.29 | 1090.29 | |
| DASFL | - | 85.75±0.58 | 82.56±1.56 | 66.96±1.64 | 738.24 |
4.4 Hyperparameter Analysis
We analyze the sensitivity of DASFL to two key hyperparameters: the keep ratio rℓ used in adaptive masked aggregation and the weighting coefficients (β1, β2) controlling dynamic split layer selection.
Effect of keep ratio rℓ. Figure 3(a) shows the final test accuracy under different rℓ values for IID and non-IID data distributions. Under the IID setting (α = 10), model performance remains stable across a wide range of rℓ, indicating that parameter masking does not degrade accuracy when data are homogeneous. In contrast, under non-IID settings, accuracy becomes more sensitive to rℓ. Very small keep ratios lead to noticeable performance degradation, while moderate values consistently achieve higher accuracy. This trend is especially pronounced under extreme non-IID data (α = 0.1), where intermediate rℓ yields the best performance, highlighting the importance of balancing sparsity and information retention. Figure 3(b) reports the corresponding system latency. As rℓ increases, communication latency grows monotonically due to the larger volume of uploaded parameters, while computation latency slightly decreases. As a result, the overall round latency increases with larger rℓ, revealing a clear accuracy-efficiency trade-off. These results indicate that moderate keep ratios provide a favorable balance between robustness to data heterogeneity and system efficiency, and are adopted in subsequent experiments.
Effect of weight configurations (β1, β2). We further study the impact of the weighting coefficients (β1, β2) in Eq. (6), which balance computation and communication costs during dynamic split layer selection. Five representative configurations are evaluated: (3, 1), (2, 1), (1, 1), (1, 2), and (1, 3). As shown in Figure 4(a), increasing β1 relative to β2 biases split layer selection toward shallower client-side models, reducing computation latency but increasing communication latency due to larger smashed data transmission. Conversely, larger β2 favors deeper split layers, lowering communication latency at the cost of higher client-side computation. Among all configurations, (β1, β2) = (1, 1) achieves the lowest overall round latency, indicating a well-balanced tradeoff. Figure 4(b) further illustrates the distribution of selected split layers under different (β1, β2) settings. Larger β1 leads to more frequent selection of early layers (e.g., conv2 x), whereas larger β2 shifts selections toward deeper layers (e.g., conv4 x and conv5 x). This behavior confirms that the proposed split selection mechanism effectively adapts to different resource-weighting preferences and explains the observed latency trends. Accordingly, we adopt β1 = β2 = 1 as the default configuration.


Limitations. DASFL is currently evaluated on image classification benchmarks with moderate-scale clients under a controlled resource simulator. Its advantage may diminish when client resources are nearly homogeneous or static, where a fixed split may already suffice. Moreover, the current resource model does not fully capture continuous fluctuations in real deployments, which we leave to future work.
5 Conclusion
This paper presented Dynamic Adaptive Split Federated Learning (DASFL), a unified framework for efficient and robust split federated learning under heterogeneous, timevarying resources and non-IID data. DASFL integrates resource-aware dynamic split layer selection with adaptive masked federated aggregation, enabling clients to adapt partitioning to instantaneous conditions while maintaining stable optimization under split-induced structural heterogeneity. Extensive experiments across multiple model-dataset pairs show that DASFL consistently achieves higher accuracy and lower training latency than FL, SL, static-split SFL, and recent heterogeneity-aware baselines, especially under severe data and resource heterogeneity. Overall, effective SFL in realistic edge environments requires not only dynamic split selection but also aggregation mechanisms tailored to structural heterogeneity. DASFL provides a practical foundation for adaptive, resource-aware federated learning in edge intelligence systems.
Acknowledgements
This work was supported by the National Natural Science Foundation of China (U22B2038, 62532002, 62192784, U23A20319).
@inproceedings{ijcai2026p499,
title = {DASFL: Dynamic Adaptive Split Federated Learning for Heterogeneous Clients},
author = {Li, Aijing and Li, Yawen and Ye, Guanhua and Liu, Dandan and Zhao, Tong and Guan, Zeli},
booktitle = {Proceedings of the Thirty-Fifth International Joint Conference on
Artificial Intelligence, {IJCAI-26}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Diego Calvanese},
pages = {4483--4491},
year = {2026},
month = {8},
note = {Main Track},
doi = {10.24963/ijcai.2026/499},
url = {https://doi.org/10.24963/ijcai.2026/499},
}
TY - CPAPER TI - DASFL: Dynamic Adaptive Split Federated Learning for Heterogeneous Clients AU - Li, Aijing AU - Li, Yawen AU - Ye, Guanhua AU - Liu, Dandan AU - Zhao, Tong AU - Guan, Zeli T2 - Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-26 PB - International Joint Conferences on Artificial Intelligence Organization PY - 2026 SP - 4483 EP - 4491 DO - 10.24963/ijcai.2026/499 UR - https://doi.org/10.24963/ijcai.2026/499 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: