Proceedings

From Neural Collapse to Label-Limited Evolving Streams: Geometry-Constrained Learning Under Dynamic Class Imbalance

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 3070-3078.

https://doi.org/10.24963/ijcai.2026/341

Abstract

Learning from label-limited streams presents significant challenges, particularly when coupled with concept drift and dynamic class imbalance. Existing works often struggle to maintain a discriminative feature space under these constraints, biasing decision boundaries toward majority classes or outdated concepts. To address this, we propose a novel framework named Neural collapse Inspired Label-limited Evolving stream learning (NILE). Instead of utilizing learnable classifiers, NILE exploits Neural Collapse (NC) geometry to explicitly construct a Simplex Equiangular Tight Frame (ETF) as a fixed classifier, ensuring maximal inter-class separability to guide feature discriminability. To maintain this discrimination with limited labels, NILE employs hybrid active learning to prioritize uncertain and minority samples, and an NC-adapted semi-supervised mechanism to enhance representation learning. NILE further updates the classifier by dynamically adjusting the ETF structure, enabling continual adaptation to drifting concepts. Extensive experiments show that NILE can effectively guide features toward the NC state, significantly outperforming state-of-the-art baselines in nonstationary environments.

  1. [Abdi et al., 2024] Yousef Abdi, Mohammad Asadpour, and Mohammad-Reza Feizi-Derakhshi. An ensemble-based semi-supervised learning approach for non-stationary im- balanced data streams with label scarcity. Applied Soft Computing, 167:112353, 2024.
  2. [Aguiar et al., 2024] Gabriel Aguiar, Bartosz Krawczyk, and Alberto Cano. A survey on learning from imbalanced data streams: taxonomy, challenges, empirical study, and re- producible experimental framework. Machine Learning, 113(7):4165-4243, 2024.
  3. [Boiko Ferreira et al., 2019] Luis Eduardo Boiko Ferreira, Heitor Murilo Gomes, Albert Bifet, and Luiz S. Oliveira. Adaptive random forests with resampling for imbalanced data streams. In IJCNN, pages 1-6, 2019.
  4. [Cacciarelli and Kulahci, 2024] Davide Cacciarelli and Mu- rat Kulahci. Active learning for data streams: a survey. Machine Learning, 113(1):185-239, 2024.
  5. [Cano and Krawczyk, 2020] Alberto Cano and Bartosz Krawczyk. Kappa updated ensemble for drifting data stream mining. Machine Learning, 109(1):175-218, 2020.
  6. [Cano and Krawczyk, 2022] Alberto Cano and Bartosz Krawczyk. Rose: robust online self-adjusting ensemble for continual learning on imbalanced drifting data streams. Machine Learning, 111(7):2561-2599, 2022.
  7. [Din et al., 2022] Salah Ud Din, Jay Kumar, Junming Shao, Cobbinah Bernard Mawuli, and Waldiodio David Ndi- aye. Learning high-dimensional evolving data streams with limited labels. IEEE Transactions on Cybernetics, 52(11):11373-11384, 2022.
  8. [Fahy et al., 2022] Conor Fahy, Shengxiang Yang, and Mario Gongora. Scarcity of labels in non-stationary data streams: A survey. ACM Comput. Surv., 55(2):1-39, 2022.
  9. [Gomes et al., 2022] Heitor Murilo Gomes, Maciej Grzenda, Rodrigo Mello, Jesse Read, Minh Huong Le Nguyen, and Albert Bifet. A survey on semi-supervised learning for de- layed partially labelled data streams. ACM Comput. Surv., 55(4):1-42, 2022.
  10. [Gunasekara et al., 2024] Nuwan Gunasekara, Bernhard Pfahringer, Heitor Murilo Gomes, Albert Bifet, and Yun Sing Koh. Recurrent concept drifts on data streams. In IJCAI, pages 8029-8037, 2024. IJCAI
  11. [Guo et al., 2024] Yinan Guo, Jiayang Pu, Botao Jiao, Yanyan Peng, Dini Wang, and Shengxiang Yang. On- line semi-supervised active learning ensemble classifica- tion for evolving imbalanced data streams. Applied Soft Computing, 155:111452, 2024.
  12. [Hong and Ling, 2024] Wanli Hong and Shuyang Ling. Neu- ral collapse for unconstrained feature model under cross- entropy loss with imbalanced data. Journal of Machine Learning Research, 25(192):1-48, 2024.
  13. [Hu et al., 2024] Zhanxuan Hu, Yichen Wang, Hailong Ning, Yonghang Tai, and Feiping Nie. Neural collapse inspired semi-supervised learning with fixed classifier. In- formation Sciences, 667:120469, 2024.
  14. [Jiang et al., 2025] Jun Jiang, Bin Wang, Quan Tang, Guoxi- ang Zhong, Xuhao Tang, and Joel J. P. C. Rodrigues. Incre- mental semi-supervised learning for data streams classifi- cation in internet of things. IEEE Transactions on Network and Service Management, 22(3):2489-2501, 2025.
  15. [Jiao et al., 2025] Botao Jiao, Heitor Murilo Gomes, Bing Xue, Yinan Guo, and Mengjie Zhang. A semi-supervised active learning neural network for data streams with con- cept drift. IEEE Computational Intelligence Magazine, 20(1):18-33, 2025.
  16. [Krawczyk and Cano, 2019] Bartosz Krawczyk and Alberto Cano. Adaptive ensemble active learning for drifting data stream mining. In IJCAI, pages 2763-2771, 2019. IJCAI
  17. [Li et al., 2024] Ang Li, Meng Han, Dongliang Mu, Zhihui Gao, and Shujuan Liu. Online active learning method for multi-class imbalanced data stream. Knowledge and Infor- mation Systems, 66(4):2355-2391, 2024.
  18. [Liao et al., 2023] Guobo Liao, Peng Zhang, Hongpeng Yin, Xuanhong Deng, Yanxia Li, Han Zhou, and Dandan Zhao. A novel semi-supervised classification approach for evolv- ing data streams. Expert Systems with Applications, 215:119273, 2023.
  19. [Liu and Qin, 2025] Litian Liu and Yao Qin. Detecting out- of-distribution through the lens of neural collapse. In CVPR, pages 15424-15433, 2025.
  20. [Liu et al., 2021] Weike Liu, Hang Zhang, Zhaoyun Ding, Qingbao Liu, and Cheng Zhu. A comprehensive ac- tive learning method for multiclass imbalanced data streams with concept drift. Knowledge-Based Systems, 215:106778, 2021.
  21. [Liu et al., 2023a] Sanmin Liu, Shan Xue, Jia Wu, Chuan Zhou, Jian Yang, Zhao Li, and Jie Cao. Online active learning for drifting data streams. IEEE Transactions on Neural Networks and Learning Systems, 34(1):186-200, 2023.
  22. [Liu et al., 2023b] Weike Liu, Cheng Zhu, Zhaoyun Ding, Hang Zhang, and Qingbao Liu. Multiclass imbalanced and concept drift network traffic classification framework based on online active learning. Engineering Applications of Artificial Intelligence, 117:105607, 2023.
  23. [Loezer et al., 2020] Lucas Loezer, Fabrício Enembreck, Jean Paul Barddal, and Alceu de Souza Britto. Cost- sensitive learning for imbalanced data streams. In SAC, pages 498-504, 2020.
  24. [Malialis et al., 2022] Kleanthis Malialis, Christos G. Panayiotou, and Marios M. Polycarpou. Nonstationary data stream classification with online active learning and siamese neural networks. Neurocomputing, 512:235-252, 2022.
  25. [Papyan et al., 2020] Vardan Papyan, X. Y. Han, and David L. Donoho. Prevalence of neural collapse during the terminal phase of deep learning training. Proceedings of the National Academy of Sciences, 117(40):24652-24663, 2020.
  26. [Seo et al., 2024] Minhyuk Seo, Hyunseo Koh, Wonje Je- ung, Minjae Lee, San Kim, Hankook Lee, Sungjun Cho, Sungik Choi, Hyunwoo Kim, and Jonghyun Choi. Learning equi-angular representations for online continual learning. In CVPR, pages 23933-23942, 2024.
  27. [Tanha et al., 2022] Jafar Tanha, Negin Samadi, Yousef Abdi, and Nazila Razzaghi-Asl. Cpssds: Conformal pre- diction for semi-supervised classification on data streams. Information Sciences, 584:212-234, 2022.
  28. [Vafaie et al., 2020] Parsa Vafaie, Herna Viktor, and Wojtek Michalowski. Multi-class imbalanced semi-supervised learning from streams through online ensembles. In ICDMW, pages 867-874, 2020.
  29. [Wang and Li, 2018] Yi Wang and Tao Li. Improving semi- supervised co-forest algorithm in evolving data streams. Applied Intelligence, 48(10):3248-3262, 2018.
  30. [Wang et al., 2015] Shuo Wang, Leandro L. Minku, and Xin Yao. Resampling-based ensemble methods for online class imbalance learning. IEEE Transactions on Knowledge and Data Engineering, 27(5):1356-1368, 2015.
  31. [Wang et al., 2016] Shuo Wang, Leandro L. Minku, and Xin Yao. Dealing with multiple classes in online class imbal- ance learning. In IJCAI, pages 2118-2124, 2016. IJCAI
  32. [Wang et al., 2026a] Hongliang Wang, Liangxv Pan, Zhonglin Wu, Lei Liu, Haifeng Peng, Yulin Tao, Qinli Yang, and Junming Shao. A deep metric framework for reliable semi-supervised learning on evolving data streams. Applied Intelligence, 56(2):49, 2026.
  33. [Wang et al., 2026b] Hongliang Wang, Zhonglin Wu, Jinxia Guo, Wei Han, Lei Liu, Qinli Yang, and Junming Shao. Exploiting reliable evolving micro-clusters for robust semi-supervised learning on data streams. Information Sciences, 735:123069, 2026.
  34. [Wang et al., 2026c] Hongliang Wang, Zhonglin Wu, Jinxia Guo, Qirui Hao, Xinyu Liu, Hongyuan Liu, Qinli Yang, and Junming Shao. Learning contrastive evolving micro- clusters for robust semi-supervised data stream classifica- tion. IEEE Transactions on Cybernetics, 2026.
  35. [Wu et al., 2024] Zhonglin Wu, Hongliang Wang, Jingxia Guo, Qinli Yang, and Junming Shao. Learning evolving prototypes for imbalanced data stream classification with limited labels. Information Sciences, 679:120979, 2024.
  36. [Wu et al., 2026] Zhonglin Wu, Hongliang Wang, Tongze Zhang, Hongyuan Liu, Jinxia Guo, Qinli Yang, and Jun- ming Shao. Region-based deep metric learning for tack- ling class overlap in online semi-supervised data stream classification. Information Fusion, 130:104126, 2026.
  37. [Xiao et al., 2024] Ruixuan Xiao, Lei Feng, Kai Tang, Junbo Zhao, Yixuan Li, Gang Chen, and Haobo Wang. Targeted representation alignment for open-world semi-supervised learning. In CVPR, pages 23072-23082, 2024.
  38. [Yan et al., 2024] Hongren Yan, Yuhua Qian, Furong Peng, Jiachen Luo, Zheqing Zhu, and Feijiang Li. Neural col- lapse to multiple centers for imbalanced data. In NeurIPS, volume 37, pages 65583-65617, 2024.
  39. [Yang et al., 2022] Yibo Yang, Shixiang Chen, Xiangtai Li, Liang Xie, Zhouchen Lin, and Dacheng Tao. Inducing neural collapse in imbalanced learning: Do we really need a learnable classifier at the end of deep neural network? In NeurIPS, volume 35, pages 37991-38002, 2022.
  40. [Yu et al., 2025] Hang Yu, Jiahao Wen, Yiping Sun, Xiao Wei, and Jie Lu. Ca-gnn: A competence-aware graph neural network for semi-supervised learning on streaming data. IEEE Transactions on Cybernetics, 55(2):684-697, 2025.
  41. [Zhang et al., 2022] Hang Zhang, Weike Liu, and Qingbao Liu. Reinforcement online active learning ensemble for drifting imbalanced data streams. IEEE Transactions on Knowledge and Data Engineering, 34(8):3971-3983, 2022.
  42. [Zhang et al., 2025] Shuoxi Zhang, Zijian Song, and Kun He. Neural collapse inspired knowledge distillation. AAAI, 39(21):22542-22550, 2025.
  43. [Zhao and Koh, 2020] Di Zhao and Yun Sing Koh. Feature drift detection in evolving data streams. In DEXA, 2020.
  44. [Zhao et al., 2022] Di Zhao, Yun Sing Koh, and Philippe Fournier-Viger. Measuring drift severity by tree structure classifiers. In IJCNN, pages 1-8, 2022.
  45. [Zhou et al., 2022] Jinxin Zhou, Xiao Li, Tianyu Ding, Chong You, Qing Qu, and Zhihui Zhu. On the optimiza- tion landscape of neural collapse under MSE loss: Global optimality with unconstrained features. In ICML, volume 162, pages 27179-27202, 2022.
  46. [Zhou et al., 2023] Han Zhou, Hongpeng Yin, Xuanhong Deng, and Yuyu Huang. Online harmonizing gradient de- scent for imbalanced data streams one-pass classification. In IJCAI, pages 2468-2475, 2023. IJCAI
  47. [Zhu et al., 2021] Zhihui Zhu, Tianyu Ding, Jinxin Zhou, Xiao Li, Chong You, Jeremias Sulam, and Qing Qu. A ge- ometric analysis of neural collapse with unconstrained fea- tures. In NeurIPS, volume 34, pages 29820-29834, 2021.
  48. [Žliobaitė et al., 2014] Indrė Žliobaitė, Albert Bifet, Bern- hard Pfahringer, and Geoffrey Holmes. Active learning with drifting streaming data. IEEE Transactions on Neu- ral Networks and Learning Systems, 25(1):27-39, 2014.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards