{"type":"ScholarlyArticle","title":"On the Generalization of Feature Incremental Learning","authors":[{"name":"Chao Xu","slug":"chao-xu","given":"Chao","family":"Xu","affiliation":""},{"name":"Xijia Tang","slug":"xijia-tang","given":"Xijia","family":"Tang","affiliation":""},{"name":"Lijun Zhang","slug":"lijun-zhang","given":"Lijun","family":"Zhang","affiliation":""},{"name":"Chenping Hou","slug":"chenping-hou","given":"Chenping","family":"Hou","affiliation":""}],"abstract":"In many real applications, the data attributes are incremental and the samples are stored with accumulated feature spaces gradually. Although there are several elegant approaches to tackling this problem, the theoretical analysis is still limited. There exist at least two challenges and fundamental questions. 1) How to derive the generalization bounds of these approaches? 2) Under what conditions do these approaches have a strong generalization guarantee? To solve these crucial but rarely studied problems, we provide a comprehensive theoretical analysis in this paper. We begin by summarizing and refining four strategies for addressing feature incremental data. Subsequently, we derive their generalization bounds, providing rigorous and quantitative insights. The theoretical findings highlight the key factors influencing the generalization abilities of different strategies. In tackling the above two fundamental problems, we also provide valuable guidance for exploring other learning challenges in dynamic environments. Finally, the comprehensive experimental and theoretical results mutually validate each other, underscoring the reliability of our conclusions.","doi":"10.24963/ijcai.2025/746","url":"https://ijcai.org/proceedings/2025/746","pdf":"https://ijcai.org/proceedings/2025/0746.pdf","markdown":"https://ijcai.org/proceedings/2025/746.md","bibtex":"https://ijcai.org/proceedings/2025/bibtex/746","volume":{"slug":"2025","title":"Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2025","url":"https://ijcai.org/proceedings/2025/","year":2025,"location":"Montreal, Canada","dates":"16-22 August 2025","editors":"James Kwok","isbn":"978-1-956792-06-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2025"},"section":"Machine Learning","track":"Main Track","number":746,"pages":{"first":6705,"last":6713},"keywords":["Machine Learning: ML: Learning theory","Machine Learning: ML: Supervised Learning"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}