{"type":"ScholarlyArticle","title":"TabKD: Tabular Knowledge Distillation Through Interaction Diversity of Learned Feature Bins","authors":[{"name":"Shovon Niverd Pereira","slug":"shovon-niverd-pereira","given":"Shovon Niverd","family":"Pereira","affiliation":""},{"name":"Krishna Khadka","slug":"krishna-khadka","given":"Krishna","family":"Khadka","affiliation":""},{"name":"Yu Lei","slug":"yu-lei","given":"Yu","family":"Lei","affiliation":""}],"abstract":"Data-free knowledge distillation enables model distillation without original training data, which is critical for privacy-sensitive tabular domains. However, existing methods do not perform well on tabular data because they do not explicitly address feature interactions, which are critical for encoding predictive knowledge. We identify interaction diversity, systematic coverage of feature combinations, as an important factor for effective tabular model distillation. To operationalize this insight, we propose TabKD, which learns adaptive feature bins aligned with teacher decision boundaries, then generates synthetic queries that ensure uniform pairwise interaction coverage. Across 4 benchmark datasets and 4 teacher architectures, TabKD achieves the highest student-teacher agreement in 14 of 16 configurations, outperforming 5 state-of-the-art baselines. We further show that interaction coverage strongly correlates with distillation quality, validating our core hypothesis. Our work establishes interaction-focused exploration as a principled framework for tabular model distillation.","doi":"10.24963/ijcai.2026/526","url":"https://ijcai.org/proceedings/2026/526","pdf":"https://ijcai.org/proceedings/2026/0526.pdf","markdown":"https://ijcai.org/proceedings/2026/526.md","bibtex":"https://ijcai.org/proceedings/2026/bibtex/526","volume":{"slug":"2026","title":"Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2026","url":"https://ijcai.org/proceedings/2026/","year":2026,"location":"Bremen, Germany","dates":"15-21 August 2026","editors":"Diego Calvanese","isbn":"978-1-956792-09-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2026"},"section":"Machine Learning","track":"Main Track","number":526,"pages":{"first":4723,"last":4731},"keywords":["Machine Learning: Knowledge-aided learning","Machine Learning: Adversarial machine learning"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}