Proceedings

Temporal Smoothness Doubly Robust Learning for Debiased Knowledge Tracing

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 3728-3736.

https://doi.org/10.24963/ijcai.2026/415

© 2026 International Joint Conferences on Artificial Intelligence

Abstract

Knowledge Tracing (KT) is fundamental to intelligent education systems, yet relies on educational logs that are selectively observed. The non-random nature of exercise recommendations and student choices inevitably induces severe selection bias. Most existing KT methods neglect this issue, training on observed logs using standard empirical risk, which yields biased mastery estimates and accumulates errors in subsequent recommendations. To address this, we introduce a doubly robust (DR) formulation for KT that integrates a propensity model with an error imputation model, theoretically guaranteeing unbiasedness if either model is accurate. Beyond unbiasedness, in the sequential setting of KT, we identify that the estimator's performance is compromised by variance-dependent stochastic deviations that accumulate over time, thereby causing training instability and limiting performance. To mitigate this, we derive a generalization bound that explicitly characterizes the impact of estimator variance and identifies temporal smoothness as a key factor in controlling it. Building on these theoretical insights, we propose the Temporal Smoothness Doubly Robust (TSDR) framework. TSDR jointly optimizes the KT predictor and the imputation model with a smoothness regularizer, effectively reducing variance while preserving the unbiasedness guarantee of DR. Experiments on multiple real-world benchmarks demonstrate that TSDR consistently enhances various state-of-the-art KT backbones, underscoring the vital role of principled bias correction in KT.

  1. [Anderson et al., 1985] John R Anderson, C Franklin Boyle, and Brian J Reiser. Intelligent tutoring systems. Science, 228(4698):456-462, 1985.
  2. [Azuma, 1967] Kazuoki Azuma. Weighted sums of certain dependent random variables. Tohoku Mathematical Jour- nal, Second Series, 19(3):357-367, 1967.
  3. [Baker et al., 2008a] Ryan SJ d Baker, Albert T Corbett, and Vincent Aleven. More accurate student modeling through contextual estimation of slip and guess probabilities in bayesian knowledge tracing. In International conference on intelligent tutoring systems, pages 406-415. Springer, 2008.
  4. [Baker et al., 2008b] Ryan SJd Baker, Albert T Corbett, and Vincent Aleven. Improving contextual models of guess- ing and slipping with a truncated training set. Educational Data Mining, page 67, 2008.
  5. [Baker, 2001] Frank B Baker. The basics of item response theory. ERIC, 2001.
  6. [Barrett et al., 2024] Jake Barrett, Alasdair Day, and Kobi Gal. Improving model fairness with time-augmented bayesian knowledge tracing. In Proceedings of the 14th Learning Analytics and Knowledge Conference, pages 46- 54, 2024.
  7. [Cai et al., 2025] Ruichu Cai, Kaitao Zheng, Junxian Huang, Zijian Li, Zhengming Chen, Boyan Xu, and Zhifeng Hao. Causal view of time series imputation: Some identification results on missing mechanism. International Joint Confer- ences on Artificial Intelligence, 2025. IJCAI
  8. [Carless, 2019] David Carless. Feedback loops and the longer-term: towards feedback spirals. Assessment & Evaluation in Higher Education, 44(5):705-714, 2019.
  9. [Chen et al., 2024] Weilin Chen, Ruichu Cai, Zeqin Yang, Jie Qiao, Yuguang Yan, Zijian Li, and Zhifeng Hao. Dou- bly robust causal effect estimation under networked inter- ference via targeted learning. In International Conference on Machine Learning, pages 6457-6485. PMLR, 2024.
  10. [Choi et al., 2020] Youngduck Choi, Youngnam Lee, Dong- min Shin, Junghyun Cho, Seoyon Park, Seewoo Lee, Ji- neon Baek, Chan Bae, Byungsoo Kim, and Jaewe Heo. Ednet: A large-scale hierarchical dataset in education. In Ig Ibert Bittencourt, Mutlu Cukurova, Kasia Muldner, Rose Luckin, and Eva Millán, editors, Artificial Intelli- gence in Education, pages 69-73, Cham, 2020. Springer International Publishing.
  11. [Corbett and Anderson, 1994] Albert T Corbett and John R Anderson. Knowledge tracing: Modeling the acquisi- tion of procedural knowledge. User modeling and user- adapted interaction, 4(4):253-278, 1994.
  12. [Cui et al., 2023] Chaoran Cui, Hebo Ma, Chen Zhang, Chunyun Zhang, Yumo Yao, Meng Chen, and Yuling Ma. Do we fully understand students' knowledge states? iden- tifying and mitigating answer bias in knowledge tracing. arXiv preprint arXiv:2308.07779, 2023.
  13. [Cui et al., 2025] Jiajun Cui, Hong Qian, Chanjin Zheng, Lu Wang, Mo Yu, and Wei Zhang. Rebalancing discrim- inative responses for knowledge tracing. ACM Transac- tions on Information Systems, 43(3):1-25, 2025.
  14. [de Haan et al., 2019] Pim de Haan, Dinesh Jayaraman, and Sergey Levine. Causal confusion in imitation learning. NeurIPS, 2019.
  15. [Dudík et al., 2011] Miroslav Dudík, John Langford, and Li- hong Li. Doubly robust policy evaluation and learning. In Lise Getoor and Tobias Scheffer, editors, Proceedings of the 28th International Conference on Machine Learning, ICML 2011, Bellevue, Washington, USA, June 28 -July 2, 2011, pages 1097-1104. Omnipress, 2011.
  16. [Ghosh et al., 2020] Aritra Ghosh, Neil Heffernan, and An- drew S Lan. Context-aware attentive knowledge tracing. In Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, pages 2330-2339, 2020.
  17. [Gorgun and Bulut, 2022] Guher Gorgun and Okan Bulut. Identifying aberrant responses in intelligent tutoring sys- tems: an application of anomaly detection methods. Psy- chological Test and Assessment Modeling, 64(4):359-384, 2022.
  18. [Guo et al., 2021] Xiaopeng Guo, Zhijie Huang, Jie Gao, Mingyu Shang, Maojing Shu, and Jun Sun. Enhancing knowledge tracing via adversarial training. In Proceedings of the 29th ACM international conference on multimedia, pages 367-375, 2021.
  19. [Huang et al., 2023] Shuyan Huang, Zitao Liu, Xiangyu Zhao, Weiqi Luo, and Jian Weng. Towards robust knowl- edge tracing models via k-sparse attention. In Proceed- ings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, page 2441-2445, 2023.
  20. [Huang et al., 2024] Changqin Huang, Hangjie Wei, Qiong- hao Huang, Fan Jiang, Zhongmei Han, and Xiaodi Huang. Learning consistent representations with temporal and causal enhancement for knowledge tracing. Expert Sys- tems with Applications, 245:123128, 2024.
  21. [Im et al., 2023] Yoonjin Im, Eunseong Choi, Heejin Kook, and Jongwuk Lee. Forgetting-aware linear bias for atten- tive knowledge tracing. In Proceedings of the 32nd ACM international conference on information and knowledge management, pages 3958-3962, 2023.
  22. [Li et al., 2024] Xueyi Li, Youheng Bai, Teng Guo, Zitao Liu, Yaying Huang, Xiangyu Zhao, Feng Xia, Weiqi Luo, and Jian Weng. Enhancing length generalization for atten- tion based knowledge tracing models with linear biases. In Proceedings of the thirty-third international joint con- ference on artificial intelligence (IJCAI-24), pages 5918- 5926, 2024. IJCAI
  23. [Liu et al., 2023] Zitao Liu, Qiongqiong Liu, Jiahao Chen, Shuyan Huang, and Weiqi Luo. simplekt: A simple but tough-to-beat baseline for knowledge tracing. In The Eleventh International Conference on Learning Repre- sentations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023.
  24. [Liu et al., 2025] Jie Liu, Zhifeng Li, Jiawang Yang, Hao He, and Fang Cui. The neurocognitive mechanism underlying math avoidance among math anxious people. npj Science of Learning, 10(1):50, 2025.
  25. [Lv et al., 2025] Xiangwei Lv, Guifeng Wang, Jingyuan Chen, Hejian Su, Zhiang Dong, Yumeng Zhu, Beishui Liao, and Fei Wu. Debiased cognition representation learning for knowledge tracing. ACM Transactions on In- formation Systems, 2025.
  26. [Ma et al., 2024] Haiping Ma, Yong Yang, Chuan Qin, Xi- aoshan Yu, Shangshang Yang, Xingyi Zhang, and Heng- shu Zhu. Hd-kt: Advancing robust knowledge tracing via anomalous learning interaction detection. In Proceed- ings of the ACM Web Conference 2024, pages 4479-4488, 2024.
  27. [Mao et al., 2025] Shun Mao, Jieyu Zhan, Yuanfei Deng, Yixiu Qin, and Yuncheng Jiang. Improving exercise-level knowledge tracing via knowledge concept-based memory network. Expert Systems with Applications, page 127825, 2025.
  28. [Nakagawa et al., 2019] Hiromi Nakagawa, Yusuke Iwa- sawa, and Yutaka Matsuo. Graph-based knowledge trac- ing: modeling student proficiency using graph neural net- work. In IEEE/WIC/aCM international conference on web intelligence, pages 156-163, 2019.
  29. [Newell and Rosenbloom, 2013] Allen Newell and Paul S Rosenbloom. Mechanisms of skill acquisition and the law of practice. In Cognitive skills and their acquisition, pages 1-55. Psychology Press, 2013.
  30. [Pandey and Karypis, 2019] Shalini Pandey and George Karypis. A self-attentive model for knowledge tracing. In- ternational Educational Data Mining Society, 2019.
  31. [Pearl et al., 2016] J. Pearl, M. Glymour, and N.P. Jewell. Causal Inference in Statistics: A Primer. Wiley, 2016.
  32. [Piech et al., 2015] Chris Piech, Jonathan Bassen, Jonathan Huang, Surya Ganguli, Mehran Sahami, Leonidas J Guibas, and Jascha Sohl-Dickstein. Deep knowledge trac- ing. Advances in neural information processing systems, 28, 2015.
  33. [Schnabel et al., 2016] Tobias Schnabel, Adith Swami- nathan, Ashudeep Singh, Navin Chandak, and Thorsten Joachims. Recommendations as treatments: Debiasing learning and evaluation. In international conference on machine learning, pages 1670-1679. PMLR, 2016.
  34. [Shen et al., 2021] Shuanghong Shen, Qi Liu, Enhong Chen, Zhenya Huang, Wei Huang, Yu Yin, Yu Su, and Shijin Wang. Learning process-consistent knowledge tracing. In Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, pages 1452-1460, 2021.
  35. [Steck, 2013] Harald Steck. Evaluation of recommenda- tions: rating-prediction and ranking. In Proceedings of the 7th ACM conference on Recommender systems, pages 213-220, 2013.
  36. [Thomas and Brunskill, 2016] Philip Thomas and Emma Brunskill. Data-efficient off-policy policy evaluation for reinforcement learning. In International conference on machine learning, pages 2139-2148. PMLR, 2016.
  37. [Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  38. [Villegas-Ch et al., 2025] William Villegas-Ch, Diego Buenano-Fernandez, Alexandra Maldonado Navarro, and Aracely Mera-Navarrete. Adaptive intelligent tutoring systems for stem education: analysis of the learning impact and effectiveness of personalized feedback. Smart Learning Environments, 12(1):1-31, 2025.
  39. [Vygotsky et al., 1978] Lev S Vygotsky, Michael Cole, Vera John-Steiner, S Scribner, and Ellen Souberman. The de- velopment of higher psychological processes, 1978.
  40. [Wang et al., 2019] Xiaojie Wang, Rui Zhang, Yu Sun, and Jianzhong Qi. Doubly robust joint learning for recom- mendation on data missing not at random. In Interna- tional Conference on Machine Learning, pages 6638- 6647. PMLR, 2019.
  41. [Wise, 2017] Steven L Wise. Rapid-guessing behavior: Its identification, interpretation, and implications. Educa- tional Measurement: Issues and Practice, 36(4):52-61, 2017.
  42. [Zambrano et al., 2024] Andres Felipe Zambrano, Jiayi Zhang, and Ryan S Baker. Investigating algorithmic bias on bayesian knowledge tracing and carelessness detectors. In Proceedings of the 14th Learning Analytics and Knowl- edge Conference, pages 349-359, 2024.
  43. [Zhou et al., 2025] Yiyun Zhou, Zheqi Lv, Shengyu Zhang, and Jingyuan Chen. Disentangled knowledge tracing for alleviating cognitive bias. In Proceedings of the ACM on Web Conference 2025, pages 2633-2645, 2025.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards