{"type":"ScholarlyArticle","title":"Reconciling Cognitive Modeling with Knowledge Forgetting: A Continuous Time-aware Neural Network Approach","authors":[{"name":"Haiping Ma","slug":"haiping-ma","given":"Haiping","family":"Ma","affiliation":"Information Materials and Intelligent Sensing Laboratory of Anhui Province , Anhui University , China; Institutes of Physical Science and Information Technology , Anhui University , China"},{"name":"Jingyuan Wang","slug":"jingyuan-wang","given":"Jingyuan","family":"Wang","affiliation":"Information Materials and Intelligent Sensing Laboratory of Anhui Province , Anhui University , China; Institutes of Physical Science and Information Technology , Anhui University , China"},{"name":"Hengshu Zhu","slug":"hengshu-zhu","given":"Hengshu","family":"Zhu","affiliation":"Baidu Talent Intelligence Center , Baidu Inc , China"},{"name":"Xin Xia","slug":"xin-xia","given":"Xin","family":"Xia","affiliation":"School of Mathematical Science , Anhui University , China"},{"name":"Haifeng Zhang","slug":"haifeng-zhang","given":"Haifeng","family":"Zhang","affiliation":"School of Mathematical Science , Anhui University , China"},{"name":"Xingyi Zhang","slug":"xingyi-zhang","given":"Xingyi","family":"Zhang","affiliation":"Information Materials and Intelligent Sensing Laboratory of Anhui Province , Anhui University , China; School of Artificial Intelligence , Anhui University , China"},{"name":"Lei Zhang","slug":"lei-zhang","given":"Lei","family":"Zhang","affiliation":"Information Materials and Intelligent Sensing Laboratory of Anhui Province , Anhui University , China; School of Computer Science and Technology , Anhui University , China"}],"abstract":"As an emerging technology of computer-aided education, cognitive modeling aims at discovering the knowledge proficiency or learning ability of students, which can enable a wide range of intelligent educational applications. While considerable efforts have been made in this direction, a long-standing research challenge is how to naturally integrate the forgetting mechanism into the learning process of knowledge concepts. To this end, in this paper, we propose a novel Continuous Time based Neural Cognitive Modeling(CT-NCM) approach to integrate the dynamism and continuity of knowledge forgetting into students' learning process modeling in a realistic manner. To be specific, we first adapt the neural Hawkes process with a specially-designed learning event encoding method to model the relationship between knowledge learning and forgetting with continuous time. Then, we propose a learning function with extendable settings to jointly model the change of different knowledge states and their interactions with the exercises at each moment. In this way, CT-NCM can simultaneously predict the future knowledge state and exercise performance of students. Finally, we conduct extensive experiments on five real-world datasets with various benchmark methods. The experimental results clearly validate the effectiveness of CT-NCM and show its interpretability in terms of knowledge learning visualization.","doi":"10.24963/ijcai.2022/302","url":"https://ijcai.org/proceedings/2022/302","pdf":"https://ijcai.org/proceedings/2022/0302.pdf","markdown":"https://ijcai.org/proceedings/2022/302.md","bibtex":"https://ijcai.org/proceedings/2022/bibtex/302","volume":{"slug":"2022","title":"Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2022","url":"https://ijcai.org/proceedings/2022/","year":2022,"location":"Vienna","dates":"23-29 July 2022","editors":"Luc De Raedt","isbn":"978-1-956792-00-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2022"},"section":"Data Mining","track":"Main Track","number":302,"pages":{"first":2174,"last":2181},"keywords":["Humans and AI: Cognitive Modeling","Humans and AI: Computer-Aided Education","Data Mining: Applications","Multidisciplinary Topics and Applications: Education"],"videos":[{"label":"Video #1","url":"https://slideslive.com/38986656","length_sec":87,"provider":"slideslive"},{"label":"Video #2","url":"https://slideslive.com/38984799","length_sec":351,"provider":"slideslive"}],"references":[{"position":1,"raw":"[Abidoglu et al., 2017] Ülkü Pis ¸kin Abidoglu, Oya Ertugru- loglu, and Niyal Büyükegilmez. Importance of computer- aided education for children with autism spectrum disor- der (asd). Eurasia Journal of Mathematics, Science and Technology Education, 13(8):4957-4964, 2017.","title":"Ülkü Pis ¸kin Abidoglu, Oya Ertugruloglu, and Niyal Büyükegilmez. Importance of computeraided education for children with autism spectrum disorder (asd)","authors":"Abidoglu","year":"2017","venue":"Eurasia Journal of Mathematics, Science and Technology Education","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Atkinson and Shiffrin, 1968] Richard C Atkinson and Richard M Shiffrin. Human memory: A proposed system and its control processes. In Psychology of Learning and Motivation, volume 2, pages 89-195. Elsevier, 1968.","title":"Human memory: A proposed system and its control processes","authors":"C Richard, Richard M Atkinson, Shiffrin","year":"1968","venue":"Psychology of Learning and Motivation","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chang et al., 2015] Haw-Shiuan Chang, Hwai-Jung Hsu, and Kuan-Ta Chen. Modeling exercise relationships in e-learning: A unified approach. In International Educa- tional Data Mining Society, pages 532-535, 2015.","title":"Modeling exercise relationships in e-learning: A unified approach","authors":"Chang","year":"2015","venue":"International Educational Data Mining Society","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen et al., 2005] Chih-Ming Chen, Hahn-Ming Lee, and Ya-Hui Chen. Personalized e-learning system using item response theory. Computers & Education, 44(3):237-255, 2005.","title":"Personalized e-learning system using item response theory","authors":"Chih-Ming Chen, Hahn-Ming Lee, Ya-Hui Chen","year":"2005","venue":"Computers & Education","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Choi et al., 2020] Youngduck Choi, Youngnam Lee, Dong- min Shin, Junghyun Cho, Seoyon Park, Seewoo Lee, Ji- neon Baek, Chan Bae, Byungsoo Kim, and Jaewe Heo. Ednet: A large-scale hierarchical dataset in education. In International Conference on Artificial Intelligence in Edu- cation, pages 69-73. Springer, 2020.","title":"Ednet: A large-scale hierarchical dataset in education","authors":"Choi","year":"2020","venue":"International Conference on Artificial Intelligence in Education","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Corbett and Anderson, 1994] Albert T Corbett and John R Anderson. Knowledge tracing: Modeling the acquisi- tion of procedural knowledge. User Modeling and User- Adapted Interaction, 4(4):253-278, 1994.","title":"Knowledge tracing: Modeling the acquisition of procedural knowledge","authors":"Anderson ; Corbett, T Albert, John R Corbett, Anderson","year":"1994","venue":"User Modeling and User-Adapted Interaction","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Feng et al., 2009] Mingyu Feng, Neil Heffernan, and Ken- neth Koedinger. Addressing the assessment challenge with an online system that tutors as it assesses. User Modeling and User-Adapted Interaction, 19(3):243-266, 2009.","title":"Addressing the assessment challenge with an online system that tutors as it assesses","authors":"Mingyu Feng, Neil Heffernan, Kenneth Koedinger","year":"2009","venue":"User Modeling and User-Adapted Interaction","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Ghosh et al., 2020] Aritra Ghosh, Neil Heffernan, and An- drew S Lan. Context-aware attentive knowledge tracing. In Proceedings of the 26th ACM SIGKDD International Con- ference on Knowledge Discovery & Data Mining, pages 2330-2339, 2020.","title":"Context-aware attentive knowledge tracing","authors":"Aritra Ghosh, Neil Heffernan, Andrew S Lan","year":"2020","venue":"Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Hawkes, 1971] Alan G Hawkes. Spectra of some self-exciting and mutually exciting point processes. Biometrika, 58(1):83-90, 1971.","title":"Spectra of some self-exciting and mutually exciting point processes","authors":"Alan G Hawkes","year":"1971","venue":"Biometrika","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Hochreiter and Schmidhuber, 1997] Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural Computation, 9(8):1735-1780, 1997.","title":"Long short-term memory","authors":"Schmidhuber Hochreiter, Sepp Hochreiter, Jürgen Schmidhuber","year":"1997","venue":"Neural Computation","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Huang et al., 2020] Zhenya Huang, Qi Liu, Yuying Chen, Le Wu, Keli Xiao, Enhong Chen, Haiping Ma, and Guop- ing Hu. Learning or forgetting? a dynamic approach for tracking the knowledge proficiency of students. ACM Transactions on Information Systems, 38(2):1-33, 2020.","title":"Learning or forgetting? a dynamic approach for tracking the knowledge proficiency of students","authors":"Zhenya Huang, Qi Liu, Yuying Chen, Le Wu, Keli Xiao, Enhong Chen, Haiping Ma, Guoping Hu","year":"2020","venue":"ACM Transactions on Information Systems","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Lan and Baraniuk, 2016] Andrew S Lan and Richard G Baraniuk. A contextual bandits framework for person- alized learning action selection. In International Educa- tional Data Mining Society, pages 424-429, 2016.","title":"A contextual bandits framework for personalized learning action selection","authors":"S Andrew, Richard G Lan, Baraniuk","year":"2016","venue":"International Educational Data Mining Society","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Lindsey et al., 2014] Robert V Lindsey, Jeffery D Shroyer, Harold Pashler, and Michael C Mozer. Improving stu- dents' long-term knowledge retention through personal- ized review. Psychological Science, 25(3):639-647, 2014.","title":"Improving students' long-term knowledge retention through personalized review","authors":"Jeffery D Robert V Lindsey, Harold Shroyer, Michael C Pashler, Mozer","year":"2014","venue":"Psychological Science","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Lord, 1980] Frederic M Lord. Applications of item re- sponse theory to practical testing problems. lawrence erib- aum associates. Inc, Hillsdale, NJ, 1980.","title":"Applications of item response theory to practical testing problems","authors":"Frederic M Lord","year":"1980","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Mei and Eisner, 2017] Hongyuan Mei and Jason Eisner. The neural hawkes process: A neurally self-modulating multivariate point process. Advances in Neural Informa- tion Processing Systems, pages 5754-6767, 2017.","title":"The neural hawkes process: A neurally self-modulating multivariate point process","authors":"Eisner ; Mei, Hongyuan Mei, Jason Eisner","year":"2017","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Murre and Dros, 2015] Jaap MJ Murre and Joeri Dros. Replication and analysis of ebbinghaus' forgetting curve. PloS ONE, 10(7):e0120644, 2015.","title":"Replication and analysis of ebbinghaus' forgetting curve","authors":"M J Jaap, Joeri Murre, Dros","year":"2015","venue":"PloS ONE","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Myers, 2004] David G Myers. Psychology, in modules. Macmillan, 2004.","title":"Psychology, in modules","authors":"G David, Myers","year":"2004","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Nagatani et al., 2019] Koki Nagatani, Qian Zhang, Masahiro Sato, Yan-Ying Chen, Francine Chen, and Tomoko Ohkuma. Augmenting knowledge tracing by considering forgetting behavior. In The World Wide Web Conference, pages 3101-3107, 2019.","title":"Augmenting knowledge tracing by considering forgetting behavior","authors":"Koki Nagatani, Qian Zhang, Masahiro Sato, Yan-Ying Chen, Francine Chen, Tomoko Ohkuma","year":"2019","venue":"The World Wide Web Conference","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Papoušek et al., 2016] Jan Papoušek, Radek Pelánek, and Vít Stanislav. Adaptive geography practice data set. Jour- nal of Learning Analytics, 3(2):317-321, 2016.","title":"Adaptive geography practice data set","authors":"Papoušek","year":"2016","venue":"Journal of Learning Analytics","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Patikorn et al., 2018] Thanaporn Patikorn, Neil T Heffer- nan, and Ryan S Baker. Assistments longitudinal data mining competition 2017: A preface. In Proceedings of the Workshop on Scientific Findings from the ASSISTments Longitudinal Data Competition, International Conference on Educational Data Mining, 2018.","title":"Assistments longitudinal data mining competition 2017: A preface","authors":"Patikorn","year":"2018","venue":"Proceedings of the Workshop on Scientific Findings from the ASSISTments Longitudinal Data Competition, International Conference on Educational Data Mining","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Piech et al., 2015] Chris Piech, Jonathan Spencer, Jonathan Huang, Surya Ganguli, Mehran Sahami, Leonidas Guibas, and Jascha Sohl-Dickstein. Deep knowledge tracing. Ad- vances in Neural Information Processing Systems, pages 505-513, 2015.","title":"Deep knowledge tracing","authors":"Chris Piech, Jonathan Spencer, Jonathan Huang, Surya Ganguli, Mehran Sahami, Leonidas Guibas, Jascha Sohl-Dickstein","year":"2015","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Shen et al., 2021] Shuanghong Shen, Qi Liu, Enhong Chen, Zhenya Huang, Wei Huang, Yu Yin, Yu Su, and Shijin Wang. Learning process-consistent knowledge tracing. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pages 1452-1460, 2021.","title":"Learning process-consistent knowledge tracing","authors":"Shuanghong Shen, Qi Liu, Enhong Chen, Zhenya Huang, Wei Huang, Yu Yin, Yu Su, Shijin Wang","year":"2021","venue":"Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Vie and Kashima, 2019] Jill-Jênn Vie and Hisashi Kashima. Knowledge tracing machines: Factorization machines for knowledge tracing. In Proceedings of the AAAI Confer- ence on Artificial Intelligence, volume 33, pages 750-757, 2019.","title":"Knowledge tracing machines: Factorization machines for knowledge tracing","authors":"Kashima ; Jill-Jênn Vie, Hisashi Vie, Kashima","year":"2019","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Wang et al., 2020] Fei Wang, Qi Liu, Enhong Chen, Zhenya Huang, Yuying Chen, Yu Yin, Zai Huang, and Shijin Wang. Neural cognitive diagnosis for intelligent educa- tion systems. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 6153-6161, 2020.","title":"Neural cognitive diagnosis for intelligent education systems","authors":"Fei Wang, Qi Liu, Enhong Chen, Zhenya Huang, Yuying Chen, Yu Yin, Zai Huang, Shijin Wang","year":"2020","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Wang et al., 2021] Chenyang Wang, Weizhi Ma, Min Zhang, Chuancheng Lv, Fengyuan Wan, Huijie Lin, Tao- ran Tang, Yiqun Liu, and Shaoping Ma. Temporal cross- effects in knowledge tracing. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pages 517-525, 2021.","title":"Temporal crosseffects in knowledge tracing","authors":"Chenyang Wang, Weizhi Ma, Min Zhang, Chuancheng Lv, Fengyuan Wan, Huijie Lin, Taoran Tang, Yiqun Liu, Shaoping Ma","year":"2021","venue":"Proceedings of the 14th ACM International Conference on Web Search and Data Mining","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}