journal article·2025-02-01Open access

Deep Knowledge Tracing Integrating Temporal Causal Inference and PINN

Faming Lu, Yingran Li, Yunxia Bao

Applied Sciences· Volume 15· Issue 3

Abstract

Knowledge tracing predicts students’ future performance based on their historical performance data, which is significant for students’ learning resource recommendation, learning path prediction, and other aspects. Students’ knowledge mastery, learning ability, and question difficulty all influence the performance metrics of knowledge tracing. This paper proposes a deep knowledge tracing model that integrates temporal causal inference and the PINN (Physics-Informed Neural Network) model. The model first uses the temporal causality model to explores the causal relationships between students’ knowledge points, which is then combined with the deep learning-based knowledge tracing model for prediction. Next, it treats the logical model as a ’physical model’, adds a loss term, considers the confounding factors caused by students’ answer preferences, and adjusts students’ learning ability through backdoors to obtain more accurate predictions. In the public education datasets ASSISTment2012 and ASSISTchall, the predictive performance of the TLPKT-PINN model is superior to some classical models and LPKT. From the experimental results, we can conclude that considering the degree of mastery of causal knowledge points and adjusting the loss term can improve the accuracy of predicting student grades.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · AI-based Problem Solving and Planning · Intelligent Tutoring Systems and Adaptive Learning

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao 266590, China

College of Mathematics and System Science, Shandong University of Science and Technology, Qingdao 266590, China

Funding

National Science and Technology, the Major Basic Research Project of the Shandong Provincial Natural Science Foundation · NSFC · Sci. & Tech. Development Fund of Shandong Province of China · Taishan Scholar Program of Shandong Province · Science and Technology Program Special Project of Qingdao West Coast New Area

References (28)

Show source-provided references
1. Impact of AI assistance on student agency10.1016/j.compedu.2023.104967 ↗
2. Enhanced learning resource recommendation based on online learning style model10.26599/TST.2019.9010014 ↗
3. Shen, S., Liu, Q., Huang, Z., Zheng, Y., Yin, M., Wang, M., and Chen, E. (2021). A survey of knowledge tracing. arXiv.
4. Knowledge tracing: Modeling the acquisition of procedural knowledge10.1007/BF01099821 ↗
5. Hidden markov models10.1016/S0959-440X(96)80056-X ↗
6. Piech, C., Bassen, J., Huang, J., Ganguli, S., Sahami, M., Guibas, L.J., and Sohl-Dickstein, J. (2015). Deep Knowledge Tracing. Adv. Neural Inform. Process. Syst., 28.
7. Serial order: A parallel distributed processing approach10.1016/S0166-4115(97)80111-2 ↗
8. Shen, S., Liu, Q., Chen, E., Huang, Z., Huang, W., Yin, Y., Su, Y., and Wang, S. (2021, January 14–18). Learning process-consistent knowledge tracing. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, Virtual.10.1145/3447548.3467237 ↗
9. Hybrid models for knowledge tracing: A systematic literature review10.1109/TLT.2023.3348690 ↗
10. Dynamic Bayesian networks for student modeling10.1109/TLT.2017.2689017 ↗
11. De Baker, R.S.J., Corbett, A.T., and Aleven, V. (2008, January 23–27). More accurate student modeling through contextual estimation of slip and guess probabilities in Bayesian knowledge tracing. Proceedings of the 9th International Conference on Intelligent Tutoring Systems (LNCS 5091), Montreal, QC, Canada.10.1007/978-3-540-69132-7_44 ↗
12. Use of Deep Learning for Continuous Prediction of Mortality for All Admissions in Intensive Care Units10.26599/TST.2022.9010027 ↗
13. Time-aware LSTM neural networks for dynamic personalized recommendation on business intelligence10.26599/TST.2023.9010025 ↗
14. Zhang, J., Shi, X., King, I., and Yeung, D.Y. (2017, January 3–7). Dynamic key-value memory networks for knowledge tracing. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.10.1145/3038912.3052580 ↗
15. Nakagawa, H., Iwasawa, Y., and Matsuo, Y. (2019, January 14–17). Graph-based knowledge tracing: Modeling student proficiency using graph neural network. Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence, Thessaloniki, Greece.10.1145/3350546.3352513 ↗
16. Ghosh, A., Heffernan, N., and Lan, A.S. (2020, January 6–10). Context-aware attentive knowledge tracing. Proceedings of the 26th ACM SIGKDD International Conference On Knowledge Discovery & DATA Mining, Virtual.10.1145/3394486.3403282 ↗
17. Novel framework for an intrusion detection system using multiple feature selection methods based on deep learning10.26599/TST.2023.9010032 ↗
18. STDNet: A Spatio-Temporal Decomposition Neural Network for Multivariate Time Series Forecasting10.26599/TST.2023.9010105 ↗
19. Daley, D.J., and Vere-Jones, D. (2003). An Introduction to the Theory of Point Processes: Volume I: Elementary Theory and Methods, Springer.
20. Investigating causal relations by econometric models and cross-spectral methods
21. Graphical models for marked point processes based on local independence10.1111/j.1467-9868.2007.00634.x ↗
22. Graphical modeling for multivariate Hawkes processes with nonparametric link functions10.1111/jtsa.12213 ↗
23. Inferring solutions of differential equations using noisy multi-fidelity data10.1016/j.jcp.2017.01.060 ↗
24. Machine learning of linear differential equations using Gaussian processes10.1016/j.jcp.2017.07.050 ↗
25. Bayesian numerical homogenization10.1137/140974596 ↗
26. Williams, C.K.I., and Rasmussen, C.E. (2006). Gaussian Processes for Machine Learning, MIT Press.
27. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations10.1016/j.jcp.2018.10.045 ↗
28. Learning time series associated event sequences with recurrent point process networks10.1109/TNNLS.2018.2889776 ↗