journal article·2022-09-29Open access

NeuralNCD: A Neural Network Cognitive Diagnosis Model Based on Multi-Dimensional Features

Guangquan Li, Yuqing Hu, Junkai Shuai, Tonghua Yang, Yonghong Zhang, Shiming Dai, Naixue Xiong

Applied Sciences· Volume 12· Issue 19

Abstract

One of the most critical functions of modern intelligent teaching technology is cognitive diagnostics. Traditional cognitive diagnostic models (CDMs) usually use designed functions to deal with the linear interaction between students and exercises, but it is difficult to adequately deal with the complex relationship of non-linear interaction between students and exercises; moreover, existing cognitive diagnostic models often lack the integrated consideration of multiple features of exercises. To address these issues, this paper proposes a neural network cognitive diagnosis model (NeuralNCD) that incorporates multiple features. The model obtains more accurate diagnostic results by using neural networks to handle the nonlinear interaction between students and exercises. First, the student vector and the exercise vector are obtained through the Q-matrix; second, the multi-dimensional features of the exercises (e.g., difficulty, discrimination, guess and slip) are obtained using the neural network; finally, item response theory and a neural network are employed to characterize the interaction between the student and the exercise in order to determine the student’s cognitive state. At the same time, monotonicity assumptions and data preprocessing mechanisms are introduced into the neural network to improve the accuracy of the diagnostic results. Extensive experimental results on real world datasets present the effectiveness of NeuralNCD with regard to both accuracy and interpretability for diagnosing students’ cognitive states. The prediction accuracy (ACC), root mean square error (RMSE), and area under the curve (AUC) were 0.734, 0.425, and 0.776, respectively, which were about 2–10% higher than the related works in these evaluation metrics.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Intelligent Tutoring Systems and Adaptive Learning · Online Learning and Analytics · Brain Tumor Detection and Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer and Information Engineering, Jiangxi Agriculture University, Nanchang 330045, China

School of Vocational Teachers, Jiangxi Agriculture University, Nanchang 330045, China

School of Information Engineering, Jiangxi Vocational College of Mechanical & Electrical Technology, Nanchang 330013, China

Department of Computer, Mathematical and Physical Sciences, Sul Ross State University, Alpine, TX 79830, USA

Funding

Key Project of Education Science Planning in Jiangxi Province

References (35)

Show source-provided references
1. Burns, H., Luckhardt, C.A., Parlett, J.W., and Redfield, C.L. (2014). Intelligent Tutoring Systems: Evolutions in Design, Psychology Press.10.4324/9781315807492 ↗
2. Anderson, A., Huttenlocher, D., Kleinberg, J., and Leskovec, J. (2014, January 7–11). Engaging with massive online courses. Proceedings of the 23rd International Conference on World Wide Web, Seoul, Korea.10.1145/2566486.2568042 ↗
3. Data security and privacy protection for cloud storage: A survey10.1109/ACCESS.2020.3009876 ↗
4. A review of knowledge tracking
5. The rapid calculation method of DINA model for large scale cognitive diagnosis
6. 31a review of cognitively diagnostic assessment and a summary of psychometric models10.1016/S0169-7161(06)26031-0 ↗
7. Liu, Q. (2021, January 19–26). Towards a New Generation of Cognitive Diagnosis. Proceedings of the 30th International Joint Conference on Artificial Intelligence, Montreal, QC, Canada.10.24963/ijcai.2021/703 ↗
8. A hierarchical IRT model for criterion-referenced measurement10.2307/1165207 ↗
9. DINA model and parameter estimation: A didactic10.3102/1076998607309474 ↗
10. Embretson, S.E., and Reise, S.P. (2013). Item Response Theory, Psychology Press.10.4324/9781410605269 ↗
11. Matrix factorization techniques for recommender systems10.1109/MC.2009.263 ↗
12. Sciuto, G.L., Susi, G., Cammarata, G., and Capizzi, G. (2016, January 22–24). A spiking neural network-based model for anaerobic digestion process. Proceedings of the 2016 International Symposium on Power Electronics, Electrical Drives, Automation and Motion, Capri, Italy.
13. A pedestrian detection method based on genetic algorithm for optimize XGBoost training parameters10.1109/ACCESS.2019.2936454 ↗
14. Wang, F., Liu, Q., Chen, E., Huang, Z., Chen, Y., Yin, Y., and Wang, S. (2020, January 7–12). Neural cognitive diagnosis for intelligent education systems. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.
15. Ioffe, S., and Szegedy, C. (2015, January 7–9). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning, Lille, France.
16. A hybrid e-learning recommendation approach based on learners’ influence propagation10.1109/TKDE.2019.2895033 ↗
17. Predicting achievement and providing support before STEM majors begin to fail10.1016/j.compedu.2020.103999 ↗
18. Preference cognitive diagnosis for student performance prediction10.1109/ACCESS.2020.3042775 ↗
19. Using JAGS for Bayesian Cognitive Diagnosis Modeling: A Tutorial10.3102/1076998619826040 ↗
20. Reckase, M.D. (2009). Multidimensional item response theory models. Multidimensional Item Response Theory, Springer.10.1007/978-0-387-89976-3 ↗
21. Fuzzy cognitive diagnosis for modelling examinee performance
22. Higher-order latent trait models for cognitive diagnosis10.1007/BF02295640 ↗
23. GDINA: An R package for cognitive diagnosis modeling10.18637/jss.v093.i14 ↗
24. Wang, D., Cai, Y., and Tu, D. (2020). Q-matrix estimation methods for cognitive diagnosis models: Based on partial known Q-matrix. Multivar. Behav. Res., 1–13.10.1080/00273171.2020.1746901 ↗
25. Dong, L., Ling, Z., Ling, Q., and Lai, Z. (2022). Cognitive Diagnosis with Explicit Student Vector Estimation and Unsupervised Question Matrix Learning. arXiv.
26. Zhan, P., Man, K., Wind, S.A., and Malone, J. (2022). Cognitive Diagnosis Modeling Incorporating Response Times and Fixation Counts: Providing Comprehensive Feedback and Accurate Diagnosis. J. Educ. Behav. Stat.10.31234/osf.io/5bprq ↗
27. Spatio-temporal vessel trajectory clustering based on data mapping and density10.1109/ACCESS.2018.2866364 ↗
28. BD-VTE: A novel baseline data based verifiable trust evaluation scheme for smart network systems10.1109/TNSE.2020.3014455 ↗
29. Exploring finger vein based personal authentication for secure IoT10.1016/j.future.2017.07.013 ↗
30. Cheng, S., Liu, Q., Chen, E., Huang, Z., Huang, Z., Chen, Y., and Hu, G. (2019, January 3–7). DIRT: Deep learning enhanced item response theory for cognitive diagnosis. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China.10.1145/3357384.3358070 ↗
31. Cheng, S., Liu, Q., and Chen, E. (2020). Domain adaption for knowledge tracing. arXiv.
32. A structure fidelity approach for big data collection in wireless sensor networks10.3390/s150100248 ↗
33. Wu, S., and Flach, P. (2005). A Scored AUC Metric for Classifier Evaluation and Selection, Second Workshop on ROC analysis in ML.
34. A simple generalisation of the area under the ROC curve for multiple class classification problems10.1023/A:1010920819831 ↗
35. Mnih, A., and Salakhutdinov, R.R. (2007, January 12). Probabilistic matrix factorization. Proceedings of the NIPS’07: 20th International Conference on Neural Information Processing Systems, Vancouver, BC, Canada.