journal article·2025-04-25Open access

Methods for Cognitive Diagnosis of Students’ Abilities Based on Keystroke Features

Xu Chi, Xinyu Guo, Yu Sheng

Applied Sciences· Volume 15· Issue 9

Abstract

Keystroke data contain the behavioral information of students during the programming process. The clustering analysis of keystroke data can classify students based on specific characteristics in the programming process, thereby providing a basis for personalized teaching. Research combined with keystroke features is still in its initial stage. Due to the independence and discreteness of keystroke data, and the lack of a clear requirement for the selection of the number of clusters in traditional clustering algorithms, this selection is rather arbitrary, and outliers will affect the clustering effect. Aiming at the above problems, we improve the original method. Keystroke data were used to obtain students’ programming behavior information and optimize the traditional clustering algorithm according to the characteristics of keystroke data. The K-means++ algorithm was adopted to determine the initial clustering centers, the elbow method was used to determine the number of clusters, and an outlier processing algorithm was introduced. We have independently constructed a keystroke dataset for computer-based programming examinations and used it to verify our method. Moreover, the improved algorithm has shown improvements in multiple evaluation indicators. Experiments have proven that the method proposed in this paper can more accurately classify students’ proficiency levels in the evaluation of students’ programming abilities in the educational field. This provides strong support for the formulation of teaching strategies and the allocation of resources, and the method possesses important application value and practical significance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Foreign Language Teaching Methods · Intelligent Tutoring Systems and Adaptive Learning · Innovative Educational Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science, Central South University, Changsha 410000, China

Xinjiang Technical Institute of Physics and Chemistry, University of Chinese Academy of Sciences, Urumqi 830011, China

References (20)

Show source-provided references
1. Analysis of Teaching Problems and Countermeasures in Computer Programming Courses
2. Research on cognitive diagnosis in English testing
3. Examining the transcription-writing link: Effects of handwriting fluency and spelling accuracy on writing performance via planning and translating in middle grades10.1016/j.lindif.2016.11.004 ↗
4. Leinonen, J. (2019). Keystroke Data in Programming Courses, University of Helsinki.
5. Cognitive Learning Strategies in an Introductory Computer Programming Course
6. Continuous Identity Authentication by Integrating Keystroke Content and Keystroke Behavior
7. A Review of Keystroke Dynamics Research
8. Epp, C., Lippold, M., and Mandryk, R.L. (2011, January 7–12). Identifying emotional states using keystroke dynamics. Proceedings of the Sigchi Conference on Human Factors in Computing Systems, Vancouver, BC, Canada.10.1145/1978942.1979046 ↗
9. Khan, M.F.A., Edwards, J., Bodily, P., and Karimi, H. (2023, January 15–18). Deciphering Student Coding Behavior: Interpretable Keystroke Features and Ensemble Strategies for Grade Prediction. Proceedings of the 2023 IEEE International Conference on Big Data (BigData), Sorrento, Italy.10.1109/BigData59044.2023.10386085 ↗
10. Shrestha, R., Leinonen, J., Zavgorodniaia, A., Hellas, A., and Edwards, J. (2022, January 25–27). Pausing While Programming: Insights From Keystroke Analysis. Proceedings of the 2022 IEEE/ACM 44th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET), Pittsburgh, PA, USA.10.1109/ICSE-SEET55299.2022.9794163 ↗
11. A Review of Clustering Algorithms
12. Cognitive diagnosis models for multiple strategies10.1111/bmsp.12155 ↗
13. James, F.E., Feldhausen, R., Bean, N.H., Weese, J., Allen, D.S., and Friend, M. (March, January 26). From Typing to Insights: An Interactive Code Visualization for Enhanced Student Support Using Keystroke Data. Proceedings of the 56th ACM Technical Symposium on Computer Science Education V 2, Pittsburgh, PA, USA.
14. Nakada, T., and Miura, M. (2024). Extracting typing game keystroke patterns as potential indicators of programming aptitude. Front. Comput. Sci., 6.10.3389/fcomp.2024.1412458 ↗
15. Educational Data Mining for Student Learning Pattern Analysis using Clustering Algorithms10.35940/ijeat.F1528.089620 ↗
16. Aggarwal, C.C., and Reddy, C.K. (2014). Data Clustering: Algorithms and Applications. 2013, CRC Press.10.1201/b15410 ↗
17. Patel, G.K., Dabhi, V.K., and Prajapati, H.B. (2015). Study and Analysis of Particle Swarm Optimization for Improving Partition Clustering, IEEE.10.1109/ICACEA.2015.7164699 ↗
18. K-means Clustering Algorithm with Optimized Initial Clustering Centers
19. Chen, Q. (2007). Contemporary Educational Psychology, Beijing Normal University Press.
20. The Complexity of Education and Nonlinear Laws