journal article·2025-06-02Open access

Dynamic Handwriting Features for Cognitive Assessment in Inflammatory Demyelinating Diseases: A Machine Learning Study

Jiali Yang, Chaowei Yuan, Yiqiao Chai, Yukun Song, Shuning Zhang, Junhui Li, Mingying Lan, Li Gao

Applied Sciences· Volume 15· Issue 11

Abstract

Cognitive impairment is common but often overlooked in patients with inflammatory demyelinating diseases such as multiple sclerosis and neuromyelitis optica spectrum disorder. The conventional assessments may fail to detect subtle deficits and require substantial time and expertise. We collected neuropsychological scores and real-time handwriting data across nine drawing tasks and tasks from the Symbol Digit Modalities Test in 93 patients. Temporal, pressure, and kinematic features were extracted, and machine learning classifiers were trained using five-fold cross-validation with bootstrap confidence intervals. The response timing and pen pressure metrics correlated significantly with global cognitive scores (|r| = 0.30–0.37, p < 0.01). A support vector machine using eight selected features achieved an area under the receiver-operating characteristic curve (AUC) of 0.910, and a streamlined five-feature variant maintained an equivalent performance (AUC = 0.921) while reducing the assessment time by 35%. These results indicate that digital handwriting metrics can complement the standard screening by capturing fine motor and temporal characteristics overlooked in conventional testing. Validation in larger, disease-balanced, and longitudinal cohorts is needed to confirm their clinical utility.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Multiple Sclerosis Research Studies · Hereditary Neurological Disorders · Systemic Lupus Erythematosus Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China

School of Digital Media and Design Arts, Beijing University of Posts and Telecommunications, Beijing 100876, China

School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China

Funding

National Natural Science Foundation of China · Beijing University of Posts and Telecommunications (BUPT)

References (50)

Show source-provided references
1. CNS Inflammatory Demyelinating Disorders: MS, NMOSD and MOG Antibody Associated Disease10.1136/jim-2019-001126 ↗
2. The Prevalence of Cognitive Impairment in Patients with Neuromyelitis Optica Spectrum Disorders (NMOSD): A Systematic Review and Meta-Analysis10.1016/j.msard.2021.102757 ↗
3. Cognitive Impairment in Multiple Sclerosis: Clinical Management, MRI, and Therapeutic Avenues10.1016/S1474-4422(20)30277-5 ↗
4. Cognitive Dysfunction in Early Multiple Sclerosis: A Review10.1093/qjmed/hcx070 ↗
5. The Brief Repeatable Battery of Neuropsychological Tests: Normative Values Allow Application in Multiple Sclerosis Clinical Practice10.1177/135245850100700409 ↗
6. Recommendations for a Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS)10.1177/1352458511431076 ↗
7. The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool for Mild Cognitive Impairment10.1111/j.1532-5415.2005.53221.x ↗
8. Longitudinal Change in Performance on the Montreal Cognitive Assessment in Older Adults10.1080/13854046.2015.1087596 ↗
9. Floor and Ceiling Effects on the Montreal Cognitive Assessment in Patients with Parkinson’s Disease in Brazil10.1590/1980-5764-dn-2023-0022 ↗
10. Telehealth Equivalence of the Montreal Cognitive Assessment (MoCA): Results from the Emory Healthy Brain Study (EHBS)10.1111/jgs.18271 ↗
11. Cognition in Multiple Sclerosis10.1212/WNL.0000000000004977 ↗
12. The Symbol Digit Modalities Test (SDMT) Is Sensitive but Non-Specific in MS: Lexical Access Speed, Memory, and Information Processing Speed Independently Contribute to SDMT Performance10.1016/j.msard.2021.102950 ↗
13. Repeated Forms, Testing Intervals, and SDMT Performance in a Large Multiple Sclerosis Dataset10.1016/j.msard.2022.104375 ↗
14. A Comprehensive Review of the Paced Auditory Serial Addition Test (PASAT)10.1016/j.acn.2005.07.006 ↗
15. Oreja-Guevara, C., Ayuso Blanco, T., Brieva Ruiz, L., Hernández Pérez, M.Á., Meca-Lallana, V., and Ramió-Torrentà, L. (2019). Cognitive Dysfunctions and Assessments in Multiple Sclerosis. Front. Neurol., 10.10.3389/fneur.2019.00581 ↗
16. Interrater Reliability of Neuropsychological Diagnoses: A Department of Veterans Affairs Cooperative Study10.1017/S1355617702814333 ↗
17. Vessio, G. (2019). Dynamic Handwriting Analysis for Neurodegenerative Disease Assessment: A Literary Review. Appl. Sci., 9.10.3390/app9214666 ↗
18. The “Handwriting Brain”: A Meta-Analysis of Neuroimaging Studies of Motor versus Orthographic Processes10.1016/j.cortex.2013.05.011 ↗
19. Smartphone-Based Symbol-Digit Modalities Test Reliably Captures Brain Damage in Multiple Sclerosis10.1038/s41746-021-00401-y ↗
20. A Handwriting-Based Protocol for Assessing Neurodegenerative Dementia10.1007/s12559-019-09642-2 ↗
21. Bisio, A., Pedullà, L., Bonzano, L., Tacchino, A., Brichetto, G., and Bove, M. (2017). The Kinematics of Handwriting Movements as Expression of Cognitive and Sensorimotor Impairments in People with Multiple Sclerosis. Sci. Rep., 7.10.1038/s41598-017-18066-7 ↗
22. Bonzano, L., Sormani, M.P., Tacchino, A., Abate, L., Lapucci, C., Mancardi, G., Uccelli, A., and Bove, M. (2013). Quantitative Assessment of Finger Motor Impairment in Multiple Sclerosis. PLoS ONE, 8.10.1371/journal.pone.0065225 ↗
23. Chen, S., Stromer, D., Alabdalrahim, H.A., Schwab, S., Weih, M., and Maier, A. (2020). Automatic Dementia Screening and Scoring by Applying Deep Learning on Clock-Drawing Tests. Sci. Rep., 10.10.1038/s41598-020-74710-9 ↗
24. Detection of Mild Cognitive Impairment through Hand Motor Function under Digital Cognitive Test: Mixed Methods Study10.2196/48777 ↗
25. Smits, E.J., Tolonen, A.J., Cluitmans, L., van Gils, M., Conway, B.A., Zietsma, R.C., Leenders, K.L., and Maurits, N.M. (2014). Standardized Handwriting to Assess Bradykinesia, Micrographia and Tremor in Parkinson’s Disease. PLoS ONE, 9.10.1371/journal.pone.0097614 ↗
26. Cognitive and Psychopathological Features of Neuromyelitis Optica Spectrum Disorder and Myelin Oligodendrocyte Glycoprotein Antibody-Associated Disease: A Narrative Review10.1016/j.msard.2024.105596 ↗
27. Guo, H., Feng, B., Ma, Y., Zhang, X., Fan, H., Dong, Z., Chen, T., and Gong, Q. (2023). Analysis of the Screening and Predicting Characteristics of the House-Tree-Person Drawing Test for Mental Disorders: A Systematic Review and Meta-Analysis. Front. Psychiatry, 13.10.3389/fpsyt.2022.1041770 ↗
28. Rating Neurologic Impairment in Multiple Sclerosis: An Expanded Disability Status Scale (EDSS)10.1212/WNL.33.11.1444 ↗
29. Enhanced Diagnostic Accuracy for Neurocognitive Disorders: A Revised Cut-off Approach for the Montreal Cognitive Assessment10.1186/s13195-020-00603-8 ↗
30. Age- and Education-Adjusted Normative Data for the Montreal Cognitive Assessment (MoCA) in Older Adults Aged 70–9910.1080/13825585.2015.1041449 ↗
31. The Montreal Cognitive Assessment (MoCA) as a Screening Test for Cognitive Dysfunction in Multiple Sclerosis10.1080/23279095.2016.1243108 ↗
32. Yu, J., Li, J., and Huang, X. (2012). The Beijing Version of the Montreal Cognitive Assessment as a Brief Screening Tool for Mild Cognitive Impairment: A Community-Based Study. BMC Psychiatry, 12.10.1186/1471-244X-12-156 ↗
33. The H-T-P Technique. A Qualitative and Quantitative Scoring Manual10.1002/1097-4679(194810)4:4<317::AID-JCLP2270040402>3.0.CO;2-6 ↗
34. Potticary, H., and Langdon, D. (2023). A Systematic Review and Meta-Analysis of the Brief Cognitive Assessment for Multiple Sclerosis (BICAMS) International Validations. J. Clin. Med., 12.10.3390/jcm12020703 ↗
35. Wacom (2025, May 18). Introduction|Wacom Developer Documentation. Wacom.com., Available online: https://developer-docs.wacom.com/docs/sdk-for-ink/overview/.
36. Evaluation of Handwriting Kinematics and Pressure for Differential Diagnosis of Parkinson’s Disease10.1016/j.artmed.2016.01.004 ↗
37. Mice: Multivariate Imputation by Chained Equations in R10.18637/jss.v045.i03 ↗
38. Morris, T.P., White, I.R., and Royston, P. (2014). Tuning Multiple Imputation by Predictive Mean Matching and Local Residual Draws. BMC Med. Res. Methodol., 14.10.1186/1471-2288-14-75 ↗
39. Small Sample Sizes: A Big Data Problem in High-Dimensional Data Analysis10.1177/0962280220970228 ↗
40. Salman, R., Alzaatreh, A., Sulieman, H., and Faisal, S. (2021). A Bootstrap Framework for Aggregating Within and Between Feature Selection Methods. Entropy, 23.10.3390/e23020200 ↗
41. Pudjihartono, N., Fadason, T., Kempa-Liehr, A.W., and O’Sullivan, J.M. (2022). A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction. Front. Bioinform., 2.10.3389/fbinf.2022.927312 ↗
42. Hosmer, D.W., and Lemeshow, S. (2000). Applied Logistic Regression, John Wiley & Sons, Inc.10.1002/0471722146 ↗
43. Random Forests10.1023/A:1010933404324 ↗
44. Support-Vector Networks10.1007/BF00994018 ↗
45. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD ’16), San Francisco, CA, USA.10.1145/2939672.2939785 ↗
46. Learning from Imbalanced Data10.1109/TKDE.2008.239 ↗
47. Varma, S., and Simon, R. (2006). Bias in Error Estimation When Using Cross-Validation for Model Selection. BMC Bioinform., 7.10.1186/1471-2105-7-91 ↗
48. Caruana, R., and Niculescu-Mizil, A. (2006, January 25–29). An Empirical Comparison of Supervised Learning Algorithms. Proceedings of the 23rd International Conference on Machine Learning (ICML ’06), Pittsburgh, PA, USA.10.1145/1143844.1143865 ↗
49. Cognitive Assessment in Neuromyelitis Optica Spectrum Disorders: A Systematic Review and Meta-Analysis (P7-8.014)10.1212/WNL.0000000000212620 ↗
50. Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, Routledge. [2nd ed.].