journal article·2020-02-26Open access

A Study of the Effectiveness Verification of Computer-Based Dementia Assessment Contents (Co-Wis): Non-Randomized Study

Seung Il Song, Hyun Seok Jeong, Jung Pil Park, Ji Yean Kim, Dai Seg Bai, Gi Hwan Kim, Dong Hoon Cho, Bon Hoon Koo, Hye Geum Kim

Applied Sciences· Volume 10· Issue 5

Abstract

Computer-based neuropsychological assessments have many advantages over traditional neuropsychological assessments. However, limited data are available on the validity and reliability of computer-based assessments. The purpose of this study was to examine the reliability and validity of computer-based dementia assessment contents (Co-Wis). This study recruited 113 participants from Yeungnam University Medical Center in Daegu from June 2019 to December 2019 and received ethical approval. Participants were evaluated using standard and objective dementia cognitive test tools such as the Korean version of the Mini-Mental State Examination (K-MMSE), the Clinical Dementia Rating Scale (CDR), and the Standardized Seoul Neuropsychological Screening Battery-II (SNSB-II). To verify the effectiveness of Co-Wis, the concurrent validity, test–retest reliability (Pearson’s correlation coefficients), construct validity (Factor analysis), and signal detection analysis (ROC curve) were used. In most of the Co-Wis subtests, the concurrent validity and test–retest reliability showed statistically significant correlations (p < 0.05, p < 0.01). The factor analysis showed that Co-Wis assessed the most major cognitive areas (Tucker–Lewis Index (TLI) = 0.876, Comparative Fit Index (CFI) = 0.897, RMSEA = 0.88). Thus, Co-Wis appears clinically applicable and with high reliability and validity. In the future, we should develop tests to evaluate both standard data and big data-based machine learning.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Dementia and Cognitive Impairment Research · Health and Wellbeing Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Corporate Research Institute of Clupea, Inc., Daegu 41585, Korea

Division of Clinical Psychology, Department of Psychiatry, Yeungnam University, Daegu 42415, Korea

Department of Psychiatry, College of Medicine, Yeungnam University, Daegu 42415, Korea

Funding

Ministry of Science and ICT(Republic of Korea)

References (39)

Show source-provided references
1. Major Depressive Disorder in Family Caregivers of Patients with Dementia
2. Korean national dementia plans: From 1st to 3rd10.5124/jkma.2018.61.5.298 ↗
3. Sarant, J.S., Harris, D., Busby, P., Maruff, P., Schembri, A., Lemke, U., and Launer, S. (2020). The Effect of Hearing Aid Use on Cognition in Older Adults: Can We Delay Decline or Even Improve Cognition Function?. J. Clin. Med., 9.10.3390/jcm9010254 ↗
4. Lee, J.E., Shin, D.W., Han, K., Kim, D., Yoo, J.E., Lee, J., Kim, S.Y., Son, K.Y., Cho, B., and Kim, M.J. (2020). Change in Metabolic Syndrome Status and Risk of Dementia. J. Clin. Med., 9.10.3390/jcm9010122 ↗
5. Early Diagnosis of Dementia
6. Seoul Neuropsychological Screening Battery-Dementia Version(SNSB-D): A Useful Tool for Assessment and Monitoring Cognitive Impairments in Dementia Patients10.3346/jkms.2010.25.7.1071 ↗
7. A Study of the Reliability and the Validity of Clinical Data Interchange Standards Consortium(CDISC) based Nonpharmacy Dementia Diagnosis Contents(Co-Wis)
8. Computerized Cognitive Testing for Older Adults: A review
9. A Systematic Review of Computerized Cognitive Function Tests for the Screening of Mild Cognitive Impairment10.14519/jksot.2016.24.2.02 ↗
10. George-Hyslop, P.H. St. Prediction of probable Alzheimer’s disease in memory-impaired patients: A prospective longitudinal study
11. Willingness to use computerized systems for the diagnosis of dementia testing a theoretical model in an Israeli sample10.1097/WAD.0b013e318222323e ↗
12. Cognitive Assessment for Patient with Brain Injury by Computerized Neuropsychological
13. The Study of the Usefulness of Computerized Neuropsychological Test (STIM) in Traumatic Brain-injury Patients
14. The Comparison of Acupuncture Sensation Index Among Three Different Acupuncture Devices
15. Neurocognitive Assessment of Geriatric Patients
16. Difference in Sleep, Fatigue, and Neurocognitive Function between Shift Nurses and Non-shift Nurses10.7475/kjan.2017.29.2.190 ↗
17. Analysis of Correlation between Cognitive Function and Speech Recognition in Noise10.3342/kjorl-hns.2010.53.4.215 ↗
18. American Occupational Therapy Association (2014). Occupational therapy practice framework: Domain & process(3rd edition). Am. J. Occup. Ther., 68, 1–48.10.5014/ajot.2014.68S1 ↗
19. Montes, R.M., Lobete, L.D., Pereira, J., Schoemaker, M.M., Riego, S.S., and Pousada, T. (2020). Identifying Children with Developmental Coordination Disorder via Parental Questionnaires. Spanish Reference Norms for the DCDDaily-Q-ES and Correlation with the DCDQ-ES. Int. J. Environ. Res. Public Health, 17.10.3390/ijerph17020555 ↗
20. Wattad, R., Gabis, L.V., Shefer, S., Tresser, S., and Portnoy, S. (2020). Correlations between Performance in a Virtual Reality Game and the Movement Assessment Battery Diagnostic in Children with Developmental Coordination Disorder. Appl. Sci., 10.10.3390/app10030833 ↗
21. A Study on Reliability and Validity of the Korean Version of Impact of Event Scale-Revised
22. The Reliability and Validity of Useful Field of View Test
23. A Study on the Reliability and Validity of Seoul-Instrumental Activities of Daily Living(S-IADL)
24. Development and Standardization Process, and Factor Analysis of the Computerized Cognitive Function Test System for Korea Adults
25. A Guide on the Use of Factor Analysis in the Assess. Constr. Validity10.4040/jkan.2013.43.5.587 ↗
26. The Criteria for Selecting Appropriate Fit Indices in Structural Equation Modeling and Their Rationales
27. Predictive Validity of Pressure Ulcer Risk Assessment Scales among Patient in a Trauma Intensive Care Unit10.34250/jkccn.2019.12.2.26 ↗
28. Assessment of Cognitive skills via Human-robot Interaction and Cloud Computing10.1007/s42235-019-0043-2 ↗
29. Rossi, S., Santangelo, G., Staffa, M., Varrasi, S., Conti, D., and Di Nuovo, A. (2018, January 27–31). Psychometric Evaluation Supported by a Social Robot: Personality Factors and Technology Accpectance. Proceedings of the 2018 27th IEEE International Symposium on Robot and Human Interactive Communication RO-MAN2018, Nanjing, China.10.1109/ROMAN.2018.8525838 ↗
30. Effect of Motor Imagery Training with Visual and Kinesthetic Imagery Training on Balance Ability in Post Stroke Hemiparesis
31. A Research to Evaluate the Reliability and Validity of Pattern Identifications Tool for Cognitive Disorder: A Clinical Study Protocol
32. De Gruijter, D.N., and Leo, J.T. (2007). Statistical Test Theory for the Behavioral Science, CRC Press.10.1201/9781584889595 ↗
33. Bartels, C., Wegrzyn, M., Wiedl, A., Ackermann, V., and Ehrenreich, H. (2010). Practice effects in healthy adults: A longitudinal study on frequent repetitive cognitive testing. BMC Neurosci., 11.10.1186/1471-2202-11-118 ↗
34. Han, S.S., and Lee, S.C. (2018). Nursing and Health Statistical Analysis, Hannarae Publishing.
35. Structural Equation Modeling: Guidelines for Determining Model Fit
36. Mobile Screening Test System for Mild Cognitive Impairment: Concurrent validity with the Montreal Cognitive Assessment and Inter-rater Reliablity
37. The Validity of Reliability of Computerized Comprehensive Neurocognitive Function Test in the Elderly
38. Validity and Reliability of Tablet PC-Based Cognitive Assessment Tools for Stroke Patients10.14519/kjot.2019.27.4.04 ↗
39. Takahashi, J., Kawai, H., Suzuki, H., Fujiwara, Y., Watanabe, Y., Hirano, H., Kim, H., Ihara, K., Miki, A., and Obuchi, S. (2020). Development and validity of the Computer-Based Cognitive Assessment Tool for intervention in community-dwelling older individuals. Geriatr. Gerontol. Int., 1–5.10.1111/ggi.13836 ↗