Using Technology for the Efficient and Precise Assessment of Cognitive Skills in Countries with Limited Standardized Assessment Instruments: A Report on the Case of Saudi Arabia
Source abstract
Abstract
In Saudi Arabia, the country’s progress toward appropriate and inclusive education programs for children with disabilities is still evolving. A crucial aspect of this evolution has been the development of a comprehensive assessment battery that covers a broad range of cognitive factors for the diagnosis of neurodevelopment disorders and other types of intellectual atypicalities, including giftedness. The Alif–Ya Assessment Battery consists of 47 subtests based on various theories of intelligence. Alif–Ya capitalizes on advanced technologies to enable its delivery either in person or remotely. Moreover, over half of Alif–Ya’s subtests are adaptive; items are selected for the test takers based on their previous responses. In this paper, we provide an overview of the Alif–Ya Assessment Battery, describe how it was designed to make the best use of the latest and best features of technology for the appropriate and accurate assessment of children and adolescents in the Kingdom of Saudi Arabia via remote or in-person administration, and present initial data collected with the battery.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Cognitive Abilities and Testing · Cognitive and developmental aspects of mathematical skills · Reading and Literacy Development
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Texas Institute of Measurement, Evaluation and Statistics, University of Houston, 4349 Martin Luther King Boulevard, Houston, TX 77204-60220, USA
Department of Psychiatry, School of Medicine, Yale University, 300 George Street, New Haven, CT 06511, USA
National Center for Assessment in Higher Education, King Khaled Road, Riyadh 11537, Saudi Arabia
MindTrust, Inc., 470 James Street, #11, New Haven, CT 06513, USA
Center for Cognitive Sciences, Sirius University, 354340 Sirius, Russia
Child Study Center, School of Medicine, Yale University, 230 S Frontage Road, New Haven, CT 06520, USA
Funding
Ministry of Higher Education of the Kingdom of Saudi Arabia
References (58)
Show source-provided references
1. Alnahdi, G.H. (2007). The Extent of Applying the Rules and Guidelines of Assessment and Diagnosis Set Forth in the Regulations of Special Education Institutes and Programs for Students with Intellectual Disability. [Master’s Thesis, King Saud University].
2. Wechsler, D., and Kodama, H. (1949). Wechsler Intelligence Scale for Children, Psychological Corporation.
3. Terman, L.M., and Merrill, M.A. (1960). Stanford-Binet Intelligence Scale: Manual for the third revision, Form L-M, Houghton Mifflin.
4. Special education programs for students with intellectual disability in Saudi Arabia: Issues and recommendations
5. The intelligence scale for children in the Saudi environment
6. Assessment and prediction of mental retardation in Saudi children10.1023/A:1013567814055 ↗
7. Leiter, R.G. (1969). General instructions for the Leiter International Performance Scale, Stoelting.
8. Beery, K.E. (1989). Manual for the Developmental Test of Visual-Motor Integration, Modern Curriculum Test. [3rd ed.].
9. Sparrow, S.S., Balla, D.A., and Cicchetti, D.V. (1984). Vineland Adaptive Behavior Scales, American Guidance Service.
10. The Arabic version of the Stroop test and its equivalency to the English version
11. A group version of the Stroop colour and word test10.1207/s15327752jpa3904_10 ↗
12. Saudi normative data for the Wisconsin card sorting test, Stroop test, test of non-verbal intelligence-3, picture completion and vocabulary (subtest of the Wechsler adult intelligence scale-revised)
13. Crawford, J.R., Parker, D.M., and McKinlat, W.W. (1992). Assessment of front lobe dysfunction. A Handbook of Neuropsychological Assessment, Lawrence Erlbaum Association.
14. Wechsler, D. (1981). WAIS-R Manual, The Psychological Corporation.
15. Brown, L., Sherbenou, R.J., and Johnsen, S.K. (1997). Test of Nonverbal Intelligence, PRO-ED. [3rd ed.].
16. The standardization of the standard progressive matrices in a Saudi sample
17. An increase of intelligence in Saudi Arabia, 1977–201010.1016/j.intell.2012.10.011 ↗
18. Utilization rates of computerized tests and test batteries among clinical neuropsychologists in the United States and Canada10.1037/a0037987 ↗
19. Raven, J.C., and Court, J. (1938). Raven’s Progressive Matrices, Western Psychological Services.
20. Conners’ continuous performance Test II (CPT II v. 5)
21. Assessment of neurological and behavioural function: The NIH Toolbox10.1016/S1474-4422(09)70335-7 ↗
22. Daniel, M. (2012). Equivalence of Q-interactive™-Administered Cognitive Tasks: CVLT-II and Selected D-KEFS Subtests, Pearson.
23. The test-retest reliability of a standardized neurocognitive and neurophysiological test battery:“neuromarker”10.1080/00207450590958475 ↗
24. Neuropsychology 3.0: Evidence-based science and practice10.1017/S1355617710001396 ↗
25. Computerized neuropsychological assessment devices: Joint position paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology10.1093/arclin/acs027 ↗
26. Computerized neuropsychological testing in epilepsy: Overview of available tools10.1016/j.seizure.2013.04.004 ↗
27. Adaptive testing by computer10.1037/0022-006X.53.6.774 ↗
28. Wall, J.E., and Walz, G.R. (2003). Computerized Adaptive Testing: An Introduction. Measuring Up: Assessment Issues for Teachers, Pro-Ed, Inc.
29. Moreno, K.E., and Hetter, R.D. (1997, January 14–16). Full Scale CAT-ASVAB Implementation: Challenges and Outcomes. Proceedings of the 39th Annual Conference of the International MIlitary Testing Association, Sydney, Australia.
30. Micromanaging time: Measuring and controlling timing errors in computer-controlled experiments10.3758/BF03203120 ↗
31. Adams, K.M., and Heaton, R.K. (1987). Computerized neuropsychological assessment: Issues and applications. Computerized Psychological Assessment: A Practitioner’s Guide, Basic Books.
32. Comparison of oral and computerized versions of the word memory test10.1093/arclin/acq060 ↗
33. Raw-score equivalence of computer-assisted and paper versions of WISC–V10.1037/ser0000295 ↗
34. Gonzalez, J., and Wiberg, M. (2017). Applying Test Equating Methods, Springer International Publishing.10.1007/978-3-319-51824-4 ↗
35. Wechsler Intelligence Scale for Children—V: Test review10.1080/21622965.2015.1015337 ↗
36. Psychological applications on the internet: A discipline on the threshold of a new millenium10.1016/S0962-1849(05)80038-1 ↗
37. Best practices for remote psychological assessment via telehealth technologies10.1037/a0034547 ↗
38. Glidden, L.M., Abbeduto, L., McIntryre, L.L., and Tasse, M.J. (2021). Theories and measurement of intelligence. APA Handbook of Intellectual and Developmental Disabilities: Foundations, American Psychological Association.10.1037/0000194-000 ↗
39. From the Binet–Simon to the Wechsler–Bellevue: Tracing the history of intelligence testing10.1076/jcen.24.3.383.981 ↗
40. Flanagan, D.P., and McDonough, E.M. (2018). A history of intelligence assessment: The unfinished tapestry. Contemporary Intellectual Assessment: Theories, Tests, and Issues, The Guilford Press.
41. Cattell, R.B. (1987). Intelligence: Its structure, growth, and action, Elsevier.
42. McGrew, K., Werder, J.K., and Woodcock, R.W. (1991). Measurement of intellectual capabilities: A review of theory. Woodcock-Johnson Technical Manual, Riverside Publishing.
43. Flanagan, D.P., and Harrison, P.L. (2005). The Cattell-Horn Theory of Cognitive Abilities: Past, present, and future. Contemporary Intellectual Assessment: Theories, Tests, and Issues, Guilford Press.
44. Intelligence and IQ: What teachers should know10.1080/01443410500344696 ↗
45. Can intelligence testing inform educational intervention for children with reading disability?10.3390/jintelligence3040137 ↗
46. Luria, A.R. (1966). Human Brain and Psychological Processes, Harper & Row.
47. Flanagan, D.P., and Harrison, P.L. (2012). Planning, attention, simultaneous, successive: A cognitive-processing-based theory of intelligence. Contemporary Intellectual Assessment: Theories, Tests, and Issues, The Guilford Press.
48. Campbell, J.I.D. (2005). Development of numerical estimation: A review. Handbook of Mathematical Cognition, Psychological Press.10.4324/9780203998045-20 ↗
49. Dehaene, S. (2009). Origins of mathematical intuitions. The Year in Cognitive Neuroscience 2009, New York Academy of Sciences.10.1111/j.1749-6632.2009.04469.x ↗
50. Statistical learning by 8-month-old infants10.1126/science.274.5294.1926 ↗
51. An Italian battery for the assessment of semantic memory disorders10.1007/s10072-012-1181-z ↗
52. An exploratory study for assessment of multimodal semantic memory in Colombian children10.21500/20112084.4847 ↗
53. Goldstein, S., Princiotta, D., and Naglieri, J.A. (2015). Intelligence and culture: History and assessment. Handbook of Intelligence: Evolutionary Theory, Historical Perspective, and Current Concepts, Springer.10.1007/978-1-4939-1562-0 ↗
54. Embretson, S.E., and Reise, S.P. (2013). Item Response Theory, Lawrence Erlbaum Associates.10.4324/9781410605269 ↗
55. mirt: A multidimensional item response theory package for the R environment10.18637/jss.v048.i06 ↗
56. R Core Team (2021). R: A language and environment for statistical computing. R: Foundation for Statistical Computing, R Core Team.
57. Computerized adaptive testing with R: Recent updates of the package catR10.18637/jss.v076.c01 ↗
58. Development and public release of a computerized adaptive (CAT) version of the Schizotypal Personality Questionnaire10.1016/j.psychres.2018.02.022 ↗