Analysis of Test Results and Test Quality during Certification of Non-Destructive Testing Specialists
Source abstract
Abstract
Abstract This article analyzes the results of personal certification for eddy current testing of railway facilities. The influences of education level, the work experience, the candidate age on the qualifying examinations results are considered. The conformity between test task difficulties and certification candidate training is analyzed with Rasch method. The characteristic curves of test task difficulties and the characteristic curves of candidate training levels are constructed. The results general and special examinations of 2020 and 2021 are analyzed to identify extreme test questions. The research results enable to assess the candidate training and the test task difficulties through latent parameters measured as logit unit. The analysis identified test tasks with overstated and understated task difficulty logits compared with the logits of the candidate training, assessed the correspondence between test difficulties and training candidate level, and assessed a distribution uniformity of the tasks difficulty. The required training logit of candidates for the certification is calculated for successful passing general and special exam tests. The getting results give a basis for further analysis of the tasks complexity, identification the reasons for the insufficiency of the auditory material familiarization for the tasks with low rate of response, for making adjustments to the consulting sessions, as well as the content and form of the test.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Innovative Educational Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (15)
Show source-provided references
1. Berrío Ángela, I., Gomez-Benito, J., and Arias, E.M., Developments and trends in research on methods of detecting differential item functioning, Educ. Res. Rev., 2020, vol. 31, p. 100340. https://doi.org/10.1016/j.edurev.2020.10034010.1016/j.edurev.2020.100340 ↗
2. Boon, H.J. and Lewthwaite, B., Development of an instrument to measure a facet of quality teaching: Culturally responsive pedagogy, Int. J. Educ. Res., 2015, vol. 72, pp. 38–58. https://doi.org/10.1016/j.ijer.2015.05.00210.1016/j.ijer.2015.05.002 ↗
3. Aghekyan, R., Validation of the SIEVEA Instrument using the Rasch analysis, Int. J. Educ. Res., 2020, vol. 103, p. 101619. https://doi.org/10.1016/j.ijer.2020.10161910.1016/j.ijer.2020.101619 ↗
4. Kruit, P., Oostdam, R., van den Berg, E., and Schuitema, J., Performance assessment as a diagnostic tool for science teachers, Res. Sci. Educ., 2020, vol. 50, no. 3, pp. 1093–1117. https://doi.org/10.1007/s11165-018-9724-910.1007/s11165-018-9724-9 ↗
5. Vaughan, B., A Rasch analysis of the revised study process questionnaire in an Australian osteopathy student cohort, Stud. Educ. Eval., 2018, vol. 56, pp. 144–153. https://doi.org/10.1016/j.stueduc.2017.12.00310.1016/j.stueduc.2017.12.003 ↗
6. Ehrich, J.F., Woodcock, S., and West, C., The effect of gender on teaching dispositions: A Rasch measurement approach, Int. J. Educ. Res., 2020, vol. 99, p. 101510. https://doi.org/10.1016/j.ijer.2019.10151010.1016/j.ijer.2019.101510 ↗
7. Zhao Yue, Huen, J.M., and Chan, Y.W., Measuring longitudinal gains in student learning: A comparison of Rasch scoring and summative scoring approaches, Res. Higher Educ., 2017, vol. 58, no. 6, pp. 605–616. https://doi.org/10.1007/s11162-016-9441-z10.1007/s11162-016-9441-z ↗
8. Sabetova, T.V., The use of latent variable method in human resource management, Russ. J. Agric. Socio-Econ. Sci., 2017, vol. 66, no. 6, pp. 123–129. https://doi.org/10.18551/rjoas.2017-06.1410.18551/rjoas.2017-06.14 ↗
9. Van Zile-Tamsen, C., Using Rasch analysis to inform rating scale development, Res. Higher Educ., 2017, vol. 58, no. 8, pp. 922–933. https://doi.org/10.1007/s11162-017-9448-010.1007/s11162-017-9448-0 ↗
10. Jääskä, E. and Aaltonen, K., Teachers’ experiences of using game-based learning methods in project management higher education, Project Leadership Soc., 2022, vol. 3, p. 100041. https://doi.org/10.1016/j.plas.2022.10004110.1016/j.plas.2022.100041 ↗
11. Chang, W.-Ch., Ludlow, L., Grudnoff, L., Ell, F., Haigh, M., and Hill, M.l., Measuring the complexity of teaching practice for equity: Development of a scenario-format scale, Teach. Teacher Educ., 2019, vol. 82, pp. 69–85. https://doi.org/10.1016/j.tate.2019.03.00410.1016/j.tate.2019.03.004 ↗
12. Krasova, N.A. and Aleynikova, N.E., Mathematical modeling of the problem of determining a set of control measures using the fuzzy method of analyzing hierarchies and a method based on measuring latent variables, Model. Optim. Inf. Technol., 2019, vol. 7, no. 3(26), p. 33. https://doi.org/10.26102/2310-6018/2019.26.3.024.10.26102/2310-6018/2019.26.3.024 ↗
13. Korypaeva, Yu.V., Krasova, N.E., Peshkov, V.V., and Ryabov, S.V., Methodology for organizing and assessing the quality of research work of cadets of the military scientific society based on the Rush mathematical model, Vestn. Voronezh. Gos. Tekh. Univ., 2020, vol. 16, no. 2, pp. 65–70. https://doi.org/10.25987/VSTU.2020.16.2.01010.25987/VSTU.2020.16.2.010 ↗
14. Murav’ev, V.V., Volkova, L.V., Platunov, A.V., Bulatova, E.G., and Bajkalova, T.N., Analysis of test results mean specialists in magnetic non-destructive testing for the certification, Kontrol’. Diagn., 2015, no. 10, pp. 36–42. https://doi.org/10.14489/td.2015.010.pp.036-04210.14489/td.2015.010.pp.036-042 ↗
15. Murav’ev, V.V., Murav’eva, O.V., Volkova, L.V., Bogdan, O.P., Platunov, A.V., and Baikalova, T.N., Test quality analysis during specialist certification on acoustic emission nondestructive testing of railway objects, V Mire NK, 2015, vol. 18, no. 3, pp. 66–71.