Automatic Scoring of Laboratory Reports Using Multi-Dimensional Feature Engineering and Ensemble Learning with Dynamic Threshold Control
Source abstract
Abstract
In the field of engineering, the advancement of automated scoring systems for laboratory reports has been significantly hampered by three persistent challenges: scarcity of high-quality annotated data, high domain-specific complexity, and insufficient model interpretability. To address these limitations, this study proposes an AdaBoost regression model based on multi-level feature engineering and threshold control, denoted as MFTC-ABR. This method constructs a multi-dimensional feature set using a lightweight neural network, which evaluates laboratory reports across four core dimensions: comprehension of experimental principles, completion of experimental procedures, depth of result analysis, and plagiarism detection. At the scoring algorithm level, a dynamic threshold adjustment mechanism is integrated into the AdaBoostReg ensemble learning framework. By redesigning the sample weight update rule, the prediction errors of samples are divided into three intervals: the acceptable region, the stable learning range, and the focus range. Accordingly, a differentiated weight update strategy is implemented, and a history-aware mechanism is introduced to further regulate the attention allocated to individual samples. Finally, experimental results on the power electronics laboratory report dataset show that MFTC-ABR model achieves a mean absolute error (MAE) of 3.09 and a scoring consistency rate of 82% within a five-point error tolerance. These findings validate the effectiveness and practicability of the proposed method for automatic assessment in specialized domains with limited data availability.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Machine Learning in Materials Science · Authorship Attribution and Profiling
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Engineering, Henan University of Science and Technology, Luoyang 471023, China
Funding
National Natural Science Foundation of China · Henan University of Science and Technology
References (38)
Show source-provided references
1. Tan, L.Y., Hu, S., Yeo, D.J., and Cheong, K.H. (2025). A Comprehensive Review on Automated Grading Systems in STEM Using AI Techniques. Mathematics, 13.10.3390/math13172828 ↗
2. Vetrivel, S.C., Arun, V.P., Ambikapathi, R., and Saravanan, T.P. (2025). Automated grading systems: Enhancing efficiency and consistency in student assessments. Adopting Artificial Intelligence Tools in Higher Education, CRC Press.10.1201/9781003470304-3 ↗
3. Capdehourat, G., Amigo, I., Lorenzo, B., and Trigo, J. (2025). On the effectiveness of LLMs for automatic grading of open-ended questions in Spanish. arXiv.
4. Chen, Y., Liu, X., Huo, P., Li, L., and Li, F. (2017, January 22–25). The design and implementation for automatic evaluation system of virtual experiment report. Proceedings of the 2017 12th International Conference on Computer Science and Education (ICCSE), Houston, TX, USA.10.1109/ICCSE.2017.8085587 ↗
5. An Automatic Scoring Method for Subjective Questions in the Electrical Field Based on Multi-feature Fusion
6. Magooda, A.E., Zahran, M.A., Rashwan, M.A., Raafat, H.M., and Fayek, M.B. (2016). Vector Based Techniques for Short Answer Grading. Florida Artificial Intelligence Research Society Conference, AAAI Press.
7. Hoblos, J. (2020, January 14–16). Experimenting with latent semantic analysis and latent dirichlet allocation on automated essay grading. Proceedings of the 2020 Seventh International Conference on Social Networks Analysis, Management and Security (SNAMS), Paris, France.10.1109/SNAMS52053.2020.9336533 ↗
8. Ferreira Mello, R., Pereira Junior, C., Rodrigues, L., Pereira, F.D., Cabral, L., Costa, N., Ramalho, G., and Gasevic, D. (2025). Automatic short answer grading in the LLM era: Does GPT-4 with prompt engineering beat traditional models?. Proceedings of the 15th International Learning Analytics and Knowledge Conference, Association for Computing Machinery.10.1145/3706468.3706481 ↗
9. Automated essay grading using machine learning algorithm10.1088/1742-6596/1000/1/012030 ↗
10. Reducing workload in short answer grading using machine learning10.1007/s40593-022-00322-1 ↗
11. Improving Chinese automated essay scoring via deep language analysis
12. An automatic short-answer grading model for semi-open-ended questions10.1080/10494820.2019.1648300 ↗
13. Lertchaturaporn, T., and Songmuang, P. (2024, January 29–31). Automated Scoring Model for Semi-Open-Ended Question in Scientific Explanation. Proceedings of the 2024 IEEE International Conference on Cybernetics and Innovations (ICCI), Chonburi, Thailand.10.1109/ICCI60780.2024.10532484 ↗
14. Bani Saad, M., Jackowska-Strumillo, L., and Bieniecki, W. (2025). Hybrid ANN-Based and Text Similarity Method for Automatic Short-Answer Grading in Polish. Appl. Sci., 15.10.3390/app15031605 ↗
15. An Enhanced Automatic Arabic Essay Scoring System Based on Machine Learning Algorithms
16. Zhu, L., Liu, G., Lv, S., Chen, D., Chen, Z., and Li, X. (2023). An intelligent boosting and decision-tree-regression-based score prediction (BDTR-SP) method in the reform of tertiary education teaching. Information, 14.10.3390/info14060317 ↗
17. Jiao, H., Xu, S., and Liao, M. (2024). Exploration of the Stacking Ensemble Learning Algorithm for Automated Scoring of Constructed-Response Items in Reading Assessment. The Routledge International Handbook of Automated Essay Evaluation, Routledge.10.4324/9781003397618-4 ↗
18. Automatic assessment of students’ engineering design performance using a Bayesian network model10.1177/0735633120960422 ↗
19. Improving Automatic Short Answer Scoring Task Through a Hybrid Deep Learning Framework
20. Automated essay scoring with SBERT embed-dings and LSTM-Attention networks10.7717/peerj-cs.2634 ↗
21. Automated Essay Scoring Method Based on GCN and Fine Tuned BERT
22. Uto, M., and Takahashi, Y. (2024). Neural automated essay scoring for improved confidence estimation and score prediction through integrated classification and regression. International Conference on Artificial Intelligence in Education, Springer Nature.10.1007/978-3-031-64315-6_42 ↗
23. Research on automatic scoring algorithm for English composition based on machine learning
24. Chen, Y., Chen, H., and Su, S. (2023, January 24–26). Fine-tuning large language models in education. Proceedings of the 2023 13th International Conference on Information Technology in Medicine and Education (ITME), Wuyishan, China.10.1109/ITME60234.2023.00148 ↗
25. Zhou, X., Hu, W., Lei, Z., and Liu, G.P. (2023). Implementation and Evaluation of an Automatic Scoring System for Experimental Reports Based on ChatGPT. International Conference on Interactive Collaborative Learning, Springer Nature.10.1007/978-3-031-51979-6_45 ↗
26. Fine-tuning LLMs for psychological and educational assessments: Tutorials for open-source and closed-source LLMs10.1080/15305058.2025.2568389 ↗
27. A Survey of Domain-specific Fine-tuned Large Language Models10.1109/ACCESS.2026.3658096 ↗
28. Ito, Y., and Ma, Q. (2025). Ensemble ToT of LLMs and Its Application to Automatic Grading System for Supporting Self-Learning. arXiv.10.1007/978-3-032-02049-9_18 ↗
29. Schmidgall, S., Su, Y., Wang, Z., Sun, X., Wu, J., Yu, X., Liu, J., Moor, M., Liu, Z., and Barsoum, E. (2025). Agent laboratory: Using llm agents as research assistants. Findings of the Association for Computational Linguistics: EMNLP 2025, Association for Computational Linguistics.10.18653/v1/2025.findings-emnlp.320 ↗
30. Morjaria, L., Burns, L., Gandhi, B., Bracken, K., Farooq, M.S., Levinson, A.J., Ngo, Q., and Sibbald, M. (2026). Can Large Language Models Generate High-Quality Short-Answer Assessments? A Comparative Study in Undergraduate Medical Education. Appl. Sci., 16.10.3390/app16052535 ↗
31. Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilities10.1038/s41524-025-01564-y ↗
32. Hedonic housing prices and the demand for clean air10.1016/0095-0696(78)90006-2 ↗
33. Least angle regression10.1214/009053604000000067 ↗
34. Grinsztajn, L., Flöge, K., Key, O., Birkel, F., Jund, P., Roof, B., Jäger, B., Safaric, D., Alessi, S., and Hayler, A. (2025). Tabpfn-2.5: Advancing the state of the art in tabular foundation models. arXiv.
35. Ye, H.J., Liu, S.Y., and Chao, W.L. (2025). A closer look at tabpfn v2: Strength, limitation, and extension. arXiv.
36. Chen, T., and Guestrin, C. (2016). Xgboost: A scalable tree boosting system. Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery.10.1145/2939672.2939785 ↗
37. Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., and Liu, T.Y. (2017). Lightgbm: A highly efficient gradient boosting decision tree. Advances in Neural Information Processing Systems, NeurIPS Foundation.
38. Advanced Hybrid Prediction Model: Optimizing LightGBM, XGBoost, Lasso Regression and Random Forest with Bayesian Optimization